Jul 17 21:01:43.098318 ip-10-0-137-0 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 21:01:43.098333 ip-10-0-137-0 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 21:01:43.098342 ip-10-0-137-0 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 21:01:43.098667 ip-10-0-137-0 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 21:01:53.347574 ip-10-0-137-0 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 17 21:01:53.347593 ip-10-0-137-0 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 260a44bd2859460ab64dd0d06c5970cd --
Jul 17 21:03:52.349566 ip-10-0-137-0 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 21:03:52.791688 ip-10-0-137-0 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 21:03:52.791688 ip-10-0-137-0 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 21:03:52.791688 ip-10-0-137-0 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 21:03:52.791688 ip-10-0-137-0 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 21:03:52.791688 ip-10-0-137-0 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 21:03:52.793899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.793775    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 21:03:52.800148 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800130    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:03:52.800148 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800147    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800153    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800157    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800160    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800164    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800167    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800172    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800177    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800180    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800183    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800186    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800189    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800193    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800196    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800199    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800208    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800212    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800214    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800218    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:03:52.800227 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800221    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800223    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800226    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800229    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800232    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800235    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800238    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800241    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800244    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800247    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800249    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800252    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800255    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800257    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800260    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800263    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800266    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800269    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800272    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800274    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:03:52.800730 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800277    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800280    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800285    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800288    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800291    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800295    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800298    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800301    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800305    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800307    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800310    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800313    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800316    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800319    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800322    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800325    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800328    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800331    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800334    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:03:52.801250 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800336    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800339    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800342    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800345    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800360    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800363    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800369    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800372    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800375    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800379    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800382    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800385    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800389    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800392    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800395    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800398    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800401    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800406    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800409    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:03:52.801758 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800413    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800416    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800419    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800422    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800425    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800427    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800430    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800433    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800436    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800438    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800441    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800444    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800447    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800449    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800452    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800455    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800458    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800460    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800463    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800466    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:03:52.802277 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.800469    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801207    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801213    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801217    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801219    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801222    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801226    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801229    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801232    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801235    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801238    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801242    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801245    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801248    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801250    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801253    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801256    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801259    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801262    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801265    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:03:52.802792 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801268    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801271    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801273    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801276    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801279    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801282    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801285    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801287    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801290    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801292    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801295    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801298    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801302    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801305    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801307    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801310    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801313    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801316    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801318    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801322    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:03:52.803316 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801324    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801327    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801330    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801334    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801337    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801339    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801342    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801346    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801368    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801371    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801374    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801377    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801379    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801382    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801386    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801389    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801392    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801394    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801397    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801400    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:03:52.803857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801403    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801406    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801408    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801411    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801414    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801417    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801421    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801425    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801428    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801432    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801434    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801438    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801441    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801445    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801448    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801452    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801455    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801458    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801460    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:03:52.804386 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801463    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801467    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801470    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801472    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801475    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801478    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801480    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801483    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801486    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801488    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801491    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801494    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801497    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801499    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801502    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801505    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801508    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801511    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801513    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:03:52.804893 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801516    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801520    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801968    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801974    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801978    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801981    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801985    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801988    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801992    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801996    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.801999    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802004    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802008    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802011    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802015    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802019    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802022    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802025    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:03:52.805417 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802028    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802031    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802033    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802036    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802040    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802044    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802047    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802050    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802053    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802056    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802058    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802061    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802064    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802066    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802069    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802072    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802075    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802078    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802080    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:03:52.805885 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802083    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802085    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802089    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802092    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802095    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802098    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802100    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802104    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802107    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802110    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802113    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802115    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802118    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802121    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802123    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802126    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802129    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802132    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802135    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802138    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:03:52.806384 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802141    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802144    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802146    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802149    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802152    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802154    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802157    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802159    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802162    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802165    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802170    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802173    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802176    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802178    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802181    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802184    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802187    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802190    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802193    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802195    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:03:52.806913 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802198    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802201    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802203    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802206    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802208    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802211    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802214    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802216    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802219    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802221    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802224    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802227    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802230    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802232    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802235    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802237    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802240    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802243    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802246    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802248    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:03:52.807497 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802251    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802254    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802258    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.802260    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802334    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802363    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802371    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802375    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802381    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802384    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802389    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802394    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802397    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802401    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802404    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802408    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802411    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802415    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802418    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802421    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802425    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802428    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802432    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802435    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 21:03:52.808048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802439    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802442    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802446    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802450    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802453    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802457    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802460    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802466    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802469    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802472    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802478    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802481    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802486    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802489    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802493    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802496    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802500    2572 flags.go:64] FLAG: --enable-server="true"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802503    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802509    2572 flags.go:64] FLAG: --event-burst="100"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802512    2572 flags.go:64] FLAG: --event-qps="50"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802516    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802519    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802522    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802526    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 21:03:52.808718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802529    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802532    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802536    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802539    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802542    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802545    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802549    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802552    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802555    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802558    2572 flags.go:64] FLAG: --feature-gates=""
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802562    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802565    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802568    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802571    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802575    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802581    2572 flags.go:64] FLAG: --help="false"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802584    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-137-0.ec2.internal"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802587    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802592    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802595    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802599    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802602    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802605    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 21:03:52.809343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802609    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802612    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802615    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802619    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802622    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802625    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802628    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802632    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802635    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802638    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802641    2572 flags.go:64] FLAG: --lock-file=""
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802644    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802647    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802650    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802656    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802659    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802662    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802665    2572 flags.go:64] FLAG: --logging-format="text"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802668    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802671    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802675    2572 flags.go:64] FLAG: --manifest-url=""
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802678    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802682    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802686    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802692    2572 flags.go:64] FLAG: --max-pods="110"
Jul 17 21:03:52.810108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802695    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802698    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802705    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802711    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802715    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802721    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802724    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802732    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802735    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802739    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802742    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802746    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802752    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802755    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802758    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802762    2572 flags.go:64] FLAG: --port="10250"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802765    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802768    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06fa4d0f5dfc7a4ed"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802772    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802775    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802778    2572 flags.go:64] FLAG: --register-node="true"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802781    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802785    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802788    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 17 21:03:52.810797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802790    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802794    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802798    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802801    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802805    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802808    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802811    2572 flags.go:64] FLAG: --runonce="false"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802817    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802820    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802823    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802826    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802830    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802833    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802836    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802839    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802842    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802845    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802848    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802851    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802855    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802858    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802861    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802867    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802870    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802873    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 21:03:52.811474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802877    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802880    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802883    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802886    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802889    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802892    2572 flags.go:64] FLAG: --v="2"
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802896    2572 flags.go:64] FLAG: --version="false"
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802900    2572 flags.go:64] FLAG: --vmodule=""
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802904    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.802907    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803037    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803041    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803044    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803048    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803055    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803059    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803063    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803066    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803069    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803072    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803075    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:03:52.812290 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803078    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803081    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803083    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803086    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803089    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803092    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803095    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803098    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803101    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803104    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803106    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803109    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803112    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803114    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803117    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803120    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803124    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803128    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803131    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:03:52.813261 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803134    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803137    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803140    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803143    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803145    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803148    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803153    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803155    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803158    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803161    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803164    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803166    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803169    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803172    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803174    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803177    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803180    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803183    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803186    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803189    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:03:52.813845 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803192    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803195    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803197    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803200    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803203    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803205    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803208    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803210    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803213    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803215    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803218    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803221    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803223    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803226    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803229    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803231    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803234    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803237    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803240    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803243    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:03:52.814385 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803248    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803251    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803254    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803257    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803260    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803263    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803266    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803269    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803272    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803275    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803277    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803280    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803283    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803286    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803290    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803293    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803296    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803298    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803301    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803303    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:03:52.814910 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803306    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803309    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803311    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803314    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803317    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803321    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803324    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803327    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.803330    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.804021    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.813169    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.813187    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.813210    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.813216    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 21:03:52.815526 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813293    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813298    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813302    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813305    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813309    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813327    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813330    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813333    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813336    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813339    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813343    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813346    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813349    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813354    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813359    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813363    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813368    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813371    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813374    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813378    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:03:52.815903 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813380    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813384    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813387    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813390    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813398    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813404    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813407    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813410    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813414    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813418    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813422    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813425    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813428    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813431    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813435    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813440    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813443    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813446    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813449    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:03:52.816441 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813452    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813455    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813459    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813461    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813464    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813467    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813469    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813472    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813475    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813478    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813480    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813483    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813486    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813490    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813495    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813500    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813504    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813508    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813511    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:03:52.816933 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813514    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813517    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813521    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813524    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813526    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813529    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813532    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813535    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813538    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813540    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813543    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813546    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813549    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813552    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813554    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813557    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813560    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813563    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813566    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813568    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:03:52.817517 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813571    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813575    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813577    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813580    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813583    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813586    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813588    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813592    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813595    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813597    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813600    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813603    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813606    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813608    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813612    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813615    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813618    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813621    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813624    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813627    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:03:52.818042 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813630    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.813636    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813765    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813770    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813773    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813777    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813780    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813783    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813786    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813789    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813792    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813795    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813798    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813801    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813805    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 21:03:52.818579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813807    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813810    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813813    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813817    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813823    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813827    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813831    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813834    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813836    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813839    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813842    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813845    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813848    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813851    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813854    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813857    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813860    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813863    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 21:03:52.818994 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813865    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813868    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813871    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813874    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813876    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813879    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813882    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813884    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813887    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813890    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813892    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813895    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813898    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813900    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813904    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813906    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813909    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813912    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813915    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813917    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 21:03:52.819579 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813920    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813923    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813925    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813928    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813931    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813933    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813936    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813939    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813942    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813945    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813948    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813950    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813953    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813956    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813959    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813962    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813964    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813967    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813971    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813973    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 21:03:52.820086 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813976    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813979    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813981    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813984    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813988    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813991    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813994    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.813998    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814000    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814003    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814006    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814010    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814012    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814015    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814018    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814021    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814023    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814026    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814029    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 21:03:52.820623 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814032    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814035    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814037    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814040    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814043    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814045    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814048    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814051    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:52.814054    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.814059    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.814194    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.817067    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.818676    2572 server.go:1019] "Starting client certificate rotation"
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.818785    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 21:03:52.821121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.818826    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 21:03:52.821529 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.821280    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 21:03:52.826579 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.826560    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 21:03:52.839748 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.839730    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 17 21:03:52.842841 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.842826    2572 log.go:25] "Validated CRI v1 image API"
Jul 17 21:03:52.843809 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.843791    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 21:03:52.846461 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.846439    2572 fs.go:135] Filesystem UUIDs: map[487fe83a-102b-4281-b85f-01bc6b46154a:/dev/nvme0n1p3 58c9f94d-a02d-4537-9949-d7ad9e5098f8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 17 21:03:52.846546 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.846461    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 21:03:52.854674 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.854536    2572 manager.go:216] Machine: {Timestamp:2026-07-17 21:03:52.853100458 +0000 UTC m=+0.383008905 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099753 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a15fa80875abbcdec966b466e6332 SystemUUID:ec2a15fa-8087-5abb-cdec-966b466e6332 BootID:260a44bd-2859-460a-b64d-d0d06c5970cd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3f:70:43:42:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3f:70:43:42:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:d8:37:19:f2:79 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 21:03:52.854674 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.854655    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 21:03:52.854844 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.854774    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 21:03:52.856258 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.856232    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 21:03:52.858292 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.858259    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 21:03:52.859899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.858297    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 21:03:52.861102 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.861071    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 21:03:52.861102 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.861100    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 21:03:52.861263 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.861112    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 21:03:52.862278 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.862065    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 21:03:52.863741 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.863728    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 21:03:52.867300 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.867287    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 21:03:52.867448 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.867437    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 21:03:52.867511 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.867470    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 21:03:52.867511 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.867480    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 21:03:52.867511 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.867500    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 21:03:52.867511 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.867510    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 17 21:03:52.867697 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.867520    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 21:03:52.867933 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.867919    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 21:03:52.868000 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.867939    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 21:03:52.871085 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.871066    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 21:03:52.872991 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.872975    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 21:03:52.873044 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.873009    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 21:03:52.874311 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874294    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 21:03:52.874378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874319    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 21:03:52.874378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874327    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 21:03:52.874378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874333    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 21:03:52.874378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874343    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 21:03:52.874378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874364    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 21:03:52.874378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874374    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 21:03:52.874378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874380    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 21:03:52.874573 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874388    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 21:03:52.874573 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874394    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 21:03:52.874573 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874407    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 21:03:52.874573 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.874414    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 21:03:52.875362 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.875338    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 21:03:52.875362 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.875358    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 21:03:52.878750 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.878735    2572 server.go:1268] "Started kubelet"
Jul 17 21:03:52.878932 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.878870    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 21:03:52.879030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.878947    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 21:03:52.879241 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.879163    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 21:03:52.879684 ip-10-0-137-0 systemd[1]: Started Kubernetes Kubelet.
Jul 17 21:03:52.880843 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.880826    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 21:03:52.881347 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.881319    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 21:03:52.881347 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.881319    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 21:03:52.881514 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.881390    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 21:03:52.882923 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.882909    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 21:03:52.887413 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.887383    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 21:03:52.889797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.889776    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 21:03:52.889797 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.889775    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 21:03:52.890138 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.890099    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:52.890527 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.890512    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 21:03:52.890667 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.890547    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 21:03:52.890667 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.890667    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 21:03:52.890810 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.890696    2572 factory.go:55] Registering systemd factory
Jul 17 21:03:52.890810 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.890740    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 17 21:03:52.890899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.890820    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 21:03:52.890899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.890831    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 21:03:52.891067 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.891053    2572 factory.go:153] Registering CRI-O factory
Jul 17 21:03:52.891113 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.891071    2572 factory.go:223] Registration of the crio container factory successfully
Jul 17 21:03:52.891161 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.891133    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 21:03:52.891161 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.891158    2572 factory.go:103] Registering Raw factory
Jul 17 21:03:52.891269 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.891175    2572 manager.go:1196] Started watching for new ooms in manager
Jul 17 21:03:52.891684 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.891667    2572 manager.go:349] Starting recovery of all containers
Jul 17 21:03:52.893437 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.893409    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 21:03:52.893940 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.893899    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 21:03:52.904014 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.903985    2572 manager.go:354] Recovery completed
Jul 17 21:03:52.904464 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.903140    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-0.ec2.internal.18c32f9df7913818  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-0.ec2.internal,UID:ip-10-0-137-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-0.ec2.internal,},FirstTimestamp:2026-07-17 21:03:52.87870876 +0000 UTC m=+0.408617205,LastTimestamp:2026-07-17 21:03:52.87870876 +0000 UTC m=+0.408617205,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-0.ec2.internal,}"
Jul 17 21:03:52.908771 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.908757    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:03:52.909536 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.909517    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vs4cb"
Jul 17 21:03:52.913498 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.913477    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:03:52.913603 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.913515    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:03:52.913603 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.913533    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:03:52.914174 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.914156    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 21:03:52.914174 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.914171    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 21:03:52.914325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.914176    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:03:52.914325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.914190    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 21:03:52.915492 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.915474    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:03:52.915563 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.915510    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:03:52.915563 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.915529    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:03:52.915735 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.915723    2572 policy_none.go:49] "None policy: Start"
Jul 17 21:03:52.915773 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.915740    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 21:03:52.915773 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.915755    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 21:03:52.916872 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.916858    2572 policy_none.go:47] "Start"
Jul 17 21:03:52.918149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.918131    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vs4cb"
Jul 17 21:03:52.926672 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.926593    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-0.ec2.internal.18c32f9df9a40dfc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-0.ec2.internal,UID:ip-10-0-137-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-0.ec2.internal,},FirstTimestamp:2026-07-17 21:03:52.913497596 +0000 UTC m=+0.443406049,LastTimestamp:2026-07-17 21:03:52.913497596 +0000 UTC m=+0.443406049,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-0.ec2.internal,}"
Jul 17 21:03:52.952258 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.952057    2572 manager.go:337] "Starting Device Plugin manager"
Jul 17 21:03:52.952386 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.952302    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 21:03:52.952386 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.952332    2572 server.go:87] "Starting device plugin registration server"
Jul 17 21:03:52.952695 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.952680    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 21:03:52.952737 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.952700    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 21:03:52.952830 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.952811    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 21:03:52.952927 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.952904    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 21:03:52.952927 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:52.952914    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 21:03:52.953520 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.953498    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 21:03:52.953633 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:52.953557    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.032983 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.032942    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 21:03:53.034473 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.034402    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 21:03:53.034473 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.034441    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 21:03:53.034473 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.034465    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 21:03:53.034633 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.034502    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 21:03:53.037224 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.037198    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:03:53.053862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.053837    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:03:53.054857 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.054836    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:03:53.054932 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.054875    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:03:53.054932 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.054886    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:03:53.054932 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.054910    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.063353 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.063303    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.063353 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.063327    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-0.ec2.internal\": node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.080005 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.079976    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.135439 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.135393    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"]
Jul 17 21:03:53.135526 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.135488    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:03:53.136513 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.136494    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:03:53.136595 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.136528    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:03:53.136595 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.136540    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:03:53.138186 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.138171    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:03:53.138331 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.138315    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.138406 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.138353    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:03:53.138919 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.138902    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:03:53.138979 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.138935    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:03:53.138979 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.138946    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:03:53.139041 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.138902    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:03:53.139041 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.139013    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:03:53.139041 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.139024    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:03:53.140398 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.140385    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.140451 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.140409    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:03:53.141262 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.141246    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:03:53.141315 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.141269    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:03:53.141315 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.141282    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:03:53.161993 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.161968    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-0.ec2.internal\" not found" node="ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.168189 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.168167    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-0.ec2.internal\" not found" node="ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.180234 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.180205    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.280859 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.280817    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.292053 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.292019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8971edfdd4c8af8372cb230c0909ea80-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8971edfdd4c8af8372cb230c0909ea80\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.292204 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.292057    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30ae21aab87928588e13219334900650-config\") pod \"kube-apiserver-proxy-ip-10-0-137-0.ec2.internal\" (UID: \"30ae21aab87928588e13219334900650\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.292204 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.292084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8971edfdd4c8af8372cb230c0909ea80-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8971edfdd4c8af8372cb230c0909ea80\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.381567 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.381493    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.392717 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.392693    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8971edfdd4c8af8372cb230c0909ea80-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8971edfdd4c8af8372cb230c0909ea80\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.392778 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.392726    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8971edfdd4c8af8372cb230c0909ea80-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8971edfdd4c8af8372cb230c0909ea80\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.392778 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.392749    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30ae21aab87928588e13219334900650-config\") pod \"kube-apiserver-proxy-ip-10-0-137-0.ec2.internal\" (UID: \"30ae21aab87928588e13219334900650\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.392862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.392811    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/30ae21aab87928588e13219334900650-config\") pod \"kube-apiserver-proxy-ip-10-0-137-0.ec2.internal\" (UID: \"30ae21aab87928588e13219334900650\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.392862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.392827    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8971edfdd4c8af8372cb230c0909ea80-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8971edfdd4c8af8372cb230c0909ea80\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.392862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.392812    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8971edfdd4c8af8372cb230c0909ea80-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal\" (UID: \"8971edfdd4c8af8372cb230c0909ea80\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.473015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.472968    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.473099 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.472968    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:53.482523 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.482502    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.586720 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.586675    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.687443 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.687402    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.788214 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.788173    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.818811 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.818780    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 21:03:53.819270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.818943    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 21:03:53.888403 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.888380    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:53.922715 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.922677    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 20:58:53 +0000 UTC" deadline="2028-02-06 18:11:17.499439902 +0000 UTC"
Jul 17 21:03:53.922715 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:53.922711    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13653h7m23.576732612s"
Jul 17 21:03:53.989574 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:53.989475    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:54.008226 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.008191    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:03:54.025698 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.025666    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 21:03:54.026760 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.026744    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 21:03:54.026829 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.026779    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 21:03:54.026829 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.026792    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeHasSufficientPID"
Jul 17 21:03:54.090271 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:54.090063    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:54.098292 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.098259    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:03:54.190511 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:54.190480    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:54.191867 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:54.191821    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ae21aab87928588e13219334900650.slice/crio-c42547198a7c2dd67f7082c136d04583ffc35cc8a4fe74cbd885c50896a625cc WatchSource:0}: Error finding container c42547198a7c2dd67f7082c136d04583ffc35cc8a4fe74cbd885c50896a625cc: Status 404 returned error can't find the container with id c42547198a7c2dd67f7082c136d04583ffc35cc8a4fe74cbd885c50896a625cc
Jul 17 21:03:54.192368 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:54.192340    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8971edfdd4c8af8372cb230c0909ea80.slice/crio-d2832edf2b5a34d1ff6d2234bd61f7a05daccfb34b9e7d324b3e9cc6fa436214 WatchSource:0}: Error finding container d2832edf2b5a34d1ff6d2234bd61f7a05daccfb34b9e7d324b3e9cc6fa436214: Status 404 returned error can't find the container with id d2832edf2b5a34d1ff6d2234bd61f7a05daccfb34b9e7d324b3e9cc6fa436214
Jul 17 21:03:54.198913 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.198898    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:03:54.293301 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:54.293179    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:54.393351 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:54.393320    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-0.ec2.internal\" not found"
Jul 17 21:03:54.475804 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.475774    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:03:54.490832 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.490809    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:54.504630 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.504606    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 21:03:54.506519 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.506505    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal"
Jul 17 21:03:54.516139 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.516120    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 21:03:54.871139 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.871096    2572 apiserver.go:52] "Watching apiserver"
Jul 17 21:03:54.879476 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.879448    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 21:03:54.880952 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.880839    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-4rb5w","kube-system/konnectivity-agent-cjk7f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n","openshift-cluster-node-tuning-operator/tuned-sfncz","openshift-dns/node-resolver-2j9x5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal","openshift-multus/multus-additional-cni-plugins-7cp87","openshift-network-diagnostics/network-check-target-6qxlc","kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal","openshift-image-registry/node-ca-tpzdz","openshift-multus/multus-pcpmh","openshift-multus/network-metrics-daemon-79c8q","openshift-network-operator/iptables-alerter-t9t9m","openshift-ovn-kubernetes/ovnkube-node-hdjmt"]
Jul 17 21:03:54.882997 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.882659    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:03:54.882997 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:54.882751    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:03:54.885257 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.884204    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:03:54.886008 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.885659    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.887489 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.887468    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 21:03:54.887738 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.887719    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 21:03:54.888527 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.888184    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4xvxh\""
Jul 17 21:03:54.888527 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.888212    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:54.888679 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.888584    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:54.889341 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.889002    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 21:03:54.889341 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.889038    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 21:03:54.889341 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.889054    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 21:03:54.889341 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.889210    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 21:03:54.889581 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.889423    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 21:03:54.889679 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.889661    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qbj6k\""
Jul 17 21:03:54.893122 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.891520    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 21:03:54.893122 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.891619    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:54.893122 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.891631    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 21:03:54.893122 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.892466    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:03:54.893122 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.892514    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gptsd\""
Jul 17 21:03:54.893122 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.892951    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 21:03:54.893477 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.893233    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 21:03:54.895015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.893716    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5fbm9\""
Jul 17 21:03:54.895015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.893802    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 21:03:54.895015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.894021    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 21:03:54.895015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.894413    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:54.895015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.894462    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 21:03:54.899599 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.899576    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 21:03:54.899953 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.899933    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qbbjl\""
Jul 17 21:03:54.900030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900017    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900303    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900306    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-run-netns\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900343    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-log-socket\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900369    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-cni-netd\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65sh5\" (UniqueName: \"kubernetes.io/projected/27122130-4533-4388-9dea-f060a7220b42-kube-api-access-65sh5\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900421    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d-konnectivity-ca\") pod \"konnectivity-agent-cjk7f\" (UID: \"13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d\") " pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900445    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e163732-682d-4aa7-a99c-5d82c8cf0861-hosts-file\") pod \"node-resolver-2j9x5\" (UID: \"9e163732-682d-4aa7-a99c-5d82c8cf0861\") " pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900469    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-kubelet\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900491    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-etc-openvswitch\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900516    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-run-openvswitch\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900539    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-node-log\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjwrf\" (UniqueName: \"kubernetes.io/projected/a8844776-05fd-4b99-8266-37edb5ad902b-kube-api-access-fjwrf\") pod \"iptables-alerter-t9t9m\" (UID: \"a8844776-05fd-4b99-8266-37edb5ad902b\") " pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900587    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-systemd-units\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900609    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8844776-05fd-4b99-8266-37edb5ad902b-host-slash\") pod \"iptables-alerter-t9t9m\" (UID: \"a8844776-05fd-4b99-8266-37edb5ad902b\") " pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900634    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpmqd\" (UniqueName: \"kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd\") pod \"network-check-target-6qxlc\" (UID: \"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29\") " pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900658    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-run-systemd\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.901379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-run-ovn\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900725    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e163732-682d-4aa7-a99c-5d82c8cf0861-tmp-dir\") pod \"node-resolver-2j9x5\" (UID: \"9e163732-682d-4aa7-a99c-5d82c8cf0861\") " pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900776    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-cni-bin\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27122130-4533-4388-9dea-f060a7220b42-ovnkube-config\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27122130-4533-4388-9dea-f060a7220b42-env-overrides\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900875    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-var-lib-openvswitch\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900901    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-run-ovn-kubernetes\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900927    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27122130-4533-4388-9dea-f060a7220b42-ovn-node-metrics-cert\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900953    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9ntc\" (UniqueName: \"kubernetes.io/projected/8e03b4ca-563b-404d-9d47-1d53ad3d7428-kube-api-access-n9ntc\") pod \"node-ca-tpzdz\" (UID: \"8e03b4ca-563b-404d-9d47-1d53ad3d7428\") " pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.900981    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d-agent-certs\") pod \"konnectivity-agent-cjk7f\" (UID: \"13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d\") " pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.901005    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-slash\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.901037    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27122130-4533-4388-9dea-f060a7220b42-ovnkube-script-lib\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.901062    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8844776-05fd-4b99-8266-37edb5ad902b-iptables-alerter-script\") pod \"iptables-alerter-t9t9m\" (UID: \"a8844776-05fd-4b99-8266-37edb5ad902b\") " pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.901102    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e03b4ca-563b-404d-9d47-1d53ad3d7428-host\") pod \"node-ca-tpzdz\" (UID: \"8e03b4ca-563b-404d-9d47-1d53ad3d7428\") " pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.901128    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8fsm\" (UniqueName: \"kubernetes.io/projected/9e163732-682d-4aa7-a99c-5d82c8cf0861-kube-api-access-k8fsm\") pod \"node-resolver-2j9x5\" (UID: \"9e163732-682d-4aa7-a99c-5d82c8cf0861\") " pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.901153    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e03b4ca-563b-404d-9d47-1d53ad3d7428-serviceca\") pod \"node-ca-tpzdz\" (UID: \"8e03b4ca-563b-404d-9d47-1d53ad3d7428\") " pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:54.902307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.901493    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:54.903144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.901564    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 21:03:54.903144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.901583    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 21:03:54.903144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.902036    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4qxcd\""
Jul 17 21:03:54.903851 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.903828    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:54.903942 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:54.903898    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:03:54.904921 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.904899    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 21:03:54.905353 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.905333    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:54.905476 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:54.905452    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:03:54.906035 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.906004    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 21:03:54.906343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.906326    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vv8qv\""
Jul 17 21:03:54.906509 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.906442    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m6vq6\""
Jul 17 21:03:54.906509 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.906310    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 21:03:54.906774 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.906757    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 21:03:54.907050 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.907033    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:54.907203 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.907044    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 21:03:54.907553 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.907535    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 21:03:54.910012 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.909992    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 21:03:54.910155 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.910129    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 21:03:54.910399 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.910383    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zpw7v\""
Jul 17 21:03:54.910814 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.910699    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 21:03:54.915665 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.915640    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 21:03:54.951125 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.951100    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hqd5b"
Jul 17 21:03:54.960784 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.960566    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hqd5b"
Jul 17 21:03:54.991556 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:54.991535    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 21:03:55.001761 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001731    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-etc-openvswitch\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.001888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001767    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-run-openvswitch\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.001888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001794    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-node-log\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.001888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001818    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjwrf\" (UniqueName: \"kubernetes.io/projected/a8844776-05fd-4b99-8266-37edb5ad902b-kube-api-access-fjwrf\") pod \"iptables-alerter-t9t9m\" (UID: \"a8844776-05fd-4b99-8266-37edb5ad902b\") " pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:55.001888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001840    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-systemd-units\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.001888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001866    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-run\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001892    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mn9l\" (UniqueName: \"kubernetes.io/projected/b07d1d88-f531-47c2-a741-f00c648db457-kube-api-access-2mn9l\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001918    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-multus-cni-dir\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-run-systemd\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001970    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-run-ovn\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001989    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-systemd-units\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.001998    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002043    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-run-systemd\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002052    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95cff\" (UniqueName: \"kubernetes.io/projected/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-kube-api-access-95cff\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-lib-modules\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002096    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-run-ovn\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002092    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-run-openvswitch\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002106    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-device-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002055    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002130    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-os-release\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002134    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-etc-openvswitch\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.002149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002157    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-hostroot\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002162    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-node-log\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002182    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53de50e6-612c-42d2-b369-675257d073d7-multus-daemon-config\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002224    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002273    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-var-lib-openvswitch\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002342    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27122130-4533-4388-9dea-f060a7220b42-ovn-node-metrics-cert\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002374    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9ntc\" (UniqueName: \"kubernetes.io/projected/8e03b4ca-563b-404d-9d47-1d53ad3d7428-kube-api-access-n9ntc\") pod \"node-ca-tpzdz\" (UID: \"8e03b4ca-563b-404d-9d47-1d53ad3d7428\") " pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002345    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-var-lib-openvswitch\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-system-cni-dir\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002432    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-var-lib-kubelet\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002460    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27122130-4533-4388-9dea-f060a7220b42-ovnkube-script-lib\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002529    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-sys-fs\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002556    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-var-lib-cni-multus\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002586    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fsm\" (UniqueName: \"kubernetes.io/projected/9e163732-682d-4aa7-a99c-5d82c8cf0861-kube-api-access-k8fsm\") pod \"node-resolver-2j9x5\" (UID: \"9e163732-682d-4aa7-a99c-5d82c8cf0861\") " pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002612    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e03b4ca-563b-404d-9d47-1d53ad3d7428-serviceca\") pod \"node-ca-tpzdz\" (UID: \"8e03b4ca-563b-404d-9d47-1d53ad3d7428\") " pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002636    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-sysconfig\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002661    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-var-lib-kubelet\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.003148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002687    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-tuned\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.002714    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-socket-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003212    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003232    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003241    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e834921f-1ae1-4d74-ad9a-622697f5ab2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003308    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-cni-netd\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003335    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65sh5\" (UniqueName: \"kubernetes.io/projected/27122130-4533-4388-9dea-f060a7220b42-kube-api-access-65sh5\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003381    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-kubernetes\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-sysctl-d\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003433    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-registration-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003452    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e03b4ca-563b-404d-9d47-1d53ad3d7428-serviceca\") pod \"node-ca-tpzdz\" (UID: \"8e03b4ca-563b-404d-9d47-1d53ad3d7428\") " pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e834921f-1ae1-4d74-ad9a-622697f5ab2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003488    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzlct\" (UniqueName: \"kubernetes.io/projected/e834921f-1ae1-4d74-ad9a-622697f5ab2f-kube-api-access-kzlct\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003511    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27122130-4533-4388-9dea-f060a7220b42-ovnkube-script-lib\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-multus-socket-dir-parent\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003533    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-cni-netd\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003561    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-kubelet\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.004030 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003602    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003635    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-kubelet\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003687    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-system-cni-dir\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003724    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-etc-kubernetes\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003766    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003804    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8844776-05fd-4b99-8266-37edb5ad902b-host-slash\") pod \"iptables-alerter-t9t9m\" (UID: \"a8844776-05fd-4b99-8266-37edb5ad902b\") " pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003832    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmqd\" (UniqueName: \"kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd\") pod \"network-check-target-6qxlc\" (UID: \"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29\") " pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003859    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-os-release\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003884    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-run-netns\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-multus-conf-dir\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003919    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a8844776-05fd-4b99-8266-37edb5ad902b-host-slash\") pod \"iptables-alerter-t9t9m\" (UID: \"a8844776-05fd-4b99-8266-37edb5ad902b\") " pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003933    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-run-multus-certs\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.003972    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdr4t\" (UniqueName: \"kubernetes.io/projected/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-kube-api-access-fdr4t\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004002    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e163732-682d-4aa7-a99c-5d82c8cf0861-tmp-dir\") pod \"node-resolver-2j9x5\" (UID: \"9e163732-682d-4aa7-a99c-5d82c8cf0861\") " pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004026    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-cnibin\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004052    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53de50e6-612c-42d2-b369-675257d073d7-cni-binary-copy\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004092    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4049b73-3e48-4f93-96a2-bbc2d6da122e-dbus\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:55.005134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004130    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-cni-bin\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004174    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-cni-bin\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004175    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27122130-4533-4388-9dea-f060a7220b42-ovnkube-config\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004226    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27122130-4533-4388-9dea-f060a7220b42-env-overrides\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004342    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nk4g\" (UniqueName: \"kubernetes.io/projected/53de50e6-612c-42d2-b369-675257d073d7-kube-api-access-7nk4g\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004352    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e163732-682d-4aa7-a99c-5d82c8cf0861-tmp-dir\") pod \"node-resolver-2j9x5\" (UID: \"9e163732-682d-4aa7-a99c-5d82c8cf0861\") " pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004371    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-run-ovn-kubernetes\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004399    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d-agent-certs\") pod \"konnectivity-agent-cjk7f\" (UID: \"13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d\") " pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004426    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-systemd\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004453    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e834921f-1ae1-4d74-ad9a-622697f5ab2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004471    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-run-ovn-kubernetes\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004480    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-run-k8s-cni-cncf-io\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004598    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4049b73-3e48-4f93-96a2-bbc2d6da122e-kubelet-config\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-slash\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8844776-05fd-4b99-8266-37edb5ad902b-iptables-alerter-script\") pod \"iptables-alerter-t9t9m\" (UID: \"a8844776-05fd-4b99-8266-37edb5ad902b\") " pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004679    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e03b4ca-563b-404d-9d47-1d53ad3d7428-host\") pod \"node-ca-tpzdz\" (UID: \"8e03b4ca-563b-404d-9d47-1d53ad3d7428\") " pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:55.005805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004681    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27122130-4533-4388-9dea-f060a7220b42-env-overrides\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-cnibin\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004730    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-var-lib-cni-bin\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-slash\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004754    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-sysctl-conf\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004760    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27122130-4533-4388-9dea-f060a7220b42-ovnkube-config\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004779    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-sys\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004816    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-host\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004834    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e03b4ca-563b-404d-9d47-1d53ad3d7428-host\") pod \"node-ca-tpzdz\" (UID: \"8e03b4ca-563b-404d-9d47-1d53ad3d7428\") " pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004839    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-tmp\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004870    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-run-netns\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004900    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-log-socket\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004929    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d-konnectivity-ca\") pod \"konnectivity-agent-cjk7f\" (UID: \"13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d\") " pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004954    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-modprobe-d\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004967    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-host-run-netns\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e163732-682d-4aa7-a99c-5d82c8cf0861-hosts-file\") pod \"node-resolver-2j9x5\" (UID: \"9e163732-682d-4aa7-a99c-5d82c8cf0861\") " pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.004994    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27122130-4533-4388-9dea-f060a7220b42-log-socket\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.006437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.005084    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e163732-682d-4aa7-a99c-5d82c8cf0861-hosts-file\") pod \"node-resolver-2j9x5\" (UID: \"9e163732-682d-4aa7-a99c-5d82c8cf0861\") " pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:55.007311 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.005294    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a8844776-05fd-4b99-8266-37edb5ad902b-iptables-alerter-script\") pod \"iptables-alerter-t9t9m\" (UID: \"a8844776-05fd-4b99-8266-37edb5ad902b\") " pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:55.007311 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.005539    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d-konnectivity-ca\") pod \"konnectivity-agent-cjk7f\" (UID: \"13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d\") " pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:03:55.009195 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.008729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27122130-4533-4388-9dea-f060a7220b42-ovn-node-metrics-cert\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.010960 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.009508    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d-agent-certs\") pod \"konnectivity-agent-cjk7f\" (UID: \"13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d\") " pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:03:55.010960 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.010880    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:03:55.010960 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.010900    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:03:55.010960 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.010919    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fpmqd for pod openshift-network-diagnostics/network-check-target-6qxlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:03:55.011237 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.011012    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd podName:ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:55.510968968 +0000 UTC m=+3.040877419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fpmqd" (UniqueName: "kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd") pod "network-check-target-6qxlc" (UID: "ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:03:55.014466 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.014442    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjwrf\" (UniqueName: \"kubernetes.io/projected/a8844776-05fd-4b99-8266-37edb5ad902b-kube-api-access-fjwrf\") pod \"iptables-alerter-t9t9m\" (UID: \"a8844776-05fd-4b99-8266-37edb5ad902b\") " pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:55.014580 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.014558    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9ntc\" (UniqueName: \"kubernetes.io/projected/8e03b4ca-563b-404d-9d47-1d53ad3d7428-kube-api-access-n9ntc\") pod \"node-ca-tpzdz\" (UID: \"8e03b4ca-563b-404d-9d47-1d53ad3d7428\") " pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:55.015415 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.015338    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8fsm\" (UniqueName: \"kubernetes.io/projected/9e163732-682d-4aa7-a99c-5d82c8cf0861-kube-api-access-k8fsm\") pod \"node-resolver-2j9x5\" (UID: \"9e163732-682d-4aa7-a99c-5d82c8cf0861\") " pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:55.016219 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.016198    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65sh5\" (UniqueName: \"kubernetes.io/projected/27122130-4533-4388-9dea-f060a7220b42-kube-api-access-65sh5\") pod \"ovnkube-node-hdjmt\" (UID: \"27122130-4533-4388-9dea-f060a7220b42\") " pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.039598 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.039545    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal" event={"ID":"30ae21aab87928588e13219334900650","Type":"ContainerStarted","Data":"c42547198a7c2dd67f7082c136d04583ffc35cc8a4fe74cbd885c50896a625cc"}
Jul 17 21:03:55.041975 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.041944    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" event={"ID":"8971edfdd4c8af8372cb230c0909ea80","Type":"ContainerStarted","Data":"d2832edf2b5a34d1ff6d2234bd61f7a05daccfb34b9e7d324b3e9cc6fa436214"}
Jul 17 21:03:55.105658 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105611    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-system-cni-dir\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.105658 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105655    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-var-lib-kubelet\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105683    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-sys-fs\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-var-lib-cni-multus\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105730    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-sysconfig\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105747    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-var-lib-kubelet\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105805    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-sys-fs\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105814    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-var-lib-cni-multus\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105753    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-var-lib-kubelet\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105810    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-sysconfig\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-system-cni-dir\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105853    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-tuned\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105880    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-socket-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.105895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105885    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-var-lib-kubelet\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105920    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105949    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e834921f-1ae1-4d74-ad9a-622697f5ab2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.105978    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-kubernetes\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106001    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-sysctl-d\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106009    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-socket-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106028    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-registration-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e834921f-1ae1-4d74-ad9a-622697f5ab2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzlct\" (UniqueName: \"kubernetes.io/projected/e834921f-1ae1-4d74-ad9a-622697f5ab2f-kube-api-access-kzlct\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106135    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-multus-socket-dir-parent\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106188    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-system-cni-dir\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106218    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-etc-kubernetes\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106244    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-os-release\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106339    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-run-netns\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-multus-conf-dir\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.106520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106410    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-run-multus-certs\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdr4t\" (UniqueName: \"kubernetes.io/projected/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-kube-api-access-fdr4t\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-cnibin\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106648    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e834921f-1ae1-4d74-ad9a-622697f5ab2f-cni-binary-copy\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106660    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53de50e6-612c-42d2-b369-675257d073d7-cni-binary-copy\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106686    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4049b73-3e48-4f93-96a2-bbc2d6da122e-dbus\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106716    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106743    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nk4g\" (UniqueName: \"kubernetes.io/projected/53de50e6-612c-42d2-b369-675257d073d7-kube-api-access-7nk4g\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-systemd\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106774    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106798    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e834921f-1ae1-4d74-ad9a-622697f5ab2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106826    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-run-k8s-cni-cncf-io\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4049b73-3e48-4f93-96a2-bbc2d6da122e-kubelet-config\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-cnibin\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106913    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-var-lib-cni-bin\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106938    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-sysctl-conf\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106964    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-sys\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.107325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.106988    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-host\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-tmp\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107063    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-run-multus-certs\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107053    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-modprobe-d\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107102    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-run\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107141    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-os-release\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.107150    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107168    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mn9l\" (UniqueName: \"kubernetes.io/projected/b07d1d88-f531-47c2-a741-f00c648db457-kube-api-access-2mn9l\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107175    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-kubernetes\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107194    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-multus-conf-dir\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107200    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-multus-cni-dir\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.107218    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret podName:b4049b73-3e48-4f93-96a2-bbc2d6da122e nodeName:}" failed. No retries permitted until 2026-07-17 21:03:55.60719876 +0000 UTC m=+3.137107195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret") pod "global-pull-secret-syncer-4rb5w" (UID: "b4049b73-3e48-4f93-96a2-bbc2d6da122e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107247    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-system-cni-dir\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107324    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-sysctl-d\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107328    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-sys\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107378    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-run-k8s-cni-cncf-io\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.108184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107381    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-registration-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107438    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b4049b73-3e48-4f93-96a2-bbc2d6da122e-kubelet-config\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107451    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-multus-cni-dir\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107527    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-etc-kubernetes\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107598    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-host\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107653    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e834921f-1ae1-4d74-ad9a-622697f5ab2f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107658    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-multus-socket-dir-parent\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107711    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-var-lib-cni-bin\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107762    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-cnibin\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107803    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-host-run-netns\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107813    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-sysctl-conf\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107875    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-run\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107874    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e834921f-1ae1-4d74-ad9a-622697f5ab2f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107889    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-modprobe-d\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107899    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95cff\" (UniqueName: \"kubernetes.io/projected/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-kube-api-access-95cff\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107932    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-lib-modules\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107950    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-cnibin\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107958    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-device-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.109087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.107992    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-os-release\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108003    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b07d1d88-f531-47c2-a741-f00c648db457-device-dir\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108019    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-hostroot\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108045    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53de50e6-612c-42d2-b369-675257d073d7-multus-daemon-config\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108073    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108154    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-lib-modules\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.108164    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108213    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-systemd\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108224    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-os-release\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.108265    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs podName:10b57b9b-866e-49c3-a9d8-344a58e8cd6c nodeName:}" failed. No retries permitted until 2026-07-17 21:03:55.608248326 +0000 UTC m=+3.138156779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs") pod "network-metrics-daemon-79c8q" (UID: "10b57b9b-866e-49c3-a9d8-344a58e8cd6c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108260    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e834921f-1ae1-4d74-ad9a-622697f5ab2f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108269    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53de50e6-612c-42d2-b369-675257d073d7-hostroot\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108275    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b4049b73-3e48-4f93-96a2-bbc2d6da122e-dbus\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108520    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53de50e6-612c-42d2-b369-675257d073d7-cni-binary-copy\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.108736    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53de50e6-612c-42d2-b369-675257d073d7-multus-daemon-config\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.110083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.109091    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-etc-tuned\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.110754 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.110193    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-tmp\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.120871 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.120823    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mn9l\" (UniqueName: \"kubernetes.io/projected/b07d1d88-f531-47c2-a741-f00c648db457-kube-api-access-2mn9l\") pod \"aws-ebs-csi-driver-node-b2w2n\" (UID: \"b07d1d88-f531-47c2-a741-f00c648db457\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.121658 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.121576    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95cff\" (UniqueName: \"kubernetes.io/projected/f0811b8d-f7ae-4b6e-9db5-af187a70ece3-kube-api-access-95cff\") pod \"tuned-sfncz\" (UID: \"f0811b8d-f7ae-4b6e-9db5-af187a70ece3\") " pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.122641 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.122184    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzlct\" (UniqueName: \"kubernetes.io/projected/e834921f-1ae1-4d74-ad9a-622697f5ab2f-kube-api-access-kzlct\") pod \"multus-additional-cni-plugins-7cp87\" (UID: \"e834921f-1ae1-4d74-ad9a-622697f5ab2f\") " pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.122641 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.122615    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nk4g\" (UniqueName: \"kubernetes.io/projected/53de50e6-612c-42d2-b369-675257d073d7-kube-api-access-7nk4g\") pod \"multus-pcpmh\" (UID: \"53de50e6-612c-42d2-b369-675257d073d7\") " pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.122903 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.122881    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdr4t\" (UniqueName: \"kubernetes.io/projected/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-kube-api-access-fdr4t\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:55.202484 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.202449    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:03:55.203302 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.203159    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 21:03:55.209591 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.209566    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:03:55.223626 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.223602    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t9t9m"
Jul 17 21:03:55.229940 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.229907    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2j9x5"
Jul 17 21:03:55.240967 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.240945    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tpzdz"
Jul 17 21:03:55.249121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.249098    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sfncz"
Jul 17 21:03:55.255874 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.255851    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7cp87"
Jul 17 21:03:55.264699 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.264680    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pcpmh"
Jul 17 21:03:55.272664 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.272643    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n"
Jul 17 21:03:55.611994 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.611943    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:55.612188 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.612009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:55.612188 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.612037    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmqd\" (UniqueName: \"kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd\") pod \"network-check-target-6qxlc\" (UID: \"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29\") " pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:03:55.612188 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.612145    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:03:55.612188 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.612166    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:03:55.612188 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.612190    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:03:55.612476 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.612204    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fpmqd for pod openshift-network-diagnostics/network-check-target-6qxlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:03:55.612476 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.612209    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:03:55.612476 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.612237    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret podName:b4049b73-3e48-4f93-96a2-bbc2d6da122e nodeName:}" failed. No retries permitted until 2026-07-17 21:03:56.612212143 +0000 UTC m=+4.142120593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret") pod "global-pull-secret-syncer-4rb5w" (UID: "b4049b73-3e48-4f93-96a2-bbc2d6da122e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:03:55.612476 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.612259    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd podName:ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:56.612247945 +0000 UTC m=+4.142156393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpmqd" (UniqueName: "kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd") pod "network-check-target-6qxlc" (UID: "ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:03:55.612476 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:55.612277    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs podName:10b57b9b-866e-49c3-a9d8-344a58e8cd6c nodeName:}" failed. No retries permitted until 2026-07-17 21:03:56.612267469 +0000 UTC m=+4.142175924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs") pod "network-metrics-daemon-79c8q" (UID: "10b57b9b-866e-49c3-a9d8-344a58e8cd6c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:03:55.963700 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.963662    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 20:58:55 +0000 UTC" deadline="2028-04-26 05:53:09.121381558 +0000 UTC"
Jul 17 21:03:55.963700 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:55.963696    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15560h49m13.157689459s"
Jul 17 21:03:56.035633 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:56.035597    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:03:56.035809 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:56.035739    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:03:56.271237 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:56.271204    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8844776_05fd_4b99_8266_37edb5ad902b.slice/crio-860e19f9138f5268a8cd72b5ce0caac9a27954b64e15350fcebf23e74f56c0b6 WatchSource:0}: Error finding container 860e19f9138f5268a8cd72b5ce0caac9a27954b64e15350fcebf23e74f56c0b6: Status 404 returned error can't find the container with id 860e19f9138f5268a8cd72b5ce0caac9a27954b64e15350fcebf23e74f56c0b6
Jul 17 21:03:56.273112 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:56.273082    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27122130_4533_4388_9dea_f060a7220b42.slice/crio-cd240e72e43f3efba2a41948a435ba214a9e4fb903fb366a6de5845e21c9b3b1 WatchSource:0}: Error finding container cd240e72e43f3efba2a41948a435ba214a9e4fb903fb366a6de5845e21c9b3b1: Status 404 returned error can't find the container with id cd240e72e43f3efba2a41948a435ba214a9e4fb903fb366a6de5845e21c9b3b1
Jul 17 21:03:56.275349 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:56.275323    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53de50e6_612c_42d2_b369_675257d073d7.slice/crio-45ac7be088bec4d98bc9890407239555e1bd1e6505a0cce451cac10d48d64718 WatchSource:0}: Error finding container 45ac7be088bec4d98bc9890407239555e1bd1e6505a0cce451cac10d48d64718: Status 404 returned error can't find the container with id 45ac7be088bec4d98bc9890407239555e1bd1e6505a0cce451cac10d48d64718
Jul 17 21:03:56.280410 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:56.280385    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b0f970_2ea8_4bc0_9f13_3dfd00d78e8d.slice/crio-dbd14cdedd92f21231fa7e86b137e3c5a340603117278a598059574c7aa43227 WatchSource:0}: Error finding container dbd14cdedd92f21231fa7e86b137e3c5a340603117278a598059574c7aa43227: Status 404 returned error can't find the container with id dbd14cdedd92f21231fa7e86b137e3c5a340603117278a598059574c7aa43227
Jul 17 21:03:56.280765 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:56.280739    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07d1d88_f531_47c2_a741_f00c648db457.slice/crio-9d926182bd2f9e8268406ac7730722920c3e327bc2a63a4ff06324f80cdf2b1a WatchSource:0}: Error finding container 9d926182bd2f9e8268406ac7730722920c3e327bc2a63a4ff06324f80cdf2b1a: Status 404 returned error can't find the container with id 9d926182bd2f9e8268406ac7730722920c3e327bc2a63a4ff06324f80cdf2b1a
Jul 17 21:03:56.282754 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:56.282661    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e03b4ca_563b_404d_9d47_1d53ad3d7428.slice/crio-0e9191bece92f9ff63a8e78f49101978b2000ffe0f6a53b70194a04c2c62e15d WatchSource:0}: Error finding container 0e9191bece92f9ff63a8e78f49101978b2000ffe0f6a53b70194a04c2c62e15d: Status 404 returned error can't find the container with id 0e9191bece92f9ff63a8e78f49101978b2000ffe0f6a53b70194a04c2c62e15d
Jul 17 21:03:56.283689 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:56.283594    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e163732_682d_4aa7_a99c_5d82c8cf0861.slice/crio-895a4a6e914a52bf92343a8d0a2118b3ae59c788b17f427d1822a9d95da8fa27 WatchSource:0}: Error finding container 895a4a6e914a52bf92343a8d0a2118b3ae59c788b17f427d1822a9d95da8fa27: Status 404 returned error can't find the container with id 895a4a6e914a52bf92343a8d0a2118b3ae59c788b17f427d1822a9d95da8fa27
Jul 17 21:03:56.285494 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:03:56.284249    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode834921f_1ae1_4d74_ad9a_622697f5ab2f.slice/crio-89360fd9da4e157422d4db2c6d6fbf8efb4a994a184c7fae9e365414fc9bb6c1 WatchSource:0}: Error finding container 89360fd9da4e157422d4db2c6d6fbf8efb4a994a184c7fae9e365414fc9bb6c1: Status 404 returned error can't find the container with id 89360fd9da4e157422d4db2c6d6fbf8efb4a994a184c7fae9e365414fc9bb6c1
Jul 17 21:03:56.622597 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:56.622352    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:56.622780 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:56.622627    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:56.622780 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:56.622656    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmqd\" (UniqueName: \"kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd\") pod \"network-check-target-6qxlc\" (UID: \"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29\") " pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:03:56.622780 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:56.622515    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:03:56.622780 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:56.622737    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs podName:10b57b9b-866e-49c3-a9d8-344a58e8cd6c nodeName:}" failed. No retries permitted until 2026-07-17 21:03:58.622715433 +0000 UTC m=+6.152623882 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs") pod "network-metrics-daemon-79c8q" (UID: "10b57b9b-866e-49c3-a9d8-344a58e8cd6c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:03:56.622944 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:56.622781    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:03:56.622944 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:56.622842    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret podName:b4049b73-3e48-4f93-96a2-bbc2d6da122e nodeName:}" failed. No retries permitted until 2026-07-17 21:03:58.622828246 +0000 UTC m=+6.152736678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret") pod "global-pull-secret-syncer-4rb5w" (UID: "b4049b73-3e48-4f93-96a2-bbc2d6da122e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:03:56.622944 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:56.622789    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:03:56.622944 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:56.622867    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:03:56.622944 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:56.622878    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fpmqd for pod openshift-network-diagnostics/network-check-target-6qxlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:03:56.622944 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:56.622907    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd podName:ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29 nodeName:}" failed. No retries permitted until 2026-07-17 21:03:58.622899932 +0000 UTC m=+6.152808364 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpmqd" (UniqueName: "kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd") pod "network-check-target-6qxlc" (UID: "ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:03:56.964675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:56.964606    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 20:58:55 +0000 UTC" deadline="2027-12-27 07:23:16.229554261 +0000 UTC"
Jul 17 21:03:56.964675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:56.964672    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12658h19m19.26488615s"
Jul 17 21:03:57.038056 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.037319    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:57.038056 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:57.037494    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:03:57.038056 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.037895    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:57.038056 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:57.037993    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:03:57.051156 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.051120    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp87" event={"ID":"e834921f-1ae1-4d74-ad9a-622697f5ab2f","Type":"ContainerStarted","Data":"89360fd9da4e157422d4db2c6d6fbf8efb4a994a184c7fae9e365414fc9bb6c1"}
Jul 17 21:03:57.055918 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.055882    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sfncz" event={"ID":"f0811b8d-f7ae-4b6e-9db5-af187a70ece3","Type":"ContainerStarted","Data":"e81c173e30919c29c735345f2fa58c8c0a90f495179cea38b1875181a74ffb37"}
Jul 17 21:03:57.067701 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.067648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tpzdz" event={"ID":"8e03b4ca-563b-404d-9d47-1d53ad3d7428","Type":"ContainerStarted","Data":"0e9191bece92f9ff63a8e78f49101978b2000ffe0f6a53b70194a04c2c62e15d"}
Jul 17 21:03:57.070215 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.070169    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n" event={"ID":"b07d1d88-f531-47c2-a741-f00c648db457","Type":"ContainerStarted","Data":"9d926182bd2f9e8268406ac7730722920c3e327bc2a63a4ff06324f80cdf2b1a"}
Jul 17 21:03:57.075418 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.075389    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjk7f" event={"ID":"13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d","Type":"ContainerStarted","Data":"dbd14cdedd92f21231fa7e86b137e3c5a340603117278a598059574c7aa43227"}
Jul 17 21:03:57.078027 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.077178    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt" event={"ID":"27122130-4533-4388-9dea-f060a7220b42","Type":"ContainerStarted","Data":"cd240e72e43f3efba2a41948a435ba214a9e4fb903fb366a6de5845e21c9b3b1"}
Jul 17 21:03:57.081469 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.081352    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t9t9m" event={"ID":"a8844776-05fd-4b99-8266-37edb5ad902b","Type":"ContainerStarted","Data":"860e19f9138f5268a8cd72b5ce0caac9a27954b64e15350fcebf23e74f56c0b6"}
Jul 17 21:03:57.089254 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.088572    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal" event={"ID":"30ae21aab87928588e13219334900650","Type":"ContainerStarted","Data":"830745cff9b480ae333fa11a17b11c3aa39b6be0c8d9b10aac97023193c7f3e0"}
Jul 17 21:03:57.094026 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.092508    2572 generic.go:356] "Generic (PLEG): container finished" podID="8971edfdd4c8af8372cb230c0909ea80" containerID="29ed17a0868fa9630fce8f153961c56969bfb965a628a27899607cc660e88578" exitCode=0
Jul 17 21:03:57.094026 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.092582    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" event={"ID":"8971edfdd4c8af8372cb230c0909ea80","Type":"ContainerDied","Data":"29ed17a0868fa9630fce8f153961c56969bfb965a628a27899607cc660e88578"}
Jul 17 21:03:57.097709 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.097684    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2j9x5" event={"ID":"9e163732-682d-4aa7-a99c-5d82c8cf0861","Type":"ContainerStarted","Data":"895a4a6e914a52bf92343a8d0a2118b3ae59c788b17f427d1822a9d95da8fa27"}
Jul 17 21:03:57.102114 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.102053    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pcpmh" event={"ID":"53de50e6-612c-42d2-b369-675257d073d7","Type":"ContainerStarted","Data":"45ac7be088bec4d98bc9890407239555e1bd1e6505a0cce451cac10d48d64718"}
Jul 17 21:03:57.125120 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:57.125059    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-0.ec2.internal" podStartSLOduration=2.125034186 podStartE2EDuration="2.125034186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:03:57.10742293 +0000 UTC m=+4.637331387" watchObservedRunningTime="2026-07-17 21:03:57.125034186 +0000 UTC m=+4.654942644"
Jul 17 21:03:58.034819 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:58.034781    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:03:58.035339 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:58.034926    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:03:58.113757 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:58.113721    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" event={"ID":"8971edfdd4c8af8372cb230c0909ea80","Type":"ContainerStarted","Data":"156c8f43a8919108ab338b88c757f050de20ba176a4fab9c9516d1c7ec8b8333"}
Jul 17 21:03:58.638248 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:58.638208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:58.638477 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:58.638263    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmqd\" (UniqueName: \"kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd\") pod \"network-check-target-6qxlc\" (UID: \"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29\") " pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:03:58.638477 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:58.638343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:58.638477 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:58.638468    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:03:58.638651 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:58.638534    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs podName:10b57b9b-866e-49c3-a9d8-344a58e8cd6c nodeName:}" failed. No retries permitted until 2026-07-17 21:04:02.638513703 +0000 UTC m=+10.168422155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs") pod "network-metrics-daemon-79c8q" (UID: "10b57b9b-866e-49c3-a9d8-344a58e8cd6c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:03:58.638947 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:58.638929    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:03:58.639015 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:58.638984    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret podName:b4049b73-3e48-4f93-96a2-bbc2d6da122e nodeName:}" failed. No retries permitted until 2026-07-17 21:04:02.638968617 +0000 UTC m=+10.168877067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret") pod "global-pull-secret-syncer-4rb5w" (UID: "b4049b73-3e48-4f93-96a2-bbc2d6da122e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:03:58.639082 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:58.639068    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:03:58.639147 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:58.639087    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:03:58.639147 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:58.639101    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fpmqd for pod openshift-network-diagnostics/network-check-target-6qxlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:03:58.639147 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:58.639140    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd podName:ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:02.639127917 +0000 UTC m=+10.169036353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpmqd" (UniqueName: "kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd") pod "network-check-target-6qxlc" (UID: "ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:03:59.035218 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:59.035166    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:03:59.035849 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:59.035337    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:03:59.035849 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:03:59.035166    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:03:59.035849 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:03:59.035482    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:00.034728 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:00.034692    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:00.034923 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:00.034837    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:01.035500 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:01.035462    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:01.036005 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:01.035462    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:01.036005 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:01.035653    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:01.036237 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:01.036191    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:02.035274 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:02.035238    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:02.035478 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:02.035436    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:02.675988 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:02.675939    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:02.675988 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:02.675996    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:02.676501 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:02.676032    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmqd\" (UniqueName: \"kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd\") pod \"network-check-target-6qxlc\" (UID: \"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29\") " pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:02.676501 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:02.676157    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:04:02.676501 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:02.676179    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:04:02.676501 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:02.676191    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fpmqd for pod openshift-network-diagnostics/network-check-target-6qxlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:04:02.676501 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:02.676223    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:04:02.676501 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:02.676238    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:04:02.676501 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:02.676249    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd podName:ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:10.676233916 +0000 UTC m=+18.206142348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpmqd" (UniqueName: "kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd") pod "network-check-target-6qxlc" (UID: "ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:04:02.676501 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:02.676291    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret podName:b4049b73-3e48-4f93-96a2-bbc2d6da122e nodeName:}" failed. No retries permitted until 2026-07-17 21:04:10.676273012 +0000 UTC m=+18.206181445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret") pod "global-pull-secret-syncer-4rb5w" (UID: "b4049b73-3e48-4f93-96a2-bbc2d6da122e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:04:02.676501 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:02.676328    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs podName:10b57b9b-866e-49c3-a9d8-344a58e8cd6c nodeName:}" failed. No retries permitted until 2026-07-17 21:04:10.676316464 +0000 UTC m=+18.206224904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs") pod "network-metrics-daemon-79c8q" (UID: "10b57b9b-866e-49c3-a9d8-344a58e8cd6c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:04:03.036100 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:03.036005    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:03.036265 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:03.036126    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:03.036265 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:03.036137    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:03.036265 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:03.036230    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:04.035734 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:04.035688    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:04.036223 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:04.035828    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:05.034978 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:05.034849    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:05.035130 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:05.034986    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:05.035365 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:05.035311    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:05.035471 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:05.035423    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:06.035444 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:06.035404    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:06.035917 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:06.035563    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:07.034775 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:07.034724    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:07.034983 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:07.034732    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:07.034983 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:07.034877    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:07.034983 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:07.034931    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:08.035496 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:08.035433    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:08.035969 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:08.035565    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:09.035562 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:09.035530    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:09.036056 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:09.035670    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:09.036056 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:09.035727    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:09.036056 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:09.035851    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:10.035064 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:10.035025    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:10.035310 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:10.035154    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:10.739519 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:10.739481    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:10.740007 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:10.739550    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:10.740007 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:10.739575    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmqd\" (UniqueName: \"kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd\") pod \"network-check-target-6qxlc\" (UID: \"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29\") " pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:10.740007 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:10.739664    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:04:10.740007 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:10.739686    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:04:10.740007 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:10.739705    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:04:10.740007 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:10.739713    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:04:10.740007 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:10.739749    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs podName:10b57b9b-866e-49c3-a9d8-344a58e8cd6c nodeName:}" failed. No retries permitted until 2026-07-17 21:04:26.739726543 +0000 UTC m=+34.269634978 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs") pod "network-metrics-daemon-79c8q" (UID: "10b57b9b-866e-49c3-a9d8-344a58e8cd6c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:04:10.740007 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:10.739768    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret podName:b4049b73-3e48-4f93-96a2-bbc2d6da122e nodeName:}" failed. No retries permitted until 2026-07-17 21:04:26.739761677 +0000 UTC m=+34.269670107 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret") pod "global-pull-secret-syncer-4rb5w" (UID: "b4049b73-3e48-4f93-96a2-bbc2d6da122e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:04:10.740007 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:10.739717    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fpmqd for pod openshift-network-diagnostics/network-check-target-6qxlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:04:10.740007 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:10.739898    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd podName:ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:26.739876764 +0000 UTC m=+34.269785202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpmqd" (UniqueName: "kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd") pod "network-check-target-6qxlc" (UID: "ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:04:11.034825 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:11.034745    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:11.034993 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:11.034882    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:11.034993 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:11.034955    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:11.035100 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:11.035070    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:12.035391 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:12.035358    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:12.035796 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:12.035463    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:13.035899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:13.035842    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:13.036366 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:13.035973    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:13.036366 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:13.036029    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:13.036366 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:13.036139    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:14.035328 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:14.035293    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:14.035502 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:14.035410    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:15.035032 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.034642    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:15.035697 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.034725    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:15.035697 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:15.035149    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:15.035697 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:15.035205    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:15.153421 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.153353    2572 generic.go:356] "Generic (PLEG): container finished" podID="e834921f-1ae1-4d74-ad9a-622697f5ab2f" containerID="48c65a0ae11a61281e9342f3bde4efb03e98bfad89571c778a346da4bc44b4db" exitCode=0
Jul 17 21:04:15.153421 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.153382    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp87" event={"ID":"e834921f-1ae1-4d74-ad9a-622697f5ab2f","Type":"ContainerDied","Data":"48c65a0ae11a61281e9342f3bde4efb03e98bfad89571c778a346da4bc44b4db"}
Jul 17 21:04:15.155291 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.155248    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sfncz" event={"ID":"f0811b8d-f7ae-4b6e-9db5-af187a70ece3","Type":"ContainerStarted","Data":"1e101b0449d81947d6fdb541e2a5d8368210d78c250924ca898df83ff19fb0a1"}
Jul 17 21:04:15.156837 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.156802    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tpzdz" event={"ID":"8e03b4ca-563b-404d-9d47-1d53ad3d7428","Type":"ContainerStarted","Data":"87ab8260b798c8c7214e3e95a10ebfff8a6bf1c7b25773426fbabea4b2923c45"}
Jul 17 21:04:15.159213 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.159188    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n" event={"ID":"b07d1d88-f531-47c2-a741-f00c648db457","Type":"ContainerStarted","Data":"81aa5fe0e777b1736b4d5d3a60f9f53f19997f2d3bfb8ff14979f3e34ffd3dec"}
Jul 17 21:04:15.161038 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.161017    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cjk7f" event={"ID":"13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d","Type":"ContainerStarted","Data":"ff03a898def9d31612a232de8cb4a173bfb93c00aa2b8d06801933fff02f6306"}
Jul 17 21:04:15.164622 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.164601    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt" event={"ID":"27122130-4533-4388-9dea-f060a7220b42","Type":"ContainerStarted","Data":"00d681eaf9e91099430c8691f978a966468b6f907b979646bc3ed44de9c0182d"}
Jul 17 21:04:15.164721 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.164679    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt" event={"ID":"27122130-4533-4388-9dea-f060a7220b42","Type":"ContainerStarted","Data":"296feec5a4ff9991e4776ecbbdc619448635700ea85155451a9edbcd5a790631"}
Jul 17 21:04:15.164779 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.164731    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt" event={"ID":"27122130-4533-4388-9dea-f060a7220b42","Type":"ContainerStarted","Data":"22215350b83769f7a217c0696e324ab0e6c0a0b8aaf6cd4b57b2bee3e327ffa1"}
Jul 17 21:04:15.164833 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.164781    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt" event={"ID":"27122130-4533-4388-9dea-f060a7220b42","Type":"ContainerStarted","Data":"6b15b96b730379045623f5ad09b869af92cb41c85484e879a279208a4bb9eeed"}
Jul 17 21:04:15.164886 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.164831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt" event={"ID":"27122130-4533-4388-9dea-f060a7220b42","Type":"ContainerStarted","Data":"d0ebca9ae0bb56facfe01451cc73dbab1eb0fe20568db448e868a6f47aa2d413"}
Jul 17 21:04:15.164886 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.164879    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt" event={"ID":"27122130-4533-4388-9dea-f060a7220b42","Type":"ContainerStarted","Data":"081547e29d8ce42ab38d35587138136edf6f55324205dfb25ab6d9602388b73e"}
Jul 17 21:04:15.166189 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.166161    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2j9x5" event={"ID":"9e163732-682d-4aa7-a99c-5d82c8cf0861","Type":"ContainerStarted","Data":"c392e30e26803e125c75eab2bbb2d6fa6682828920e4630899a6b5c25d70d4b9"}
Jul 17 21:04:15.167713 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.167692    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pcpmh" event={"ID":"53de50e6-612c-42d2-b369-675257d073d7","Type":"ContainerStarted","Data":"6c2dd36fb41c4f375621b3125bb5ffa0f8a6be974ac94c3d1b386f94c19a7c3b"}
Jul 17 21:04:15.179847 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.179794    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-0.ec2.internal" podStartSLOduration=20.179778067 podStartE2EDuration="20.179778067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:03:58.133643848 +0000 UTC m=+5.663552304" watchObservedRunningTime="2026-07-17 21:04:15.179778067 +0000 UTC m=+22.709686519"
Jul 17 21:04:15.195688 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.195629    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cjk7f" podStartSLOduration=13.79261837 podStartE2EDuration="22.195608754s" totalImagesPullingTime="8.402990384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:15.195258027 +0000 UTC m=+22.725166482" watchObservedRunningTime="2026-07-17 21:04:15.195608754 +0000 UTC m=+22.725517207"
Jul 17 21:04:15.213114 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.213061    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2j9x5" podStartSLOduration=8.989492883 podStartE2EDuration="22.213046964s" totalImagesPullingTime="13.223554081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:15.212450117 +0000 UTC m=+22.742358570" watchObservedRunningTime="2026-07-17 21:04:15.213046964 +0000 UTC m=+22.742955416"
Jul 17 21:04:15.228932 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.228838    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tpzdz" podStartSLOduration=13.829977761 podStartE2EDuration="22.228818716s" totalImagesPullingTime="8.398840955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:15.228502168 +0000 UTC m=+22.758410620" watchObservedRunningTime="2026-07-17 21:04:15.228818716 +0000 UTC m=+22.758727185"
Jul 17 21:04:15.251210 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.251153    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sfncz" podStartSLOduration=3.075521338 podStartE2EDuration="21.25113527s" totalImagesPullingTime="18.175613932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:15.250489627 +0000 UTC m=+22.780398083" watchObservedRunningTime="2026-07-17 21:04:15.25113527 +0000 UTC m=+22.781043725"
Jul 17 21:04:15.566176 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.566148    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:04:15.566918 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.566900    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:04:15.613434 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.613391    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pcpmh" podStartSLOduration=3.423160855 podStartE2EDuration="21.613374271s" totalImagesPullingTime="18.190213416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:15.271540014 +0000 UTC m=+22.801448447" watchObservedRunningTime="2026-07-17 21:04:15.613374271 +0000 UTC m=+23.143282722"
Jul 17 21:04:15.614143 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.614123    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 21:04:15.969177 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.969077    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T21:04:15.614138648Z","UUID":"61611d5e-3e54-4dde-a8f6-dfceb217953f","Handler":null,"Name":"","Endpoint":""}
Jul 17 21:04:15.971758 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.971735    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 21:04:15.971918 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:15.971781    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 21:04:16.034962 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:16.034928    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:16.035158 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:16.035070    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:16.172682 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:16.172645    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n" event={"ID":"b07d1d88-f531-47c2-a741-f00c648db457","Type":"ContainerStarted","Data":"93c62df09bc8f0e1a4155afea876134d42c796d388a3a460e6656a81f8953765"}
Jul 17 21:04:16.174196 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:16.174142    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t9t9m" event={"ID":"a8844776-05fd-4b99-8266-37edb5ad902b","Type":"ContainerStarted","Data":"cc411ad4e9347f04d0ba04409798795d02b5efd91e7a7e6f286b126dbf5fa8f7"}
Jul 17 21:04:16.196692 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:16.196639    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t9t9m" podStartSLOduration=14.779747607000001 podStartE2EDuration="23.196625057s" totalImagesPullingTime="8.41687745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:16.195847268 +0000 UTC m=+23.725755720" watchObservedRunningTime="2026-07-17 21:04:16.196625057 +0000 UTC m=+23.726533508"
Jul 17 21:04:16.629333 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:16.629300    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:17.035448 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:17.035419    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:17.035835 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:17.035420    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:17.035835 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:17.035531    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:17.035835 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:17.035638    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:17.178202 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:17.178170    2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 21:04:17.178202 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:17.178185    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n" event={"ID":"b07d1d88-f531-47c2-a741-f00c648db457","Type":"ContainerStarted","Data":"681647995dc7b377eb823db97104275083098094aeb9baa9ee6137d1e0d62daa"}
Jul 17 21:04:17.971317 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:17.971265    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:18.034682 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:18.034647    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:18.034897 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:18.034758    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:18.184379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:18.184345    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt" event={"ID":"27122130-4533-4388-9dea-f060a7220b42","Type":"ContainerStarted","Data":"7be86aadf2336fc6c602904daa30cc708bcf662b15c063d22e0c93448bb3163f"}
Jul 17 21:04:18.814331 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:18.814294    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:04:18.814514 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:18.814420    2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 21:04:18.814923 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:18.814900    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cjk7f"
Jul 17 21:04:18.836210 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:18.836159    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2w2n" podStartSLOduration=4.968036182 podStartE2EDuration="24.836144403s" totalImagesPullingTime="19.868108221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:17.211077803 +0000 UTC m=+24.740986285" watchObservedRunningTime="2026-07-17 21:04:18.836144403 +0000 UTC m=+26.366052855"
Jul 17 21:04:18.904203 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:18.904170    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:19.035082 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:19.035049    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:19.035242 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:19.035049    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:19.035242 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:19.035191    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:19.035382 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:19.035254    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:20.035861 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:20.035656    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:20.036348 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:20.035943    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:21.035061 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:21.035033    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:21.035216 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:21.035080    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:21.035216 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:21.035177    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:21.035345 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:21.035288    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:21.192811 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:21.192772    2572 generic.go:356] "Generic (PLEG): container finished" podID="e834921f-1ae1-4d74-ad9a-622697f5ab2f" containerID="6f0bc21fc0a9d1b0dd8f4e6d3ac0ab24300f5f8c386afe39e6b2809e28e91df5" exitCode=0
Jul 17 21:04:21.193523 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:21.192863    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp87" event={"ID":"e834921f-1ae1-4d74-ad9a-622697f5ab2f","Type":"ContainerDied","Data":"6f0bc21fc0a9d1b0dd8f4e6d3ac0ab24300f5f8c386afe39e6b2809e28e91df5"}
Jul 17 21:04:21.199399 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:21.199372    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt" event={"ID":"27122130-4533-4388-9dea-f060a7220b42","Type":"ContainerStarted","Data":"7d22f950df559ffd3e4fdfbbdc5676579e7d226c08380163f187834e099b6535"}
Jul 17 21:04:21.199648 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:21.199613    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:04:21.199710 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:21.199671    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:04:21.199754 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:21.199718    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:04:21.215233 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:21.215209    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:04:21.215441 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:21.215427    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:04:22.035029 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:22.034991    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:22.035183 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:22.035151    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:22.116961 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:22.116933    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:22.184803 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:22.184622    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:22.590316 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:22.590232    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt" podStartSLOduration=11.168272779 podStartE2EDuration="29.590208118s" totalImagesPullingTime="18.421935339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:21.265805193 +0000 UTC m=+28.795713647" watchObservedRunningTime="2026-07-17 21:04:22.590208118 +0000 UTC m=+30.120116570"
Jul 17 21:04:22.590737 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:22.590483    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4rb5w"]
Jul 17 21:04:22.590737 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:22.590585    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:22.590737 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:22.590667    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:22.594526 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:22.594501    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6qxlc"]
Jul 17 21:04:22.594645 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:22.594583    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:22.594683 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:22.594654    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:22.604553 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:22.604492    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-79c8q"]
Jul 17 21:04:22.604644 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:22.604593    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:22.604718 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:22.604696    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:24.034770 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:24.034740    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:24.035265 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:24.034740    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:24.035265 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:24.034855    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:24.035265 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:24.034908    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:24.207421 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:24.207386    2572 generic.go:356] "Generic (PLEG): container finished" podID="e834921f-1ae1-4d74-ad9a-622697f5ab2f" containerID="3f5501b5b5dcd142bd0a9202eddba78d0c044afaca4e2492448ff997df721ff0" exitCode=0
Jul 17 21:04:24.207566 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:24.207435    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp87" event={"ID":"e834921f-1ae1-4d74-ad9a-622697f5ab2f","Type":"ContainerDied","Data":"3f5501b5b5dcd142bd0a9202eddba78d0c044afaca4e2492448ff997df721ff0"}
Jul 17 21:04:25.035145 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:25.035111    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:25.035536 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:25.035230    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:25.902003 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:25.901823    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:25.996037 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:25.996004    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:26.035143 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:26.035101    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:26.035143 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:26.035151    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:26.035583 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:26.035226    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rb5w" podUID="b4049b73-3e48-4f93-96a2-bbc2d6da122e"
Jul 17 21:04:26.035583 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:26.035310    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6qxlc" podUID="ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29"
Jul 17 21:04:26.214062 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:26.214028    2572 generic.go:356] "Generic (PLEG): container finished" podID="e834921f-1ae1-4d74-ad9a-622697f5ab2f" containerID="5890ad0f123f6f256dd0dbb8918ed69998f35cbb94f22724c0dafd458182414a" exitCode=0
Jul 17 21:04:26.214223 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:26.214075    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp87" event={"ID":"e834921f-1ae1-4d74-ad9a-622697f5ab2f","Type":"ContainerDied","Data":"5890ad0f123f6f256dd0dbb8918ed69998f35cbb94f22724c0dafd458182414a"}
Jul 17 21:04:26.238947 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:26.238911    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:26.316857 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:26.316825    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:26.382823 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:26.382793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:26.751613 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:26.751581    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:26.751784 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:26.751626    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:26.751784 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:26.751722    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 21:04:26.751784 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:26.751725    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:04:26.751784 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:26.751744    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmqd\" (UniqueName: \"kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd\") pod \"network-check-target-6qxlc\" (UID: \"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29\") " pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:26.751784 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:26.751775    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret podName:b4049b73-3e48-4f93-96a2-bbc2d6da122e nodeName:}" failed. No retries permitted until 2026-07-17 21:04:58.751762065 +0000 UTC m=+66.281670500 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret") pod "global-pull-secret-syncer-4rb5w" (UID: "b4049b73-3e48-4f93-96a2-bbc2d6da122e") : object "kube-system"/"original-pull-secret" not registered
Jul 17 21:04:26.751952 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:26.751820    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs podName:10b57b9b-866e-49c3-a9d8-344a58e8cd6c nodeName:}" failed. No retries permitted until 2026-07-17 21:04:58.751800504 +0000 UTC m=+66.281708937 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs") pod "network-metrics-daemon-79c8q" (UID: "10b57b9b-866e-49c3-a9d8-344a58e8cd6c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 21:04:26.751952 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:26.751828    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 21:04:26.751952 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:26.751842    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 21:04:26.751952 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:26.751853    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fpmqd for pod openshift-network-diagnostics/network-check-target-6qxlc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:04:26.751952 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:26.751889    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd podName:ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:58.751880993 +0000 UTC m=+66.281789423 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fpmqd" (UniqueName: "kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd") pod "network-check-target-6qxlc" (UID: "ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 21:04:27.035320 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.035220    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:27.035653 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:27.035396    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-79c8q" podUID="10b57b9b-866e-49c3-a9d8-344a58e8cd6c"
Jul 17 21:04:27.280065 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.280038    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-0.ec2.internal" event="NodeReady"
Jul 17 21:04:27.280233 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.280155    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 21:04:27.335610 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.335532    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5tpzl"]
Jul 17 21:04:27.402973 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.402946    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dnzsx"]
Jul 17 21:04:27.403164 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.403075    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.405606 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.405586    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 21:04:27.405606 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.405601    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 21:04:27.405754 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.405682    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzpb7\""
Jul 17 21:04:27.425466 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.425443    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5tpzl"]
Jul 17 21:04:27.425466 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.425478    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnzsx"]
Jul 17 21:04:27.425630 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.425561    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnzsx"
Jul 17 21:04:27.428062 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.428038    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4hvk8\""
Jul 17 21:04:27.428178 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.428073    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 21:04:27.428352 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.428338    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 21:04:27.428467 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.428451    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 21:04:27.558440 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.558392    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87cd57bb-9e42-4eb1-98bd-37643cb82c86-cert\") pod \"ingress-canary-dnzsx\" (UID: \"87cd57bb-9e42-4eb1-98bd-37643cb82c86\") " pod="openshift-ingress-canary/ingress-canary-dnzsx"
Jul 17 21:04:27.558440 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.558441    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdfq5\" (UniqueName: \"kubernetes.io/projected/87cd57bb-9e42-4eb1-98bd-37643cb82c86-kube-api-access-pdfq5\") pod \"ingress-canary-dnzsx\" (UID: \"87cd57bb-9e42-4eb1-98bd-37643cb82c86\") " pod="openshift-ingress-canary/ingress-canary-dnzsx"
Jul 17 21:04:27.558677 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.558460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.558677 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.558481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99786898-d573-4ee0-a307-ef5c848a1a70-tmp-dir\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.558677 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.558499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99786898-d573-4ee0-a307-ef5c848a1a70-config-volume\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.558677 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.558531    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqb9c\" (UniqueName: \"kubernetes.io/projected/99786898-d573-4ee0-a307-ef5c848a1a70-kube-api-access-zqb9c\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.659383 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.659295    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87cd57bb-9e42-4eb1-98bd-37643cb82c86-cert\") pod \"ingress-canary-dnzsx\" (UID: \"87cd57bb-9e42-4eb1-98bd-37643cb82c86\") " pod="openshift-ingress-canary/ingress-canary-dnzsx"
Jul 17 21:04:27.659383 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.659340    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdfq5\" (UniqueName: \"kubernetes.io/projected/87cd57bb-9e42-4eb1-98bd-37643cb82c86-kube-api-access-pdfq5\") pod \"ingress-canary-dnzsx\" (UID: \"87cd57bb-9e42-4eb1-98bd-37643cb82c86\") " pod="openshift-ingress-canary/ingress-canary-dnzsx"
Jul 17 21:04:27.659383 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.659362    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.659383 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.659384    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99786898-d573-4ee0-a307-ef5c848a1a70-tmp-dir\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.659682 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.659406    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99786898-d573-4ee0-a307-ef5c848a1a70-config-volume\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.659682 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.659447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqb9c\" (UniqueName: \"kubernetes.io/projected/99786898-d573-4ee0-a307-ef5c848a1a70-kube-api-access-zqb9c\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.659682 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:27.659525    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:04:27.659682 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:27.659596    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls podName:99786898-d573-4ee0-a307-ef5c848a1a70 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:28.159575028 +0000 UTC m=+35.689483473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls") pod "dns-default-5tpzl" (UID: "99786898-d573-4ee0-a307-ef5c848a1a70") : secret "dns-default-metrics-tls" not found
Jul 17 21:04:27.659856 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.659748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99786898-d573-4ee0-a307-ef5c848a1a70-tmp-dir\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.659954 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.659932    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99786898-d573-4ee0-a307-ef5c848a1a70-config-volume\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.663754 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.663728    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87cd57bb-9e42-4eb1-98bd-37643cb82c86-cert\") pod \"ingress-canary-dnzsx\" (UID: \"87cd57bb-9e42-4eb1-98bd-37643cb82c86\") " pod="openshift-ingress-canary/ingress-canary-dnzsx"
Jul 17 21:04:27.669313 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.669263    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdfq5\" (UniqueName: \"kubernetes.io/projected/87cd57bb-9e42-4eb1-98bd-37643cb82c86-kube-api-access-pdfq5\") pod \"ingress-canary-dnzsx\" (UID: \"87cd57bb-9e42-4eb1-98bd-37643cb82c86\") " pod="openshift-ingress-canary/ingress-canary-dnzsx"
Jul 17 21:04:27.669410 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.669323    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqb9c\" (UniqueName: \"kubernetes.io/projected/99786898-d573-4ee0-a307-ef5c848a1a70-kube-api-access-zqb9c\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:27.735080 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.735050    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnzsx"
Jul 17 21:04:27.921539 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:27.921509    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnzsx"]
Jul 17 21:04:27.925247 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:04:27.925221    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cd57bb_9e42_4eb1_98bd_37643cb82c86.slice/crio-6171d700021ff9c5d3d5139b9ad4b6704f1455533aec46634d93e25b5a8cd4b4 WatchSource:0}: Error finding container 6171d700021ff9c5d3d5139b9ad4b6704f1455533aec46634d93e25b5a8cd4b4: Status 404 returned error can't find the container with id 6171d700021ff9c5d3d5139b9ad4b6704f1455533aec46634d93e25b5a8cd4b4
Jul 17 21:04:28.034695 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:28.034652    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:28.034876 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:28.034843    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:28.037716 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:28.037692    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 21:04:28.038770 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:28.038748    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5j5fp\""
Jul 17 21:04:28.038889 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:28.038816    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 21:04:28.038889 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:28.038751    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 21:04:28.164320 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:28.164265    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:28.164499 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:28.164452    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:04:28.164547 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:28.164532    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls podName:99786898-d573-4ee0-a307-ef5c848a1a70 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:29.16451086 +0000 UTC m=+36.694419302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls") pod "dns-default-5tpzl" (UID: "99786898-d573-4ee0-a307-ef5c848a1a70") : secret "dns-default-metrics-tls" not found
Jul 17 21:04:28.220130 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:28.220039    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnzsx" event={"ID":"87cd57bb-9e42-4eb1-98bd-37643cb82c86","Type":"ContainerStarted","Data":"6171d700021ff9c5d3d5139b9ad4b6704f1455533aec46634d93e25b5a8cd4b4"}
Jul 17 21:04:28.454842 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:28.454811    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:28.556240 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:28.556159    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:29.034855 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:29.034822    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:29.039179 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:29.039153    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 21:04:29.039179 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:29.039161    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkggp\""
Jul 17 21:04:29.172381 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:29.172350    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:29.172547 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:29.172486    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:04:29.172547 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:29.172544    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls podName:99786898-d573-4ee0-a307-ef5c848a1a70 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:31.172525567 +0000 UTC m=+38.702434015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls") pod "dns-default-5tpzl" (UID: "99786898-d573-4ee0-a307-ef5c848a1a70") : secret "dns-default-metrics-tls" not found
Jul 17 21:04:29.330908 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:29.330822    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:29.559943 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:29.559865    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:31.190847 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:31.190654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:31.191307 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:31.190809    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:04:31.191307 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:31.191010    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls podName:99786898-d573-4ee0-a307-ef5c848a1a70 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:35.190980096 +0000 UTC m=+42.720888539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls") pod "dns-default-5tpzl" (UID: "99786898-d573-4ee0-a307-ef5c848a1a70") : secret "dns-default-metrics-tls" not found
Jul 17 21:04:32.321341 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.321306    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"]
Jul 17 21:04:32.334491 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.334468    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:32.336732 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.336707    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 21:04:32.337729 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.337708    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 21:04:32.337866 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.337732    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4qv2s\""
Jul 17 21:04:32.340344 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.339719    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 17 21:04:32.342603 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.341046    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 17 21:04:32.344070 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.344044    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"]
Jul 17 21:04:32.442461 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.442421    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5cd6b8fd68-w4fm4"]
Jul 17 21:04:32.478625 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.478596    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cd6b8fd68-w4fm4"]
Jul 17 21:04:32.478780 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.478706    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.481417 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.481396    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 21:04:32.481545 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.481445    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 21:04:32.481620 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.481606    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 21:04:32.481828 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.481805    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m2zbl\""
Jul 17 21:04:32.481962 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.481858    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 21:04:32.482016 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.481961    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 21:04:32.485365 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.485348    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 21:04:32.501668 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.501644    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5df51c14-bc3f-46ec-9824-b52e048b48e9-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:32.501777 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.501691    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:32.501844 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.501822    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfhlt\" (UniqueName: \"kubernetes.io/projected/5df51c14-bc3f-46ec-9824-b52e048b48e9-kube-api-access-vfhlt\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:32.603177 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.603144    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-default-certificate\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.603177 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.603178    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc65g\" (UniqueName: \"kubernetes.io/projected/8beac0d0-ad13-4ade-91d3-f69bdcf90233-kube-api-access-nc65g\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.603442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.603269    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfhlt\" (UniqueName: \"kubernetes.io/projected/5df51c14-bc3f-46ec-9824-b52e048b48e9-kube-api-access-vfhlt\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:32.603442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.603321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5df51c14-bc3f-46ec-9824-b52e048b48e9-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:32.603442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.603339    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.603585 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.603472    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:32.603585 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.603523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-stats-auth\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.603585 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.603568    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.603684 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:32.603651    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:32.603761 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:32.603721    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls podName:5df51c14-bc3f-46ec-9824-b52e048b48e9 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:33.103697927 +0000 UTC m=+40.633606367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tn4g4" (UID: "5df51c14-bc3f-46ec-9824-b52e048b48e9") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:32.604097 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.604075    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5df51c14-bc3f-46ec-9824-b52e048b48e9-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:32.607676 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.607650    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:32.613641 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.613621    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfhlt\" (UniqueName: \"kubernetes.io/projected/5df51c14-bc3f-46ec-9824-b52e048b48e9-kube-api-access-vfhlt\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:32.703998 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.703909    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-default-certificate\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.703998 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.703949    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc65g\" (UniqueName: \"kubernetes.io/projected/8beac0d0-ad13-4ade-91d3-f69bdcf90233-kube-api-access-nc65g\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.704215 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.703999    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.704215 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.704044    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-stats-auth\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.704215 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.704077    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.704215 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:32.704168    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:33.204149728 +0000 UTC m=+40.734058162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : configmap references non-existent config key: service-ca.crt
Jul 17 21:04:32.704215 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:32.704175    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:04:32.704427 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:32.704228    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:33.204211916 +0000 UTC m=+40.734120346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : secret "router-metrics-certs-default" not found
Jul 17 21:04:32.706657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.706634    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-stats-auth\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.706775 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.706656    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-default-certificate\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.709179 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.709154    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:32.715656 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.715632    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc65g\" (UniqueName: \"kubernetes.io/projected/8beac0d0-ad13-4ade-91d3-f69bdcf90233-kube-api-access-nc65g\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:32.812077 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:32.812047    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:33.105882 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:33.105800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:33.106025 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:33.105956    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:33.106025 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:33.106020    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls podName:5df51c14-bc3f-46ec-9824-b52e048b48e9 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:34.106004793 +0000 UTC m=+41.635913225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tn4g4" (UID: "5df51c14-bc3f-46ec-9824-b52e048b48e9") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:33.207131 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:33.207092    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:33.207259 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:33.207158    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:33.207259 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:33.207237    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:04:33.207344 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:33.207266    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:34.207249616 +0000 UTC m=+41.737158046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : configmap references non-existent config key: service-ca.crt
Jul 17 21:04:33.207344 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:33.207308    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:34.207297286 +0000 UTC m=+41.737205722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : secret "router-metrics-certs-default" not found
Jul 17 21:04:33.232801 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:33.232766    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnzsx" event={"ID":"87cd57bb-9e42-4eb1-98bd-37643cb82c86","Type":"ContainerStarted","Data":"a45b88ba74e859ff43118bda67ec69d177e8052b00465101bbde147af8df52f8"}
Jul 17 21:04:33.235446 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:33.235420    2572 generic.go:356] "Generic (PLEG): container finished" podID="e834921f-1ae1-4d74-ad9a-622697f5ab2f" containerID="ff802dc343fb5aa2a624ce7d66905943546f5e26b357352359ec707cfd6956f2" exitCode=0
Jul 17 21:04:33.235540 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:33.235462    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp87" event={"ID":"e834921f-1ae1-4d74-ad9a-622697f5ab2f","Type":"ContainerDied","Data":"ff802dc343fb5aa2a624ce7d66905943546f5e26b357352359ec707cfd6956f2"}
Jul 17 21:04:33.252493 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:33.252450    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dnzsx" podStartSLOduration=1.8079842720000001 podStartE2EDuration="6.252435803s" totalImagesPullingTime="4.444451531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:33.251839899 +0000 UTC m=+40.781748362" watchObservedRunningTime="2026-07-17 21:04:33.252435803 +0000 UTC m=+40.782344268"
Jul 17 21:04:34.113867 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:34.113834    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:34.114246 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:34.113966    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:34.114246 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:34.114030    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls podName:5df51c14-bc3f-46ec-9824-b52e048b48e9 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:36.114004639 +0000 UTC m=+43.643913072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tn4g4" (UID: "5df51c14-bc3f-46ec-9824-b52e048b48e9") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:34.214502 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:34.214467    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:34.214675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:34.214546    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:34.214675 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:34.214632    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:04:34.214675 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:34.214664    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:36.214651541 +0000 UTC m=+43.744559970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : configmap references non-existent config key: service-ca.crt
Jul 17 21:04:34.214776 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:34.214687    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:36.214672552 +0000 UTC m=+43.744580982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : secret "router-metrics-certs-default" not found
Jul 17 21:04:34.240675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:34.240645    2572 generic.go:356] "Generic (PLEG): container finished" podID="e834921f-1ae1-4d74-ad9a-622697f5ab2f" containerID="8ad5d0a2b7d7f6c24378d834217c34edd5c8634789c3b0c5d212657d991a323f" exitCode=0
Jul 17 21:04:34.240779 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:34.240729    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp87" event={"ID":"e834921f-1ae1-4d74-ad9a-622697f5ab2f","Type":"ContainerDied","Data":"8ad5d0a2b7d7f6c24378d834217c34edd5c8634789c3b0c5d212657d991a323f"}
Jul 17 21:04:35.223536 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:35.223496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:35.223908 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:35.223622    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:04:35.223908 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:35.223673    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls podName:99786898-d573-4ee0-a307-ef5c848a1a70 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:43.223659677 +0000 UTC m=+50.753568111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls") pod "dns-default-5tpzl" (UID: "99786898-d573-4ee0-a307-ef5c848a1a70") : secret "dns-default-metrics-tls" not found
Jul 17 21:04:35.246393 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:35.246360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7cp87" event={"ID":"e834921f-1ae1-4d74-ad9a-622697f5ab2f","Type":"ContainerStarted","Data":"1aed2f57cc2089766a49c014cccf49c92f9cc0a85eae86de02bd0e6e3b801e1a"}
Jul 17 21:04:35.270463 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:35.270411    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7cp87" podStartSLOduration=7.926161005 podStartE2EDuration="41.270391594s" totalImagesPullingTime="33.344230589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:35.269340759 +0000 UTC m=+42.799249213" watchObservedRunningTime="2026-07-17 21:04:35.270391594 +0000 UTC m=+42.800300045"
Jul 17 21:04:35.398438 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:35.398391    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:35.479079 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:35.479003    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:36.130548 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:36.130510    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:36.130708 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:36.130661    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:36.130750 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:36.130739    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls podName:5df51c14-bc3f-46ec-9824-b52e048b48e9 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:40.130723567 +0000 UTC m=+47.660632000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tn4g4" (UID: "5df51c14-bc3f-46ec-9824-b52e048b48e9") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:36.231632 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:36.231597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:36.231957 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:36.231673    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:36.231957 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:36.231743    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:04:36.231957 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:36.231786    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:40.231773942 +0000 UTC m=+47.761682371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : configmap references non-existent config key: service-ca.crt
Jul 17 21:04:36.231957 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:36.231800    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:40.231794698 +0000 UTC m=+47.761703129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : secret "router-metrics-certs-default" not found
Jul 17 21:04:37.217122 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.217089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:37.300095 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.300064    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:37.317246 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.317217    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg"]
Jul 17 21:04:37.335552 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.335529    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg"
Jul 17 21:04:37.337878 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.337850    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg"]
Jul 17 21:04:37.339134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.339114    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-df52d\""
Jul 17 21:04:37.442012 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.441971    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2ns\" (UniqueName: \"kubernetes.io/projected/6e4b7294-e9d0-431a-80f0-e984d9f08704-kube-api-access-gr2ns\") pod \"network-check-source-7bc5b6bf85-q6mzg\" (UID: \"6e4b7294-e9d0-431a-80f0-e984d9f08704\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg"
Jul 17 21:04:37.542599 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.542519    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2ns\" (UniqueName: \"kubernetes.io/projected/6e4b7294-e9d0-431a-80f0-e984d9f08704-kube-api-access-gr2ns\") pod \"network-check-source-7bc5b6bf85-q6mzg\" (UID: \"6e4b7294-e9d0-431a-80f0-e984d9f08704\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg"
Jul 17 21:04:37.553032 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.552996    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2ns\" (UniqueName: \"kubernetes.io/projected/6e4b7294-e9d0-431a-80f0-e984d9f08704-kube-api-access-gr2ns\") pod \"network-check-source-7bc5b6bf85-q6mzg\" (UID: \"6e4b7294-e9d0-431a-80f0-e984d9f08704\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg"
Jul 17 21:04:37.645381 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.645350    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg"
Jul 17 21:04:37.781586 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:37.781557    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg"]
Jul 17 21:04:37.785544 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:04:37.785520    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4b7294_e9d0_431a_80f0_e984d9f08704.slice/crio-2a9e76601ebba965e491fbdfbd9a208d58b9d09b34a2023a98b7b45a3915a3bb WatchSource:0}: Error finding container 2a9e76601ebba965e491fbdfbd9a208d58b9d09b34a2023a98b7b45a3915a3bb: Status 404 returned error can't find the container with id 2a9e76601ebba965e491fbdfbd9a208d58b9d09b34a2023a98b7b45a3915a3bb
Jul 17 21:04:38.253119 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.253086    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg" event={"ID":"6e4b7294-e9d0-431a-80f0-e984d9f08704","Type":"ContainerStarted","Data":"2a9e76601ebba965e491fbdfbd9a208d58b9d09b34a2023a98b7b45a3915a3bb"}
Jul 17 21:04:38.757596 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.757565    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l9sj9"]
Jul 17 21:04:38.792339 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.792308    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:38.792599 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.792579    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l9sj9"]
Jul 17 21:04:38.792736 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.792702    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:38.795434 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.795413    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 21:04:38.795662 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.795646    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 21:04:38.796000 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.795987    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 21:04:38.796047 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.795986    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 21:04:38.796646 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.796615    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lg9w\""
Jul 17 21:04:38.905024 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.904990    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:38.951836 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.951807    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:38.951982 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.951867    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b93858dd-2569-41a3-a57a-36e97405d3c4-crio-socket\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:38.952021 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.951979    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:38.952021 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.952003    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tv88\" (UniqueName: \"kubernetes.io/projected/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-api-access-8tv88\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:38.952093 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:38.952026    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b93858dd-2569-41a3-a57a-36e97405d3c4-data-volume\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.052657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:39.052562    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.052657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:39.052600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tv88\" (UniqueName: \"kubernetes.io/projected/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-api-access-8tv88\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.052657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:39.052623    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b93858dd-2569-41a3-a57a-36e97405d3c4-data-volume\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.052657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:39.052657    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.052960 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:39.052683    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 21:04:39.052960 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:39.052756    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:39.552735474 +0000 UTC m=+47.082643930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : configmap "kube-rbac-proxy" not found
Jul 17 21:04:39.052960 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:39.052689    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b93858dd-2569-41a3-a57a-36e97405d3c4-crio-socket\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.052960 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:39.052819    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:39.052960 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:39.052862    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b93858dd-2569-41a3-a57a-36e97405d3c4-crio-socket\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.052960 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:39.052891    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:39.552875452 +0000 UTC m=+47.082783902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:39.053169 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:39.053027    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b93858dd-2569-41a3-a57a-36e97405d3c4-data-volume\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.062588 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:39.062560    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tv88\" (UniqueName: \"kubernetes.io/projected/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-api-access-8tv88\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.556803 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:39.556763    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.556990 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:39.556862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:39.556990 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:39.556944    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 21:04:39.556990 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:39.556956    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:39.557144 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:39.557008    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:40.556993879 +0000 UTC m=+48.086902310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : configmap "kube-rbac-proxy" not found
Jul 17 21:04:39.557144 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:39.557035    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:40.557015677 +0000 UTC m=+48.086924108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:40.161117 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:40.161082    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:40.161517 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:40.161239    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:40.161517 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:40.161322    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls podName:5df51c14-bc3f-46ec-9824-b52e048b48e9 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:48.161306518 +0000 UTC m=+55.691214947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tn4g4" (UID: "5df51c14-bc3f-46ec-9824-b52e048b48e9") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:40.262062 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:40.262029    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:40.262208 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:40.262091    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:40.262208 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:40.262176    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:04:40.262335 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:40.262206    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:48.2621897 +0000 UTC m=+55.792098130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : configmap references non-existent config key: service-ca.crt
Jul 17 21:04:40.262335 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:40.262224    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:48.262217885 +0000 UTC m=+55.792126315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : secret "router-metrics-certs-default" not found
Jul 17 21:04:40.430337 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:40.430309    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2j9x5_9e163732-682d-4aa7-a99c-5d82c8cf0861/dns-node-resolver/0.log"
Jul 17 21:04:40.564183 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:40.564144    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:40.564369 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:40.564232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:40.564369 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:40.564269    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 21:04:40.564369 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:40.564354    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:42.564338317 +0000 UTC m=+50.094246746 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : configmap "kube-rbac-proxy" not found
Jul 17 21:04:40.564529 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:40.564377    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:40.564529 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:40.564429    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:42.564414466 +0000 UTC m=+50.094322897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:41.505344 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:41.505261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:41.598687 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:41.598648    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:41.699166 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:41.699131    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:41.826476 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:41.826398    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tpzdz_8e03b4ca-563b-404d-9d47-1d53ad3d7428/node-ca/0.log"
Jul 17 21:04:42.583087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:42.583049    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:42.583465 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:42.583129    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:42.583465 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:42.583207    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 21:04:42.583465 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:42.583313    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:46.583293082 +0000 UTC m=+54.113201532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : configmap "kube-rbac-proxy" not found
Jul 17 21:04:42.583465 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:42.583321    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:42.583465 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:42.583392    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:46.583376676 +0000 UTC m=+54.113285123 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:42.626508 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:42.626477    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnzsx_87cd57bb-9e42-4eb1-98bd-37643cb82c86/serve-healthcheck-canary/0.log"
Jul 17 21:04:43.117563 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:43.117524    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:43.216879 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:43.216845    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:43.266033 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:43.266000    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg" event={"ID":"6e4b7294-e9d0-431a-80f0-e984d9f08704","Type":"ContainerStarted","Data":"4402051e95ae49a3347bd5fcdb6921005d8603cf3693ff5d8e1f507c082c3d5a"}
Jul 17 21:04:43.288061 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:43.288011    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q6mzg" podStartSLOduration=1.482850763 podStartE2EDuration="6.287994445s" totalImagesPullingTime="4.805143682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:43.28723056 +0000 UTC m=+50.817139012" watchObservedRunningTime="2026-07-17 21:04:43.287994445 +0000 UTC m=+50.817902951"
Jul 17 21:04:43.288510 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:43.288490    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:43.288628 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:43.288615    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 21:04:43.288678 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:43.288666    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls podName:99786898-d573-4ee0-a307-ef5c848a1a70 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:59.288652223 +0000 UTC m=+66.818560653 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls") pod "dns-default-5tpzl" (UID: "99786898-d573-4ee0-a307-ef5c848a1a70") : secret "dns-default-metrics-tls" not found
Jul 17 21:04:43.478667 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:43.478615    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:43.575751 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:43.575717    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:43.904727 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:43.904647    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:43.969551 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:43.969520    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:44.217322 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:44.217271    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:44.313748 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:44.313716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:45.767749 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.767715    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-c7l6h"]
Jul 17 21:04:45.792769 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.792738    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-c7l6h"]
Jul 17 21:04:45.792920 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.792828    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:45.795375 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.795348    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rdmxv\""
Jul 17 21:04:45.795375 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.795360    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 17 21:04:45.795375 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.795355    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 17 21:04:45.796029 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.796011    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 17 21:04:45.796109 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.796091    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 17 21:04:45.806185 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.806156    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ffvf\" (UniqueName: \"kubernetes.io/projected/3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f-kube-api-access-9ffvf\") pod \"service-ca-58598695f7-c7l6h\" (UID: \"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f\") " pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:45.806338 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.806221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f-signing-cabundle\") pod \"service-ca-58598695f7-c7l6h\" (UID: \"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f\") " pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:45.806338 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.806297    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f-signing-key\") pod \"service-ca-58598695f7-c7l6h\" (UID: \"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f\") " pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:45.808748 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.808722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:45.875515 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.875476    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:45.906637 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.906600    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ffvf\" (UniqueName: \"kubernetes.io/projected/3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f-kube-api-access-9ffvf\") pod \"service-ca-58598695f7-c7l6h\" (UID: \"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f\") " pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:45.906803 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.906668    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f-signing-cabundle\") pod \"service-ca-58598695f7-c7l6h\" (UID: \"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f\") " pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:45.906803 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.906724    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f-signing-key\") pod \"service-ca-58598695f7-c7l6h\" (UID: \"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f\") " pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:45.907357 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.907336    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f-signing-cabundle\") pod \"service-ca-58598695f7-c7l6h\" (UID: \"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f\") " pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:45.909235 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.909204    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f-signing-key\") pod \"service-ca-58598695f7-c7l6h\" (UID: \"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f\") " pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:45.915116 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:45.915093    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ffvf\" (UniqueName: \"kubernetes.io/projected/3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f-kube-api-access-9ffvf\") pod \"service-ca-58598695f7-c7l6h\" (UID: \"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f\") " pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:46.102577 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:46.102494    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-c7l6h"
Jul 17 21:04:46.246952 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:46.246917    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-c7l6h"]
Jul 17 21:04:46.249783 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:04:46.249742    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f866a48_bfe8_4cce_ae97_30cb7dd4bb7f.slice/crio-f7074152d2313e0e731c5f388492bc8bac62ce57d85aed14afc2b4630f60dfc7 WatchSource:0}: Error finding container f7074152d2313e0e731c5f388492bc8bac62ce57d85aed14afc2b4630f60dfc7: Status 404 returned error can't find the container with id f7074152d2313e0e731c5f388492bc8bac62ce57d85aed14afc2b4630f60dfc7
Jul 17 21:04:46.274328 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:46.274298    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-c7l6h" event={"ID":"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f","Type":"ContainerStarted","Data":"f7074152d2313e0e731c5f388492bc8bac62ce57d85aed14afc2b4630f60dfc7"}
Jul 17 21:04:46.612381 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:46.612339    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:46.612555 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:46.612461    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 21:04:46.612555 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:46.612480    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:46.612555 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:46.612531    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:54.612514454 +0000 UTC m=+62.142422887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : configmap "kube-rbac-proxy" not found
Jul 17 21:04:46.612664 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:46.612588    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:46.612664 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:46.612637    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:04:54.612623473 +0000 UTC m=+62.142531911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:47.313045 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.312983    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"]
Jul 17 21:04:47.315374 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.315352    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.316245 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.316222    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.316425 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.316405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cwt8\" (UniqueName: \"kubernetes.io/projected/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-kube-api-access-6cwt8\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.316495 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.316475    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.316561 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.316550    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-ca\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.316612 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.316587    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.316666 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.316629    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-hub\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.319660 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.319616    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 21:04:47.319660 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.319621    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 21:04:47.320059 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.320038    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 21:04:47.320135 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.320059    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 21:04:47.320796 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.320775    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 21:04:47.320935 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.320857    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 21:04:47.320935 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.320884    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 21:04:47.332585 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.332550    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"]
Jul 17 21:04:47.417076 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.417037    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.417314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.417145    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cwt8\" (UniqueName: \"kubernetes.io/projected/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-kube-api-access-6cwt8\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.417314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.417179    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.417314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.417223    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-ca\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.417314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.417260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.417314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.417312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-hub\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.418501 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.418442    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.423540 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.420715    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.423540 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.420847    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-ca\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.424376 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.424183    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-hub\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.425114 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.425073    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.427171 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.427147    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cwt8\" (UniqueName: \"kubernetes.io/projected/40b19aad-1f3c-496c-a7ae-41ef8404ca7f-kube-api-access-6cwt8\") pod \"cluster-proxy-proxy-agent-59f7855bdb-256dv\" (UID: \"40b19aad-1f3c-496c-a7ae-41ef8404ca7f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.638264 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.638184    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:04:47.932197 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:47.932164    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"]
Jul 17 21:04:47.936085 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:04:47.936056    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40b19aad_1f3c_496c_a7ae_41ef8404ca7f.slice/crio-e07f3e3a620460abb903908630f44f468cdd395372b63c20f3ca2bd9f82b4efd WatchSource:0}: Error finding container e07f3e3a620460abb903908630f44f468cdd395372b63c20f3ca2bd9f82b4efd: Status 404 returned error can't find the container with id e07f3e3a620460abb903908630f44f468cdd395372b63c20f3ca2bd9f82b4efd
Jul 17 21:04:48.176086 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:48.176054    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:48.224832 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:48.224801    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:04:48.224994 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:48.224947    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:48.225051 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:48.225013    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls podName:5df51c14-bc3f-46ec-9824-b52e048b48e9 nodeName:}" failed. No retries permitted until 2026-07-17 21:05:04.224997592 +0000 UTC m=+71.754906025 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-tn4g4" (UID: "5df51c14-bc3f-46ec-9824-b52e048b48e9") : secret "cluster-monitoring-operator-tls" not found
Jul 17 21:04:48.282233 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:48.282193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-c7l6h" event={"ID":"3f866a48-bfe8-4cce-ae97-30cb7dd4bb7f","Type":"ContainerStarted","Data":"889ed063741c5132cfb3ce578d1fefe5b519236d4995d3ec443cf8298b6bef57"}
Jul 17 21:04:48.283326 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:48.283304    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" event={"ID":"40b19aad-1f3c-496c-a7ae-41ef8404ca7f","Type":"ContainerStarted","Data":"e07f3e3a620460abb903908630f44f468cdd395372b63c20f3ca2bd9f82b4efd"}
Jul 17 21:04:48.302882 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:48.302826    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-c7l6h" podStartSLOduration=1.718762421 podStartE2EDuration="3.302810102s" totalImagesPullingTime="1.584047681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:48.301415275 +0000 UTC m=+55.831323726" watchObservedRunningTime="2026-07-17 21:04:48.302810102 +0000 UTC m=+55.832718532"
Jul 17 21:04:48.325430 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:48.325397    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:48.325850 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:48.325447    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:04:48.325850 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:48.325527    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 21:04:48.325850 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:48.325596    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:05:04.325570055 +0000 UTC m=+71.855478491 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : secret "router-metrics-certs-default" not found
Jul 17 21:04:48.325850 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:48.325624    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle podName:8beac0d0-ad13-4ade-91d3-f69bdcf90233 nodeName:}" failed. No retries permitted until 2026-07-17 21:05:04.325613466 +0000 UTC m=+71.855521901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle") pod "router-default-5cd6b8fd68-w4fm4" (UID: "8beac0d0-ad13-4ade-91d3-f69bdcf90233") : configmap references non-existent config key: service-ca.crt
Jul 17 21:04:49.520878 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:49.520844    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:49.737270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:49.737222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:49.841675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:49.841580    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:50.010056 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:50.010023    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:50.122206 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:50.122083    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:50.248113 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:50.248079    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:51.003105 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:51.003078    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:51.406108 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:51.406025    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:51.653801 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:51.653771    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:51.792193 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:51.792161    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:51.865010 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:51.864981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:52.206406 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:52.206373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:52.405519 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:52.405487    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:52.807771 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:52.807740    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:53.215477 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:53.215442    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:53.217021 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:53.217005    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hdjmt"
Jul 17 21:04:53.364197 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:53.364166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:53.445095 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:53.445054    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:54.032793 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:54.032739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:54.200515 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:54.200480    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:54.305317 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:54.302265    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:54.405425 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:54.405361    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:54.606781 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:54.606655    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:54.683326 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:54.682311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:54.683326 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:54.682416    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:54.683326 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:54.682558    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:54.683326 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:04:54.682622    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls podName:b93858dd-2569-41a3-a57a-36e97405d3c4 nodeName:}" failed. No retries permitted until 2026-07-17 21:05:10.682603374 +0000 UTC m=+78.212511810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9sj9" (UID: "b93858dd-2569-41a3-a57a-36e97405d3c4") : secret "insights-runtime-extractor-tls" not found
Jul 17 21:04:54.683986 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:54.683933    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b93858dd-2569-41a3-a57a-36e97405d3c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:04:55.430634 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:55.430598    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:55.508557 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:55.508517    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:55.600804 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:55.600758    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:55.887465 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:55.887371    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:55.989069 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:55.989034    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:56.053290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:56.053240    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:56.591723 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:56.591634    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:57.049811 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:57.049783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:57.123440 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:57.123411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:57.192764 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:57.192737    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:57.312562 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:57.312473    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" event={"ID":"40b19aad-1f3c-496c-a7ae-41ef8404ca7f","Type":"ContainerStarted","Data":"10ecbbf6dc301289448012f279dc14fd73f4c89ce4371051002af6c28a820b6b"}
Jul 17 21:04:57.312562 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:57.312524    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" event={"ID":"40b19aad-1f3c-496c-a7ae-41ef8404ca7f","Type":"ContainerStarted","Data":"53537c95cc1971913d2f193a0867c63d36ff715264ba8b77c03c1dd53622a1c9"}
Jul 17 21:04:57.312562 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:57.312545    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" event={"ID":"40b19aad-1f3c-496c-a7ae-41ef8404ca7f","Type":"ContainerStarted","Data":"7114541f3930b8df1e1af0e06f60865b708198e67d72cb053ffbb51e34024153"}
Jul 17 21:04:57.335785 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:57.335730    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" podStartSLOduration=1.950921535 podStartE2EDuration="10.335715529s" totalImagesPullingTime="8.384793994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:57.334310909 +0000 UTC m=+64.864219364" watchObservedRunningTime="2026-07-17 21:04:57.335715529 +0000 UTC m=+64.865623982"
Jul 17 21:04:57.412303 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:57.412255    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:57.808443 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:57.808411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:58.013139 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.013108    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:58.616444 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.616390    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:58.819575 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.819534    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:58.819999 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.819590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:58.819999 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.819687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmqd\" (UniqueName: \"kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd\") pod \"network-check-target-6qxlc\" (UID: \"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29\") " pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:58.822256 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.822234    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpmqd\" (UniqueName: \"kubernetes.io/projected/ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29-kube-api-access-fpmqd\") pod \"network-check-target-6qxlc\" (UID: \"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29\") " pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:58.822792 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.822772    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 21:04:58.823574 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.823560    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 21:04:58.832606 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.832580    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b4049b73-3e48-4f93-96a2-bbc2d6da122e-original-pull-secret\") pod \"global-pull-secret-syncer-4rb5w\" (UID: \"b4049b73-3e48-4f93-96a2-bbc2d6da122e\") " pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:58.832719 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.832625    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10b57b9b-866e-49c3-a9d8-344a58e8cd6c-metrics-certs\") pod \"network-metrics-daemon-79c8q\" (UID: \"10b57b9b-866e-49c3-a9d8-344a58e8cd6c\") " pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:58.949299 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.949242    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5j5fp\""
Jul 17 21:04:58.953715 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.953692    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rb5w"
Jul 17 21:04:58.957650 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.957629    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:58.997741 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:58.997682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:59.049892 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.049867    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkggp\""
Jul 17 21:04:59.057496 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.057472    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-79c8q"
Jul 17 21:04:59.091470 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.091436    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4rb5w"]
Jul 17 21:04:59.094100 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:04:59.094069    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4049b73_3e48_4f93_96a2_bbc2d6da122e.slice/crio-06860768121c38d9cb692ab4039814bd3c85e9eeaed8231be8b130c70117ca26 WatchSource:0}: Error finding container 06860768121c38d9cb692ab4039814bd3c85e9eeaed8231be8b130c70117ca26: Status 404 returned error can't find the container with id 06860768121c38d9cb692ab4039814bd3c85e9eeaed8231be8b130c70117ca26
Jul 17 21:04:59.113442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.113414    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6qxlc"]
Jul 17 21:04:59.118031 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:04:59.117979    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9baee1_fd43_4cfa_8bb8_2ab4229d6a29.slice/crio-10fce7b0beafda88a3132d8ebf5f1fb206cc4ac6c6530a17906905c74306950b WatchSource:0}: Error finding container 10fce7b0beafda88a3132d8ebf5f1fb206cc4ac6c6530a17906905c74306950b: Status 404 returned error can't find the container with id 10fce7b0beafda88a3132d8ebf5f1fb206cc4ac6c6530a17906905c74306950b
Jul 17 21:04:59.204995 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.204920    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-79c8q"]
Jul 17 21:04:59.208013 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:04:59.207987    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b57b9b_866e_49c3_a9d8_344a58e8cd6c.slice/crio-7a12d74007d742b0d41f7b664e250bc9579bc2cb794e40b0e7c66a14a36c28e9 WatchSource:0}: Error finding container 7a12d74007d742b0d41f7b664e250bc9579bc2cb794e40b0e7c66a14a36c28e9: Status 404 returned error can't find the container with id 7a12d74007d742b0d41f7b664e250bc9579bc2cb794e40b0e7c66a14a36c28e9
Jul 17 21:04:59.246619 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.246590    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:59.320525 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.320485    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4rb5w" event={"ID":"b4049b73-3e48-4f93-96a2-bbc2d6da122e","Type":"ContainerStarted","Data":"06860768121c38d9cb692ab4039814bd3c85e9eeaed8231be8b130c70117ca26"}
Jul 17 21:04:59.321674 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.321638    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-79c8q" event={"ID":"10b57b9b-866e-49c3-a9d8-344a58e8cd6c","Type":"ContainerStarted","Data":"7a12d74007d742b0d41f7b664e250bc9579bc2cb794e40b0e7c66a14a36c28e9"}
Jul 17 21:04:59.323098 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.323076    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6qxlc" event={"ID":"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29","Type":"ContainerStarted","Data":"95483a4a2a9d47d639c303330597fe9917fba319f4f26de65697cfbbc66d0164"}
Jul 17 21:04:59.323202 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.323111    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6qxlc" event={"ID":"ca9baee1-fd43-4cfa-8bb8-2ab4229d6a29","Type":"ContainerStarted","Data":"10fce7b0beafda88a3132d8ebf5f1fb206cc4ac6c6530a17906905c74306950b"}
Jul 17 21:04:59.323243 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.323202    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:04:59.325593 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.325575    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:59.327846 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.327821    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99786898-d573-4ee0-a307-ef5c848a1a70-metrics-tls\") pod \"dns-default-5tpzl\" (UID: \"99786898-d573-4ee0-a307-ef5c848a1a70\") " pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:59.352196 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.352146    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6qxlc" podStartSLOduration=66.352132021 podStartE2EDuration="1m6.352132021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:03:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:04:59.35143355 +0000 UTC m=+66.881342045" watchObservedRunningTime="2026-07-17 21:04:59.352132021 +0000 UTC m=+66.882040472"
Jul 17 21:04:59.514341 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.514243    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nzpb7\""
Jul 17 21:04:59.522052 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.522033    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:04:59.611400 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.611370    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:04:59.651860 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.651831    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5tpzl"]
Jul 17 21:04:59.654704 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:04:59.654678    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99786898_d573_4ee0_a307_ef5c848a1a70.slice/crio-f9ec76ffdc70edd6f0fe00167b1ba2c302ea7522a6dd16aa60d3ccbe3d5ba628 WatchSource:0}: Error finding container f9ec76ffdc70edd6f0fe00167b1ba2c302ea7522a6dd16aa60d3ccbe3d5ba628: Status 404 returned error can't find the container with id f9ec76ffdc70edd6f0fe00167b1ba2c302ea7522a6dd16aa60d3ccbe3d5ba628
Jul 17 21:04:59.986206 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:04:59.986170    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:00.093185 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:00.093140    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:00.242213 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:00.242117    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:00.327724 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:00.327687    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tpzl" event={"ID":"99786898-d573-4ee0-a307-ef5c848a1a70","Type":"ContainerStarted","Data":"f9ec76ffdc70edd6f0fe00167b1ba2c302ea7522a6dd16aa60d3ccbe3d5ba628"}
Jul 17 21:05:00.363012 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:00.362976    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:00.467780 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:00.467736    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:00.565311 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:00.565207    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:00.624771 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:00.624738    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:00.691200 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:00.691160    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:00.887677 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:00.887586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:00.988573 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:00.988507    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:01.666716 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:01.666652    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:02.065567 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.065533    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:02.337043 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.336846    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-79c8q" event={"ID":"10b57b9b-866e-49c3-a9d8-344a58e8cd6c","Type":"ContainerStarted","Data":"05a823e5015758d6b5264e0608c6d0a6b0d09bfa3424e05b4a8a359d7aa9e0e0"}
Jul 17 21:05:02.337225 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.337043    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-79c8q" event={"ID":"10b57b9b-866e-49c3-a9d8-344a58e8cd6c","Type":"ContainerStarted","Data":"56273bee6565df5ba42cc0a4cbd88bcc9a982bc8af13bbb74f40d9730f96338b"}
Jul 17 21:05:02.339035 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.338991    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tpzl" event={"ID":"99786898-d573-4ee0-a307-ef5c848a1a70","Type":"ContainerStarted","Data":"d63fab53819f4d4aa2900be47c6e793676ef66116547bb070bedc73efa823265"}
Jul 17 21:05:02.339153 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.339054    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5tpzl" event={"ID":"99786898-d573-4ee0-a307-ef5c848a1a70","Type":"ContainerStarted","Data":"7f2ebb5652c01b1f4d7ded02f2cddd6d21006373cb062c1726dc0403a4dd3c40"}
Jul 17 21:05:02.339153 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.339083    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:05:02.355240 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.355193    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-79c8q" podStartSLOduration=66.047054582 podStartE2EDuration="1m8.355173838s" totalImagesPullingTime="2.308119256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:02.3540332 +0000 UTC m=+69.883941673" watchObservedRunningTime="2026-07-17 21:05:02.355173838 +0000 UTC m=+69.885082291"
Jul 17 21:05:02.373945 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.373894    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5tpzl" podStartSLOduration=33.509877679 podStartE2EDuration="35.373878582s" totalImagesPullingTime="1.864000903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:02.37315651 +0000 UTC m=+69.903064963" watchObservedRunningTime="2026-07-17 21:05:02.373878582 +0000 UTC m=+69.903787033"
Jul 17 21:05:02.483395 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.483358    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:02.585536 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.585493    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:02.701600 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:02.701565    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:04.266827 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.266790    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:05:04.269240 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.269213    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df51c14-bc3f-46ec-9824-b52e048b48e9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-tn4g4\" (UID: \"5df51c14-bc3f-46ec-9824-b52e048b48e9\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:05:04.367429 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.367392    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:05:04.367584 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.367485    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:05:04.368008 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.367985    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8beac0d0-ad13-4ade-91d3-f69bdcf90233-service-ca-bundle\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:05:04.369751 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.369729    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8beac0d0-ad13-4ade-91d3-f69bdcf90233-metrics-certs\") pod \"router-default-5cd6b8fd68-w4fm4\" (UID: \"8beac0d0-ad13-4ade-91d3-f69bdcf90233\") " pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:05:04.448507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.448471    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4qv2s\""
Jul 17 21:05:04.457173 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.457150    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"
Jul 17 21:05:04.597796 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.597767    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-m2zbl\""
Jul 17 21:05:04.605851 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.605820    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:05:04.651838 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.651811    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4"]
Jul 17 21:05:04.653026 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:05:04.652989    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df51c14_bc3f_46ec_9824_b52e048b48e9.slice/crio-cb38b5e7824359bfc2c7d0f96977702d0c50fd36d890ca654aa5a940eed70ea4 WatchSource:0}: Error finding container cb38b5e7824359bfc2c7d0f96977702d0c50fd36d890ca654aa5a940eed70ea4: Status 404 returned error can't find the container with id cb38b5e7824359bfc2c7d0f96977702d0c50fd36d890ca654aa5a940eed70ea4
Jul 17 21:05:04.774131 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:04.773986    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5cd6b8fd68-w4fm4"]
Jul 17 21:05:05.352023 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:05.351974    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4" event={"ID":"8beac0d0-ad13-4ade-91d3-f69bdcf90233","Type":"ContainerStarted","Data":"cda28f583198ebc3bcab29b7ba0f40e39f812cc5129ba0d2ea46f2b304310197"}
Jul 17 21:05:05.352475 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:05.352049    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4" event={"ID":"8beac0d0-ad13-4ade-91d3-f69bdcf90233","Type":"ContainerStarted","Data":"81305084603b43e66ee80b18c9e92111742707ea014878bb68f563c6e6140b7b"}
Jul 17 21:05:05.354085 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:05.354050    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4" event={"ID":"5df51c14-bc3f-46ec-9824-b52e048b48e9","Type":"ContainerStarted","Data":"cb38b5e7824359bfc2c7d0f96977702d0c50fd36d890ca654aa5a940eed70ea4"}
Jul 17 21:05:05.357335 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:05.357306    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4rb5w" event={"ID":"b4049b73-3e48-4f93-96a2-bbc2d6da122e","Type":"ContainerStarted","Data":"c68c5f925661df141e0976dd06209cf4c98c917ec3f791bf31167bdbe7ea0358"}
Jul 17 21:05:05.375343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:05.375294    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4" podStartSLOduration=33.375262719 podStartE2EDuration="33.375262719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:05.3741698 +0000 UTC m=+72.904078291" watchObservedRunningTime="2026-07-17 21:05:05.375262719 +0000 UTC m=+72.905171172"
Jul 17 21:05:05.396675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:05.396605    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4rb5w" podStartSLOduration=65.966677107 podStartE2EDuration="1m11.396582323s" totalImagesPullingTime="5.429905216s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:05.39566211 +0000 UTC m=+72.925570563" watchObservedRunningTime="2026-07-17 21:05:05.396582323 +0000 UTC m=+72.926490776"
Jul 17 21:05:05.606713 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:05.606627    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:05:05.609501 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:05.609476    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:05:06.361991 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:06.361912    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:05:06.363196 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:06.363175    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5cd6b8fd68-w4fm4"
Jul 17 21:05:07.172584 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:07.172517    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:07.281142 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:07.281109    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:07.370718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:07.370678    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4" event={"ID":"5df51c14-bc3f-46ec-9824-b52e048b48e9","Type":"ContainerStarted","Data":"d548ce0e7d5dc0c26b5b46bd6b56833a2eb33358adf45dc0c5d004d4f541c7a6"}
Jul 17 21:05:07.388975 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:07.388930    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:07.428828 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:07.428727    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-tn4g4" podStartSLOduration=33.303252751 podStartE2EDuration="35.428711612s" totalImagesPullingTime="2.125458861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:07.419963231 +0000 UTC m=+74.949871697" watchObservedRunningTime="2026-07-17 21:05:07.428711612 +0000 UTC m=+74.958620063"
Jul 17 21:05:07.513916 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:07.513882    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:07.640876 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:07.640826    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" podUID="40b19aad-1f3c-496c-a7ae-41ef8404ca7f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 17 21:05:07.712756 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:07.712651    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:07.855245 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:07.855214    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:09.365704 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:09.365674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:09.452123 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:09.452085    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:10.721464 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:10.721430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:05:10.723958 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:10.723931    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b93858dd-2569-41a3-a57a-36e97405d3c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9sj9\" (UID: \"b93858dd-2569-41a3-a57a-36e97405d3c4\") " pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:05:10.904417 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:10.904383    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8lg9w\""
Jul 17 21:05:10.912572 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:10.912546    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l9sj9"
Jul 17 21:05:11.048866 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:11.048836    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:11.055176 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:11.055146    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l9sj9"]
Jul 17 21:05:11.058006 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:05:11.057951    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93858dd_2569_41a3_a57a_36e97405d3c4.slice/crio-b8f9b89c8b8eeed070cf7697ae60163464c70a7ad050bb61706af9d5947f7bd3 WatchSource:0}: Error finding container b8f9b89c8b8eeed070cf7697ae60163464c70a7ad050bb61706af9d5947f7bd3: Status 404 returned error can't find the container with id b8f9b89c8b8eeed070cf7697ae60163464c70a7ad050bb61706af9d5947f7bd3
Jul 17 21:05:11.196480 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:11.196449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:11.385072 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:11.384978    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9sj9" event={"ID":"b93858dd-2569-41a3-a57a-36e97405d3c4","Type":"ContainerStarted","Data":"b8f9b89c8b8eeed070cf7697ae60163464c70a7ad050bb61706af9d5947f7bd3"}
Jul 17 21:05:11.738835 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:11.738797    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:11.835634 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:11.835560    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:12.344888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:12.344850    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5tpzl"
Jul 17 21:05:14.017617 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:14.017485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:14.297037 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:14.296947    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:14.382699 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:14.382659    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:15.492510 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:15.492478    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:15.714739 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:15.714700    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:15.870799 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:15.870773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:16.140642 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.140566    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"]
Jul 17 21:05:16.143713 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.143648    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.146339 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.146310    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 17 21:05:16.147071 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.147046    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 17 21:05:16.147440 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.147422    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 17 21:05:16.149927 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.149903    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 21:05:16.152896 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.152876    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jsmdj\""
Jul 17 21:05:16.157345 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.157320    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gldlk"]
Jul 17 21:05:16.160466 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.160445    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.163502 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.163477    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 21:05:16.163939 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.163913    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 21:05:16.164262 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.164213    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qhtzp\""
Jul 17 21:05:16.164771 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.164571    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 21:05:16.166396 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.166375    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"]
Jul 17 21:05:16.268727 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.268691    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-textfile\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.268727 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.268738    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c2e292d-42cf-4b34-86a2-5ba64567329d-metrics-client-ca\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.268952 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.268768    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.268952 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.268830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c2e292d-42cf-4b34-86a2-5ba64567329d-sys\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.268952 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.268926    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d4cac9e-4f97-4e93-be27-b415bf262d06-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.269078 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.268961    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-tls\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.269078 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.268989    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.269078 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.269045    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-wtmp\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.269208 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.269079    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4cac9e-4f97-4e93-be27-b415bf262d06-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.269208 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.269138    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-accelerators-collector-config\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.269208 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.269165    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.269208 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.269194    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.269430 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.269262    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smmxs\" (UniqueName: \"kubernetes.io/projected/1c2e292d-42cf-4b34-86a2-5ba64567329d-kube-api-access-smmxs\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.269430 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.269323    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c2e292d-42cf-4b34-86a2-5ba64567329d-root\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.269430 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.269362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p65cl\" (UniqueName: \"kubernetes.io/projected/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-api-access-p65cl\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.370261 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370228    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d4cac9e-4f97-4e93-be27-b415bf262d06-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.370261 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370264    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-tls\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.370531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370304    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.370531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370330    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-wtmp\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.370531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370350    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4cac9e-4f97-4e93-be27-b415bf262d06-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.370531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370370    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-accelerators-collector-config\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.370531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.370531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370426    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.370531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smmxs\" (UniqueName: \"kubernetes.io/projected/1c2e292d-42cf-4b34-86a2-5ba64567329d-kube-api-access-smmxs\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.370531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370486    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c2e292d-42cf-4b34-86a2-5ba64567329d-root\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.370531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370517    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-wtmp\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.370972 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370521    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p65cl\" (UniqueName: \"kubernetes.io/projected/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-api-access-p65cl\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.370972 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370580    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-textfile\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.370972 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c2e292d-42cf-4b34-86a2-5ba64567329d-metrics-client-ca\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.370972 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370631    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.370972 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370659    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c2e292d-42cf-4b34-86a2-5ba64567329d-sys\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.370972 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370668    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6d4cac9e-4f97-4e93-be27-b415bf262d06-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.370972 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370928    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-textfile\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.371318 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.370978    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1c2e292d-42cf-4b34-86a2-5ba64567329d-sys\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.371318 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:05:16.371063    2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 17 21:05:16.371318 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:05:16.371133    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-tls podName:6d4cac9e-4f97-4e93-be27-b415bf262d06 nodeName:}" failed. No retries permitted until 2026-07-17 21:05:16.871112875 +0000 UTC m=+84.401021310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-mg5m8" (UID: "6d4cac9e-4f97-4e93-be27-b415bf262d06") : secret "kube-state-metrics-tls" not found
Jul 17 21:05:16.371619 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.371490    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d4cac9e-4f97-4e93-be27-b415bf262d06-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.371619 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.371568    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1c2e292d-42cf-4b34-86a2-5ba64567329d-root\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.371619 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.371496    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c2e292d-42cf-4b34-86a2-5ba64567329d-metrics-client-ca\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.371811 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.371762    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-accelerators-collector-config\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.372133 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.372078    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.373838 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.373813    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-tls\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.374011 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.373980    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.374105 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.374091    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1c2e292d-42cf-4b34-86a2-5ba64567329d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.379571 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.379548    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p65cl\" (UniqueName: \"kubernetes.io/projected/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-api-access-p65cl\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.379794 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.379763    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smmxs\" (UniqueName: \"kubernetes.io/projected/1c2e292d-42cf-4b34-86a2-5ba64567329d-kube-api-access-smmxs\") pod \"node-exporter-gldlk\" (UID: \"1c2e292d-42cf-4b34-86a2-5ba64567329d\") " pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.412099 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.412020    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9sj9" event={"ID":"b93858dd-2569-41a3-a57a-36e97405d3c4","Type":"ContainerStarted","Data":"0cb5b7fd39373ca9296d3a19a7c65672129446cfe06a1dae8e20d2db7fb1ec9d"}
Jul 17 21:05:16.475129 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.475093    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gldlk"
Jul 17 21:05:16.879313 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.878829    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.884121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.884054    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d4cac9e-4f97-4e93-be27-b415bf262d06-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-mg5m8\" (UID: \"6d4cac9e-4f97-4e93-be27-b415bf262d06\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:16.957888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:16.957853    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:17.054776 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:17.054742    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"
Jul 17 21:05:17.057338 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:17.057303    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:17.160596 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:17.160559    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:17.243477 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:17.243393    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-mg5m8"]
Jul 17 21:05:17.273610 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:17.273576    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:17.419241 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:17.419208    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gldlk" event={"ID":"1c2e292d-42cf-4b34-86a2-5ba64567329d","Type":"ContainerStarted","Data":"ab3a86d49b89678189eada1758803e84b6927facff999a2ce555455abc1ba4bb"}
Jul 17 21:05:17.466573 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:05:17.466539    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4cac9e_4f97_4e93_be27_b415bf262d06.slice/crio-d128e765927b2dfdd3ceadf73d6a01371e9f134b18bbaabc984807ed5c4aadc8 WatchSource:0}: Error finding container d128e765927b2dfdd3ceadf73d6a01371e9f134b18bbaabc984807ed5c4aadc8: Status 404 returned error can't find the container with id d128e765927b2dfdd3ceadf73d6a01371e9f134b18bbaabc984807ed5c4aadc8
Jul 17 21:05:17.641290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:17.641229    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" podUID="40b19aad-1f3c-496c-a7ae-41ef8404ca7f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 17 21:05:17.735822 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:17.735701    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:18.425867 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:18.425823    2572 generic.go:356] "Generic (PLEG): container finished" podID="1c2e292d-42cf-4b34-86a2-5ba64567329d" containerID="c3761f62536639c65264594e335df143d5960109ddf71f9f9e124ff5b611cb65" exitCode=0
Jul 17 21:05:18.426441 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:18.425877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gldlk" event={"ID":"1c2e292d-42cf-4b34-86a2-5ba64567329d","Type":"ContainerDied","Data":"c3761f62536639c65264594e335df143d5960109ddf71f9f9e124ff5b611cb65"}
Jul 17 21:05:18.427317 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:18.427295    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8" event={"ID":"6d4cac9e-4f97-4e93-be27-b415bf262d06","Type":"ContainerStarted","Data":"d128e765927b2dfdd3ceadf73d6a01371e9f134b18bbaabc984807ed5c4aadc8"}
Jul 17 21:05:18.916611 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:18.916581    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:19.037519 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:19.037485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:19.133758 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:19.133721    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:19.233618 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:19.233522    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:19.359499 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:19.359456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:20.437389 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:20.437342    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9sj9" event={"ID":"b93858dd-2569-41a3-a57a-36e97405d3c4","Type":"ContainerStarted","Data":"7a1c8753a63262e0d27083379ef0e0e474e2fd028f08c116d79b63857fd6e467"}
Jul 17 21:05:20.440013 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:20.439977    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gldlk" event={"ID":"1c2e292d-42cf-4b34-86a2-5ba64567329d","Type":"ContainerStarted","Data":"0488b69196cb40e3e74f3553326513576ab636f0956f4d138f6454bb5a26084c"}
Jul 17 21:05:20.440173 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:20.440035    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gldlk" event={"ID":"1c2e292d-42cf-4b34-86a2-5ba64567329d","Type":"ContainerStarted","Data":"cb14b014244aca090979c1b1e9d511de05670832539b6b4585b724e625c44dae"}
Jul 17 21:05:20.442624 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:20.442587    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8" event={"ID":"6d4cac9e-4f97-4e93-be27-b415bf262d06","Type":"ContainerStarted","Data":"d80e25e88117afda88c3837990010dd353ea0fda5376e5670a5e6c2789313c4b"}
Jul 17 21:05:20.442755 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:20.442645    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8" event={"ID":"6d4cac9e-4f97-4e93-be27-b415bf262d06","Type":"ContainerStarted","Data":"602df3bfe33b559d2d49a08d94efa146f2ec47e2d06b8d222ed5baa2ccf722c4"}
Jul 17 21:05:20.442755 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:20.442688    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8" event={"ID":"6d4cac9e-4f97-4e93-be27-b415bf262d06","Type":"ContainerStarted","Data":"0f74a6eede3684cb2c37abcdc6255773b4e2c7d535990c6225eaa4e9bf19c0a5"}
Jul 17 21:05:20.470879 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:20.470823    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gldlk" podStartSLOduration=3.381774663 podStartE2EDuration="4.47080717s" totalImagesPullingTime="1.012102182s" totalInitContainerRuntime="76.930325ms" isStatefulPod=true podCreationTimestamp="2026-07-17 21:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:20.469452534 +0000 UTC m=+87.999361006" watchObservedRunningTime="2026-07-17 21:05:20.47080717 +0000 UTC m=+88.000715622"
Jul 17 21:05:20.492938 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:20.492880    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-mg5m8" podStartSLOduration=1.80752741 podStartE2EDuration="4.492848539s" totalImagesPullingTime="2.685321129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:20.492000345 +0000 UTC m=+88.021908822" watchObservedRunningTime="2026-07-17 21:05:20.492848539 +0000 UTC m=+88.022757028"
Jul 17 21:05:20.895639 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:20.895500    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:20.993501 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:20.993461    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:21.366631 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:21.366594    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:21.440896 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:21.440852    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:21.501087 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:21.501046    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:22.110898 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:22.110856    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:22.225946 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:22.225907    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:22.377056 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:22.376933    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:24.465439 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:24.465400    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9sj9" event={"ID":"b93858dd-2569-41a3-a57a-36e97405d3c4","Type":"ContainerStarted","Data":"b2d84ec56d0ff260bf8f00f73830543ca685a2ccf971584f5c389c60854fe1a1"}
Jul 17 21:05:24.485228 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:24.485180    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l9sj9" podStartSLOduration=34.044225926 podStartE2EDuration="46.485163834s" totalImagesPullingTime="12.440937908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:04:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:05:24.484382634 +0000 UTC m=+92.014291086" watchObservedRunningTime="2026-07-17 21:05:24.485163834 +0000 UTC m=+92.015072285"
Jul 17 21:05:25.907191 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:25.907156    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:25.987164 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:25.987133    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:27.088846 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:27.088812    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:27.153447 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:27.153409    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:27.639995 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:27.639956    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" podUID="40b19aad-1f3c-496c-a7ae-41ef8404ca7f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jul 17 21:05:27.640155 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:27.640027    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv"
Jul 17 21:05:27.640541 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:27.640510    2572 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"10ecbbf6dc301289448012f279dc14fd73f4c89ce4371051002af6c28a820b6b"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jul 17 21:05:27.640585 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:27.640560    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" podUID="40b19aad-1f3c-496c-a7ae-41ef8404ca7f" containerName="service-proxy" containerID="cri-o://10ecbbf6dc301289448012f279dc14fd73f4c89ce4371051002af6c28a820b6b" gracePeriod=30
Jul 17 21:05:28.483146 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:28.483114    2572 generic.go:356] "Generic (PLEG): container finished" podID="40b19aad-1f3c-496c-a7ae-41ef8404ca7f" containerID="10ecbbf6dc301289448012f279dc14fd73f4c89ce4371051002af6c28a820b6b" exitCode=2
Jul 17 21:05:28.483595 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:28.483152    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" event={"ID":"40b19aad-1f3c-496c-a7ae-41ef8404ca7f","Type":"ContainerDied","Data":"10ecbbf6dc301289448012f279dc14fd73f4c89ce4371051002af6c28a820b6b"}
Jul 17 21:05:28.483595 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:28.483186    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59f7855bdb-256dv" event={"ID":"40b19aad-1f3c-496c-a7ae-41ef8404ca7f","Type":"ContainerStarted","Data":"8fb27993c5ef5947e52d9a43ad9ceb643c0889f14d3e328e51bf092ce682326e"}
Jul 17 21:05:29.446638 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:29.446604    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:29.632992 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:29.632958    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:29.735731 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:29.735652    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:30.330830 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:30.330799    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6qxlc"
Jul 17 21:05:32.547210 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:32.547179    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:32.659164 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:32.659134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:36.204006 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:36.203969    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:36.330351 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:36.330312    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:38.730135 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:38.730099    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:38.832095 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:38.832057    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:40.869517 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:40.869482    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:40.970813 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:40.970779    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:42.762790 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:42.762753    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd6b8fd68-w4fm4_8beac0d0-ad13-4ade-91d3-f69bdcf90233/router/0.log"
Jul 17 21:05:42.780069 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:42.780046    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnzsx_87cd57bb-9e42-4eb1-98bd-37643cb82c86/serve-healthcheck-canary/0.log"
Jul 17 21:05:47.528297 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:47.528238    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:47.629344 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:47.629301    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:47.730690 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:47.730658    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:48.104878 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:48.104841    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:48.168038 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:48.168005    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:48.371751 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:48.371673    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:48.497550 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:48.497519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:48.562566 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:48.562535    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:54.500648 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:54.500619    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:05:54.561743 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:05:54.561633    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:00.638794 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:00.638751    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:00.704144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:00.704100    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:10.871235 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:10.871196    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:10.972039 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:10.971999    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:32.240448 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:32.240414    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:32.299234 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:32.299206    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:44.886136 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:44.886056    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:44.986209 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:44.986171    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:52.598176 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:52.598137    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:55.891505 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:55.891468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:55.983037 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:55.983009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:06:56.054486 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:06:56.054456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:00.247663 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:00.247604    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:00.320038 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:00.320009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:10.878992 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:10.878960    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:10.979684 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:10.979649    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:11.047558 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:11.047529    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:13.010766 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:13.010715    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:13.111077 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:13.111042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:15.102899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:15.102854    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:15.203868 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:15.203835    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:16.094267 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:16.094235    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:16.187134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:16.187102    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:37.003075 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:37.003032    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:37.830738 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:37.830707    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:40.624634 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:40.624600    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:40.721830 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:40.721798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:42.401890 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:42.401846    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:42.495692 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:42.495654    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:43.001334 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:43.001298    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:43.106105 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:43.106074    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:44.984841 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:44.984804    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:45.384952 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:45.384860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:47.609258 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:47.609223    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:47.717677 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:47.717639    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:51.465808 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:51.465773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:51.567560 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:51.567532    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:53.579008 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:53.578978    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:53.887315 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:53.887232    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rc8nm"]
Jul 17 21:07:53.889313 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:53.889271    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rc8nm"
Jul 17 21:07:53.892150 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:53.892128    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kwkrk\""
Jul 17 21:07:53.892268 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:53.892248    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 21:07:53.892927 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:53.892909    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 21:07:53.904239 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:53.904220    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rc8nm"]
Jul 17 21:07:54.019059 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:54.019018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvvpq\" (UniqueName: \"kubernetes.io/projected/9c000f1c-b0d2-4b31-a349-525a13a262f9-kube-api-access-jvvpq\") pod \"cert-manager-55b4d954d5-rc8nm\" (UID: \"9c000f1c-b0d2-4b31-a349-525a13a262f9\") " pod="cert-manager/cert-manager-55b4d954d5-rc8nm"
Jul 17 21:07:54.019249 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:54.019073    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c000f1c-b0d2-4b31-a349-525a13a262f9-bound-sa-token\") pod \"cert-manager-55b4d954d5-rc8nm\" (UID: \"9c000f1c-b0d2-4b31-a349-525a13a262f9\") " pod="cert-manager/cert-manager-55b4d954d5-rc8nm"
Jul 17 21:07:54.120453 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:54.120403    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvvpq\" (UniqueName: \"kubernetes.io/projected/9c000f1c-b0d2-4b31-a349-525a13a262f9-kube-api-access-jvvpq\") pod \"cert-manager-55b4d954d5-rc8nm\" (UID: \"9c000f1c-b0d2-4b31-a349-525a13a262f9\") " pod="cert-manager/cert-manager-55b4d954d5-rc8nm"
Jul 17 21:07:54.120672 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:54.120478    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c000f1c-b0d2-4b31-a349-525a13a262f9-bound-sa-token\") pod \"cert-manager-55b4d954d5-rc8nm\" (UID: \"9c000f1c-b0d2-4b31-a349-525a13a262f9\") " pod="cert-manager/cert-manager-55b4d954d5-rc8nm"
Jul 17 21:07:54.129257 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:54.129231    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvvpq\" (UniqueName: \"kubernetes.io/projected/9c000f1c-b0d2-4b31-a349-525a13a262f9-kube-api-access-jvvpq\") pod \"cert-manager-55b4d954d5-rc8nm\" (UID: \"9c000f1c-b0d2-4b31-a349-525a13a262f9\") " pod="cert-manager/cert-manager-55b4d954d5-rc8nm"
Jul 17 21:07:54.129392 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:54.129230    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c000f1c-b0d2-4b31-a349-525a13a262f9-bound-sa-token\") pod \"cert-manager-55b4d954d5-rc8nm\" (UID: \"9c000f1c-b0d2-4b31-a349-525a13a262f9\") " pod="cert-manager/cert-manager-55b4d954d5-rc8nm"
Jul 17 21:07:54.197872 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:54.197833    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-rc8nm"
Jul 17 21:07:54.325587 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:54.325559    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-rc8nm"]
Jul 17 21:07:54.328840 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:07:54.328805    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c000f1c_b0d2_4b31_a349_525a13a262f9.slice/crio-97a0fae8be823b4d8e357c5fd17865329dbcbcee7a6514c6e25a40c964e77800 WatchSource:0}: Error finding container 97a0fae8be823b4d8e357c5fd17865329dbcbcee7a6514c6e25a40c964e77800: Status 404 returned error can't find the container with id 97a0fae8be823b4d8e357c5fd17865329dbcbcee7a6514c6e25a40c964e77800
Jul 17 21:07:54.983510 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:54.983476    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rc8nm" event={"ID":"9c000f1c-b0d2-4b31-a349-525a13a262f9","Type":"ContainerStarted","Data":"97a0fae8be823b4d8e357c5fd17865329dbcbcee7a6514c6e25a40c964e77800"}
Jul 17 21:07:55.104065 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:55.104024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:07:55.201625 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:07:55.201577    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:00.541672 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:00.541638    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:00.641541 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:00.641495    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:02.453731 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:02.453686    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:11.039246 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:11.039214    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-rc8nm" event={"ID":"9c000f1c-b0d2-4b31-a349-525a13a262f9","Type":"ContainerStarted","Data":"ebb5ea7d7add1b44f9547712e9f8d18ba2fd447d24aadb44adf1d936fbb33a16"}
Jul 17 21:08:11.055386 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:11.055330    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-rc8nm" podStartSLOduration=2.367033676 podStartE2EDuration="18.055309033s" totalImagesPullingTime="15.688275357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:11.054962041 +0000 UTC m=+258.584870547" watchObservedRunningTime="2026-07-17 21:08:11.055309033 +0000 UTC m=+258.585217486"
Jul 17 21:08:14.753475 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:14.753394    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:14.836462 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:14.836425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:18.289318 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:18.289251    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:18.384968 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:18.384927    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:19.098504 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.098468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:19.370919 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.370800    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:19.469863 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.469823    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:19.499701 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.499669    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"]
Jul 17 21:08:19.502075 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.502047    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.506632 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.506584    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 21:08:19.506897 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.506883    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gc7lq\""
Jul 17 21:08:19.506997 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.506975    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 21:08:19.507111 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.507010    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 21:08:19.507111 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.507021    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 21:08:19.526998 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.526963    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"]
Jul 17 21:08:19.613768 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.613735    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26c50181-c255-4d92-9477-19154a7ebc49-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.613950 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.613789    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfvb2\" (UniqueName: \"kubernetes.io/projected/26c50181-c255-4d92-9477-19154a7ebc49-kube-api-access-gfvb2\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.613950 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.613840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26c50181-c255-4d92-9477-19154a7ebc49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.613950 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.613881    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26c50181-c255-4d92-9477-19154a7ebc49-manifests\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.614076 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.613953    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26c50181-c255-4d92-9477-19154a7ebc49-tmp\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.660359 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.660241    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:19.714372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.714331    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfvb2\" (UniqueName: \"kubernetes.io/projected/26c50181-c255-4d92-9477-19154a7ebc49-kube-api-access-gfvb2\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.714372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.714377    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26c50181-c255-4d92-9477-19154a7ebc49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.714628 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.714436    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26c50181-c255-4d92-9477-19154a7ebc49-manifests\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.714628 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.714512    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26c50181-c255-4d92-9477-19154a7ebc49-tmp\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.714628 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.714550    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26c50181-c255-4d92-9477-19154a7ebc49-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.715012 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.714983    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26c50181-c255-4d92-9477-19154a7ebc49-manifests\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.716816 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.716792    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26c50181-c255-4d92-9477-19154a7ebc49-tmp\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.716911 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.716862    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26c50181-c255-4d92-9477-19154a7ebc49-webhook-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.716911 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.716897    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26c50181-c255-4d92-9477-19154a7ebc49-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.724163 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.724130    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfvb2\" (UniqueName: \"kubernetes.io/projected/26c50181-c255-4d92-9477-19154a7ebc49-kube-api-access-gfvb2\") pod \"opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx\" (UID: \"26c50181-c255-4d92-9477-19154a7ebc49\") " pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.763084 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.763045    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:19.811775 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.811739    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:19.866462 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.866428    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:19.947932 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.947908    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"]
Jul 17 21:08:19.950358 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:08:19.950333    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c50181_c255_4d92_9477_19154a7ebc49.slice/crio-5814bde135ff77b96388c00f60ec51f4e3377e01ffb6971a337fcba7ea235da1 WatchSource:0}: Error finding container 5814bde135ff77b96388c00f60ec51f4e3377e01ffb6971a337fcba7ea235da1: Status 404 returned error can't find the container with id 5814bde135ff77b96388c00f60ec51f4e3377e01ffb6971a337fcba7ea235da1
Jul 17 21:08:19.962239 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:19.962215    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:20.042499 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:20.042458    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:20.071056 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:20.071019    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx" event={"ID":"26c50181-c255-4d92-9477-19154a7ebc49","Type":"ContainerStarted","Data":"5814bde135ff77b96388c00f60ec51f4e3377e01ffb6971a337fcba7ea235da1"}
Jul 17 21:08:20.146718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:20.146683    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:20.251527 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:20.251444    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:24.088155 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:24.088118    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx" event={"ID":"26c50181-c255-4d92-9477-19154a7ebc49","Type":"ContainerStarted","Data":"43c43706a0250c4f640229b8a655980aef6810658a83de0083fe2deab07ebf86"}
Jul 17 21:08:25.092581 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:25.092549    2572 generic.go:356] "Generic (PLEG): container finished" podID="26c50181-c255-4d92-9477-19154a7ebc49" containerID="43c43706a0250c4f640229b8a655980aef6810658a83de0083fe2deab07ebf86" exitCode=0
Jul 17 21:08:25.092971 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:25.092641    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx" event={"ID":"26c50181-c255-4d92-9477-19154a7ebc49","Type":"ContainerDied","Data":"43c43706a0250c4f640229b8a655980aef6810658a83de0083fe2deab07ebf86"}
Jul 17 21:08:26.098289 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:26.098237    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx" event={"ID":"26c50181-c255-4d92-9477-19154a7ebc49","Type":"ContainerStarted","Data":"30f81352ef667ab66dd8bfbd1a2b5c794ae6fcd8e9fb2296ff99cd51a6ce0378"}
Jul 17 21:08:26.098735 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:26.098385    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:26.123538 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:26.123488    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx" podStartSLOduration=2.662279512 podStartE2EDuration="7.1234744s" totalImagesPullingTime="3.433102353s" totalInitContainerRuntime="1.028092535s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:26.122020033 +0000 UTC m=+273.651928487" watchObservedRunningTime="2026-07-17 21:08:26.1234744 +0000 UTC m=+273.653382853"
Jul 17 21:08:37.105000 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:37.104970    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx"
Jul 17 21:08:38.692074 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:38.692041    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:38.804146 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:38.804113    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:39.317195 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.317163    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:39.327655 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.327627    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-748bb598b7-z774l"]
Jul 17 21:08:39.339190 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.339167    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.342899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.342874    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 21:08:39.343025 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.342918    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 21:08:39.351229 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.351205    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-748bb598b7-z774l"]
Jul 17 21:08:39.477364 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.477332    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ba642ea-f938-4f9d-af29-11512af935f6-tmp\") pod \"kube-auth-proxy-748bb598b7-z774l\" (UID: \"8ba642ea-f938-4f9d-af29-11512af935f6\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.477364 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.477365    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6twdc\" (UniqueName: \"kubernetes.io/projected/8ba642ea-f938-4f9d-af29-11512af935f6-kube-api-access-6twdc\") pod \"kube-auth-proxy-748bb598b7-z774l\" (UID: \"8ba642ea-f938-4f9d-af29-11512af935f6\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.477571 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.477451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba642ea-f938-4f9d-af29-11512af935f6-tls-certs\") pod \"kube-auth-proxy-748bb598b7-z774l\" (UID: \"8ba642ea-f938-4f9d-af29-11512af935f6\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.498255 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.498222    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tbwnk"]
Jul 17 21:08:39.500187 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.500172    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:08:39.503094 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.503068    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pspz5\""
Jul 17 21:08:39.503258 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.503244    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 17 21:08:39.522677 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.522652    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tbwnk"]
Jul 17 21:08:39.537144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.537101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:39.578156 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.578066    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba642ea-f938-4f9d-af29-11512af935f6-tls-certs\") pod \"kube-auth-proxy-748bb598b7-z774l\" (UID: \"8ba642ea-f938-4f9d-af29-11512af935f6\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.578156 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.578134    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ba642ea-f938-4f9d-af29-11512af935f6-tmp\") pod \"kube-auth-proxy-748bb598b7-z774l\" (UID: \"8ba642ea-f938-4f9d-af29-11512af935f6\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.578373 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.578166    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6twdc\" (UniqueName: \"kubernetes.io/projected/8ba642ea-f938-4f9d-af29-11512af935f6-kube-api-access-6twdc\") pod \"kube-auth-proxy-748bb598b7-z774l\" (UID: \"8ba642ea-f938-4f9d-af29-11512af935f6\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.580568 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.580541    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ba642ea-f938-4f9d-af29-11512af935f6-tmp\") pod \"kube-auth-proxy-748bb598b7-z774l\" (UID: \"8ba642ea-f938-4f9d-af29-11512af935f6\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.580744 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.580724    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ba642ea-f938-4f9d-af29-11512af935f6-tls-certs\") pod \"kube-auth-proxy-748bb598b7-z774l\" (UID: \"8ba642ea-f938-4f9d-af29-11512af935f6\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.588508 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.588479    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6twdc\" (UniqueName: \"kubernetes.io/projected/8ba642ea-f938-4f9d-af29-11512af935f6-kube-api-access-6twdc\") pod \"kube-auth-proxy-748bb598b7-z774l\" (UID: \"8ba642ea-f938-4f9d-af29-11512af935f6\") " pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.638035 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.637996    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:39.648965 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.648938    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l"
Jul 17 21:08:39.679250 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.679196    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq4f7\" (UniqueName: \"kubernetes.io/projected/28d66e03-094c-419c-9229-4afb12be1f4f-kube-api-access-nq4f7\") pod \"odh-model-controller-7998c67dc4-tbwnk\" (UID: \"28d66e03-094c-419c-9229-4afb12be1f4f\") " pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:08:39.679250 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.679243    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28d66e03-094c-419c-9229-4afb12be1f4f-cert\") pod \"odh-model-controller-7998c67dc4-tbwnk\" (UID: \"28d66e03-094c-419c-9229-4afb12be1f4f\") " pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:08:39.730495 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.730469    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:39.780427 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.779900    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq4f7\" (UniqueName: \"kubernetes.io/projected/28d66e03-094c-419c-9229-4afb12be1f4f-kube-api-access-nq4f7\") pod \"odh-model-controller-7998c67dc4-tbwnk\" (UID: \"28d66e03-094c-419c-9229-4afb12be1f4f\") " pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:08:39.780427 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.779951    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28d66e03-094c-419c-9229-4afb12be1f4f-cert\") pod \"odh-model-controller-7998c67dc4-tbwnk\" (UID: \"28d66e03-094c-419c-9229-4afb12be1f4f\") " pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:08:39.780427 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:08:39.780139    2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 17 21:08:39.780427 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:08:39.780215    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28d66e03-094c-419c-9229-4afb12be1f4f-cert podName:28d66e03-094c-419c-9229-4afb12be1f4f nodeName:}" failed. No retries permitted until 2026-07-17 21:08:40.280195018 +0000 UTC m=+287.810103455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/28d66e03-094c-419c-9229-4afb12be1f4f-cert") pod "odh-model-controller-7998c67dc4-tbwnk" (UID: "28d66e03-094c-419c-9229-4afb12be1f4f") : secret "odh-model-controller-webhook-cert" not found
Jul 17 21:08:39.781528 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.781509    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-748bb598b7-z774l"]
Jul 17 21:08:39.784345 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:08:39.784322    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba642ea_f938_4f9d_af29_11512af935f6.slice/crio-e019cbc08afad035d6169ff38207353d2b26f490cd6f54d5b914fed21e0401e9 WatchSource:0}: Error finding container e019cbc08afad035d6169ff38207353d2b26f490cd6f54d5b914fed21e0401e9: Status 404 returned error can't find the container with id e019cbc08afad035d6169ff38207353d2b26f490cd6f54d5b914fed21e0401e9
Jul 17 21:08:39.789173 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.789153    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq4f7\" (UniqueName: \"kubernetes.io/projected/28d66e03-094c-419c-9229-4afb12be1f4f-kube-api-access-nq4f7\") pod \"odh-model-controller-7998c67dc4-tbwnk\" (UID: \"28d66e03-094c-419c-9229-4afb12be1f4f\") " pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:08:39.854642 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:39.854558    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:40.154412 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.154328    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l" event={"ID":"8ba642ea-f938-4f9d-af29-11512af935f6","Type":"ContainerStarted","Data":"e019cbc08afad035d6169ff38207353d2b26f490cd6f54d5b914fed21e0401e9"}
Jul 17 21:08:40.286025 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.285986    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28d66e03-094c-419c-9229-4afb12be1f4f-cert\") pod \"odh-model-controller-7998c67dc4-tbwnk\" (UID: \"28d66e03-094c-419c-9229-4afb12be1f4f\") " pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:08:40.288425 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.288398    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28d66e03-094c-419c-9229-4afb12be1f4f-cert\") pod \"odh-model-controller-7998c67dc4-tbwnk\" (UID: \"28d66e03-094c-419c-9229-4afb12be1f4f\") " pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:08:40.410649 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.410571    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:08:40.467393 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.466784    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:40.487263 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.487229    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-96mgs"]
Jul 17 21:08:40.489841 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.489816    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:40.493860 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.493831    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 17 21:08:40.494251 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.494216    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-bk4pz\""
Jul 17 21:08:40.505743 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.505355    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-96mgs"]
Jul 17 21:08:40.567215 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.567176    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-tbwnk"]
Jul 17 21:08:40.570857 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:08:40.570828    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d66e03_094c_419c_9229_4afb12be1f4f.slice/crio-b0bc74234e3db934e1f54d89080a3860f0957597f0f4040891e1a4e8ceaef969 WatchSource:0}: Error finding container b0bc74234e3db934e1f54d89080a3860f0957597f0f4040891e1a4e8ceaef969: Status 404 returned error can't find the container with id b0bc74234e3db934e1f54d89080a3860f0957597f0f4040891e1a4e8ceaef969
Jul 17 21:08:40.588091 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.588063    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6012ec7-6f6b-4fb4-b2cd-842721888c51-tls-certs\") pod \"model-serving-api-54d89bd5fc-96mgs\" (UID: \"d6012ec7-6f6b-4fb4-b2cd-842721888c51\") " pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:40.588226 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.588118    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r92qm\" (UniqueName: \"kubernetes.io/projected/d6012ec7-6f6b-4fb4-b2cd-842721888c51-kube-api-access-r92qm\") pod \"model-serving-api-54d89bd5fc-96mgs\" (UID: \"d6012ec7-6f6b-4fb4-b2cd-842721888c51\") " pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:40.689333 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.689296    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6012ec7-6f6b-4fb4-b2cd-842721888c51-tls-certs\") pod \"model-serving-api-54d89bd5fc-96mgs\" (UID: \"d6012ec7-6f6b-4fb4-b2cd-842721888c51\") " pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:40.689530 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.689372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r92qm\" (UniqueName: \"kubernetes.io/projected/d6012ec7-6f6b-4fb4-b2cd-842721888c51-kube-api-access-r92qm\") pod \"model-serving-api-54d89bd5fc-96mgs\" (UID: \"d6012ec7-6f6b-4fb4-b2cd-842721888c51\") " pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:40.689530 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:08:40.689445    2572 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 17 21:08:40.689654 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:08:40.689536    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6012ec7-6f6b-4fb4-b2cd-842721888c51-tls-certs podName:d6012ec7-6f6b-4fb4-b2cd-842721888c51 nodeName:}" failed. No retries permitted until 2026-07-17 21:08:41.18951304 +0000 UTC m=+288.719421471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d6012ec7-6f6b-4fb4-b2cd-842721888c51-tls-certs") pod "model-serving-api-54d89bd5fc-96mgs" (UID: "d6012ec7-6f6b-4fb4-b2cd-842721888c51") : secret "model-serving-api-tls" not found
Jul 17 21:08:40.698983 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.698954    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r92qm\" (UniqueName: \"kubernetes.io/projected/d6012ec7-6f6b-4fb4-b2cd-842721888c51-kube-api-access-r92qm\") pod \"model-serving-api-54d89bd5fc-96mgs\" (UID: \"d6012ec7-6f6b-4fb4-b2cd-842721888c51\") " pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:40.840322 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.840292    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"]
Jul 17 21:08:40.842454 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.842436    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:40.844923 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.844897    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 21:08:40.845043 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.844935    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kb86d\""
Jul 17 21:08:40.845104 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.845035    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 21:08:40.845104 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.845052    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 21:08:40.845204 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.845162    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 21:08:40.857664 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.857637    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"]
Jul 17 21:08:40.864168 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.864141    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:40.944212 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.944085    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:40.992721 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.992689    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvbmb\" (UniqueName: \"kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-kube-api-access-bvbmb\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:40.992721 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.992732    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:40.992962 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.992771    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-cacerts\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:40.992962 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.992837    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aeeb65f9-1432-4d32-9311-d0cc05c46085-local-certs\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:40.992962 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.992864    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:40.992962 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.992946    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:40.993134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:40.993012    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-token\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.054875 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.054839    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:41.094099 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.094063    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvbmb\" (UniqueName: \"kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-kube-api-access-bvbmb\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.094319 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.094109    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.094319 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.094141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-cacerts\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.094319 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.094178    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aeeb65f9-1432-4d32-9311-d0cc05c46085-local-certs\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.094496 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.094398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.094496 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.094453    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.094593 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.094512    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-token\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.094997 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.094967    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.096637 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.096609    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aeeb65f9-1432-4d32-9311-d0cc05c46085-local-certs\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.096747 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.096723    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-cacerts\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.096813 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.096763    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.096813 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.096793    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.102580 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.102557    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-token\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.102907 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.102885    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvbmb\" (UniqueName: \"kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-kube-api-access-bvbmb\") pod \"istiod-openshift-gateway-7574459656-bch7f\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.151904 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.151868    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:41.159098 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.159066    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk" event={"ID":"28d66e03-094c-419c-9229-4afb12be1f4f","Type":"ContainerStarted","Data":"b0bc74234e3db934e1f54d89080a3860f0957597f0f4040891e1a4e8ceaef969"}
Jul 17 21:08:41.195585 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.195496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6012ec7-6f6b-4fb4-b2cd-842721888c51-tls-certs\") pod \"model-serving-api-54d89bd5fc-96mgs\" (UID: \"d6012ec7-6f6b-4fb4-b2cd-842721888c51\") " pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:41.198486 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.198463    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d6012ec7-6f6b-4fb4-b2cd-842721888c51-tls-certs\") pod \"model-serving-api-54d89bd5fc-96mgs\" (UID: \"d6012ec7-6f6b-4fb4-b2cd-842721888c51\") " pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:41.316114 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.316080    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"]
Jul 17 21:08:41.321184 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:08:41.321072    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeeb65f9_1432_4d32_9311_d0cc05c46085.slice/crio-bdfc7e8a5e470f3d221808e7a35abb6a57f3acf7757d6c48bac6b5f4b8ee41b2 WatchSource:0}: Error finding container bdfc7e8a5e470f3d221808e7a35abb6a57f3acf7757d6c48bac6b5f4b8ee41b2: Status 404 returned error can't find the container with id bdfc7e8a5e470f3d221808e7a35abb6a57f3acf7757d6c48bac6b5f4b8ee41b2
Jul 17 21:08:41.403773 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.403739    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:41.607728 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:41.607650    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-96mgs"]
Jul 17 21:08:41.612120 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:08:41.612079    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6012ec7_6f6b_4fb4_b2cd_842721888c51.slice/crio-c9bb675873490e26457f1cb8ab3214edc588621bde739fbf5c8d21731e96ee6a WatchSource:0}: Error finding container c9bb675873490e26457f1cb8ab3214edc588621bde739fbf5c8d21731e96ee6a: Status 404 returned error can't find the container with id c9bb675873490e26457f1cb8ab3214edc588621bde739fbf5c8d21731e96ee6a
Jul 17 21:08:42.063899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:42.063796    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:42.166048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:42.165905    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f" event={"ID":"aeeb65f9-1432-4d32-9311-d0cc05c46085","Type":"ContainerStarted","Data":"bdfc7e8a5e470f3d221808e7a35abb6a57f3acf7757d6c48bac6b5f4b8ee41b2"}
Jul 17 21:08:42.169057 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:42.169029    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-96mgs" event={"ID":"d6012ec7-6f6b-4fb4-b2cd-842721888c51","Type":"ContainerStarted","Data":"c9bb675873490e26457f1cb8ab3214edc588621bde739fbf5c8d21731e96ee6a"}
Jul 17 21:08:45.583996 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:45.583962    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 21:08:45.584360 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:45.584026    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 17 21:08:46.190839 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.190800    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l" event={"ID":"8ba642ea-f938-4f9d-af29-11512af935f6","Type":"ContainerStarted","Data":"c6189089cc952287218e7433277e7d1d89fe60f5176e07626b78e4ec2927c1a7"}
Jul 17 21:08:46.192270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.192244    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f" event={"ID":"aeeb65f9-1432-4d32-9311-d0cc05c46085","Type":"ContainerStarted","Data":"cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4"}
Jul 17 21:08:46.192436 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.192392    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:46.193865 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.193841    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk" event={"ID":"28d66e03-094c-419c-9229-4afb12be1f4f","Type":"ContainerStarted","Data":"f6c06833fde1033701c56064b47546c3a0a92880f55d61a4cfbbbf51bbd30c76"}
Jul 17 21:08:46.194190 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.194171    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:08:46.194346 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.194315    2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bch7f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 21:08:46.194459 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.194368    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f" podUID="aeeb65f9-1432-4d32-9311-d0cc05c46085" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 21:08:46.195701 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.195683    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-96mgs" event={"ID":"d6012ec7-6f6b-4fb4-b2cd-842721888c51","Type":"ContainerStarted","Data":"fe7bbfc720c6fd1e2510166df27efddd657d7fcaf23eb05bbbcf41f97bcdfd18"}
Jul 17 21:08:46.195807 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.195796    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:46.211311 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.211253    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-748bb598b7-z774l" podStartSLOduration=1.422987525 podStartE2EDuration="7.21123928s" totalImagesPullingTime="5.788251755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:46.210101548 +0000 UTC m=+293.740010000" watchObservedRunningTime="2026-07-17 21:08:46.21123928 +0000 UTC m=+293.741147732"
Jul 17 21:08:46.229350 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.229262    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk" podStartSLOduration=2.221231788 podStartE2EDuration="7.229243054s" totalImagesPullingTime="5.008011266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:46.228202734 +0000 UTC m=+293.758111198" watchObservedRunningTime="2026-07-17 21:08:46.229243054 +0000 UTC m=+293.759151507"
Jul 17 21:08:46.256174 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.256109    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-96mgs" podStartSLOduration=2.287757115 podStartE2EDuration="6.256088137s" totalImagesPullingTime="3.968331022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:46.255401911 +0000 UTC m=+293.785310375" watchObservedRunningTime="2026-07-17 21:08:46.256088137 +0000 UTC m=+293.785996590"
Jul 17 21:08:46.278832 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.278786    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f" podStartSLOduration=2.021182177 podStartE2EDuration="6.278771617s" totalImagesPullingTime="4.25758944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:46.277263497 +0000 UTC m=+293.807171989" watchObservedRunningTime="2026-07-17 21:08:46.278771617 +0000 UTC m=+293.808680070"
Jul 17 21:08:46.399468 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.399428    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:46.484130 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:46.484002    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:47.200579 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:47.200549    2572 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-bch7f container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 21:08:47.201050 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:47.200615    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f" podUID="aeeb65f9-1432-4d32-9311-d0cc05c46085" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 21:08:47.431466 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:47.431427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:47.740651 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:47.740615    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:47.886711 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:47.886674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:50.201537 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.201511    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:50.452324 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.452224    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:50.543635 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.543600    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"]
Jul 17 21:08:50.546887 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.546867    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"
Jul 17 21:08:50.552529 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.552503    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-6q7l8\""
Jul 17 21:08:50.552790 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.552772    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 17 21:08:50.556505 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.556488    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"]
Jul 17 21:08:50.567520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.566644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:50.568263 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.568243    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"]
Jul 17 21:08:50.568521 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.568502    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:08:50.569232 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.569209    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2q2j\" (UniqueName: \"kubernetes.io/projected/b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795-kube-api-access-g2q2j\") pod \"kserve-controller-manager-d6f4b65b8-hqs6r\" (UID: \"b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"
Jul 17 21:08:50.569358 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.569319    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795-cert\") pod \"kserve-controller-manager-d6f4b65b8-hqs6r\" (UID: \"b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"
Jul 17 21:08:50.572781 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.572761    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 17 21:08:50.573148 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.573131    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-ttxtr\""
Jul 17 21:08:50.591050 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.591021    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"]
Jul 17 21:08:50.670514 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.670485    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2q2j\" (UniqueName: \"kubernetes.io/projected/b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795-kube-api-access-g2q2j\") pod \"kserve-controller-manager-d6f4b65b8-hqs6r\" (UID: \"b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"
Jul 17 21:08:50.670686 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.670524    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f80c1a6-430d-4629-a1d0-297973844e42-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x6l4k\" (UID: \"8f80c1a6-430d-4629-a1d0-297973844e42\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:08:50.670686 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.670545    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zckqn\" (UniqueName: \"kubernetes.io/projected/8f80c1a6-430d-4629-a1d0-297973844e42-kube-api-access-zckqn\") pod \"llmisvc-controller-manager-777c6bd7d5-x6l4k\" (UID: \"8f80c1a6-430d-4629-a1d0-297973844e42\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:08:50.670686 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.670609    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795-cert\") pod \"kserve-controller-manager-d6f4b65b8-hqs6r\" (UID: \"b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"
Jul 17 21:08:50.673043 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.673014    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795-cert\") pod \"kserve-controller-manager-d6f4b65b8-hqs6r\" (UID: \"b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"
Jul 17 21:08:50.681116 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.681081    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2q2j\" (UniqueName: \"kubernetes.io/projected/b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795-kube-api-access-g2q2j\") pod \"kserve-controller-manager-d6f4b65b8-hqs6r\" (UID: \"b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"
Jul 17 21:08:50.726033 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.725937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:50.771634 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.771604    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f80c1a6-430d-4629-a1d0-297973844e42-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x6l4k\" (UID: \"8f80c1a6-430d-4629-a1d0-297973844e42\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:08:50.771831 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.771648    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zckqn\" (UniqueName: \"kubernetes.io/projected/8f80c1a6-430d-4629-a1d0-297973844e42-kube-api-access-zckqn\") pod \"llmisvc-controller-manager-777c6bd7d5-x6l4k\" (UID: \"8f80c1a6-430d-4629-a1d0-297973844e42\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:08:50.771831 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:08:50.771762    2572 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 17 21:08:50.771831 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:08:50.771832    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f80c1a6-430d-4629-a1d0-297973844e42-cert podName:8f80c1a6-430d-4629-a1d0-297973844e42 nodeName:}" failed. No retries permitted until 2026-07-17 21:08:51.271814487 +0000 UTC m=+298.801722932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f80c1a6-430d-4629-a1d0-297973844e42-cert") pod "llmisvc-controller-manager-777c6bd7d5-x6l4k" (UID: "8f80c1a6-430d-4629-a1d0-297973844e42") : secret "llmisvc-webhook-server-cert" not found
Jul 17 21:08:50.782672 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.782635    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zckqn\" (UniqueName: \"kubernetes.io/projected/8f80c1a6-430d-4629-a1d0-297973844e42-kube-api-access-zckqn\") pod \"llmisvc-controller-manager-777c6bd7d5-x6l4k\" (UID: \"8f80c1a6-430d-4629-a1d0-297973844e42\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:08:50.873052 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:50.873016    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"
Jul 17 21:08:51.046542 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:51.046394    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"]
Jul 17 21:08:51.049233 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:08:51.049201    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ebbfbb_fffa_4d3c_b5f1_fc7b63094795.slice/crio-c3b585fc560e19ed7205f1347a39eab548a5424052469eed4f56f4dd801097a8 WatchSource:0}: Error finding container c3b585fc560e19ed7205f1347a39eab548a5424052469eed4f56f4dd801097a8: Status 404 returned error can't find the container with id c3b585fc560e19ed7205f1347a39eab548a5424052469eed4f56f4dd801097a8
Jul 17 21:08:51.217120 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:51.217086    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r" event={"ID":"b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795","Type":"ContainerStarted","Data":"c3b585fc560e19ed7205f1347a39eab548a5424052469eed4f56f4dd801097a8"}
Jul 17 21:08:51.276991 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:51.276954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f80c1a6-430d-4629-a1d0-297973844e42-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x6l4k\" (UID: \"8f80c1a6-430d-4629-a1d0-297973844e42\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:08:51.279380 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:51.279356    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f80c1a6-430d-4629-a1d0-297973844e42-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-x6l4k\" (UID: \"8f80c1a6-430d-4629-a1d0-297973844e42\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:08:51.314814 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:51.314720    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:51.482834 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:51.482792    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:08:51.624343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:51.624311    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"]
Jul 17 21:08:51.627190 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:08:51.627159    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8f80c1a6_430d_4629_a1d0_297973844e42.slice/crio-162f80e2e9011485a9d3280e084e6fc3bbbbfb3cc04c051a63735de2842c739f WatchSource:0}: Error finding container 162f80e2e9011485a9d3280e084e6fc3bbbbfb3cc04c051a63735de2842c739f: Status 404 returned error can't find the container with id 162f80e2e9011485a9d3280e084e6fc3bbbbfb3cc04c051a63735de2842c739f
Jul 17 21:08:51.783478 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:51.783450    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:51.907270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:51.907178    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:52.007552 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:52.007518    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:08:52.223246 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:52.223208    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k" event={"ID":"8f80c1a6-430d-4629-a1d0-297973844e42","Type":"ContainerStarted","Data":"162f80e2e9011485a9d3280e084e6fc3bbbbfb3cc04c051a63735de2842c739f"}
Jul 17 21:08:53.358770 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.358732    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"]
Jul 17 21:08:53.361253 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.358958    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f" podUID="aeeb65f9-1432-4d32-9311-d0cc05c46085" containerName="discovery" containerID="cri-o://cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4" gracePeriod=30
Jul 17 21:08:53.648667 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.648637    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 21:08:53.776878 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.776852    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:53.800416 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.800378    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-kubeconfig\") pod \"aeeb65f9-1432-4d32-9311-d0cc05c46085\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") "
Jul 17 21:08:53.800416 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.800434    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aeeb65f9-1432-4d32-9311-d0cc05c46085-local-certs\") pod \"aeeb65f9-1432-4d32-9311-d0cc05c46085\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") "
Jul 17 21:08:53.800759 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.800484    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvbmb\" (UniqueName: \"kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-kube-api-access-bvbmb\") pod \"aeeb65f9-1432-4d32-9311-d0cc05c46085\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") "
Jul 17 21:08:53.800759 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.800524    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-dns-cert\") pod \"aeeb65f9-1432-4d32-9311-d0cc05c46085\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") "
Jul 17 21:08:53.800759 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.800550    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-token\") pod \"aeeb65f9-1432-4d32-9311-d0cc05c46085\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") "
Jul 17 21:08:53.800759 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.800578    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-ca-configmap\") pod \"aeeb65f9-1432-4d32-9311-d0cc05c46085\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") "
Jul 17 21:08:53.800960 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.800941    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "aeeb65f9-1432-4d32-9311-d0cc05c46085" (UID: "aeeb65f9-1432-4d32-9311-d0cc05c46085"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:08:53.801122 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.801100    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-cacerts\") pod \"aeeb65f9-1432-4d32-9311-d0cc05c46085\" (UID: \"aeeb65f9-1432-4d32-9311-d0cc05c46085\") "
Jul 17 21:08:53.801436 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.801414    2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-ca-configmap\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:08:53.804190 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.804119    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "aeeb65f9-1432-4d32-9311-d0cc05c46085" (UID: "aeeb65f9-1432-4d32-9311-d0cc05c46085"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:08:53.804190 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.804138    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-kube-api-access-bvbmb" (OuterVolumeSpecName: "kube-api-access-bvbmb") pod "aeeb65f9-1432-4d32-9311-d0cc05c46085" (UID: "aeeb65f9-1432-4d32-9311-d0cc05c46085"). InnerVolumeSpecName "kube-api-access-bvbmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:08:53.804403 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.804202    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-cacerts" (OuterVolumeSpecName: "cacerts") pod "aeeb65f9-1432-4d32-9311-d0cc05c46085" (UID: "aeeb65f9-1432-4d32-9311-d0cc05c46085"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:08:53.804574 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.804541    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-token" (OuterVolumeSpecName: "istio-token") pod "aeeb65f9-1432-4d32-9311-d0cc05c46085" (UID: "aeeb65f9-1432-4d32-9311-d0cc05c46085"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:08:53.804695 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.804569    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "aeeb65f9-1432-4d32-9311-d0cc05c46085" (UID: "aeeb65f9-1432-4d32-9311-d0cc05c46085"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:08:53.804840 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.804824    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aeeb65f9-1432-4d32-9311-d0cc05c46085-local-certs" (OuterVolumeSpecName: "local-certs") pod "aeeb65f9-1432-4d32-9311-d0cc05c46085" (UID: "aeeb65f9-1432-4d32-9311-d0cc05c46085"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:08:53.902069 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.901984    2572 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-csr-dns-cert\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:08:53.902069 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.902012    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-token\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:08:53.902069 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.902022    2572 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-cacerts\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:08:53.902069 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.902030    2572 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aeeb65f9-1432-4d32-9311-d0cc05c46085-istio-kubeconfig\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:08:53.902069 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.902039    2572 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aeeb65f9-1432-4d32-9311-d0cc05c46085-local-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:08:53.902069 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:53.902047    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvbmb\" (UniqueName: \"kubernetes.io/projected/aeeb65f9-1432-4d32-9311-d0cc05c46085-kube-api-access-bvbmb\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:08:54.235320 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.235256    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r" event={"ID":"b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795","Type":"ContainerStarted","Data":"ad6cf794e4275035a24b4fa35e8884307fd3414abcaba2fdfdfddc740c0c556c"}
Jul 17 21:08:54.235539 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.235369    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"
Jul 17 21:08:54.236789 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.236761    2572 generic.go:356] "Generic (PLEG): container finished" podID="aeeb65f9-1432-4d32-9311-d0cc05c46085" containerID="cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4" exitCode=0
Jul 17 21:08:54.236931 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.236795    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f" event={"ID":"aeeb65f9-1432-4d32-9311-d0cc05c46085","Type":"ContainerDied","Data":"cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4"}
Jul 17 21:08:54.236931 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.236803    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"
Jul 17 21:08:54.236931 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.236825    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-bch7f" event={"ID":"aeeb65f9-1432-4d32-9311-d0cc05c46085","Type":"ContainerDied","Data":"bdfc7e8a5e470f3d221808e7a35abb6a57f3acf7757d6c48bac6b5f4b8ee41b2"}
Jul 17 21:08:54.236931 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.236845    2572 scope.go:117] "RemoveContainer" containerID="cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4"
Jul 17 21:08:54.245838 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.245816    2572 scope.go:117] "RemoveContainer" containerID="cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4"
Jul 17 21:08:54.246154 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:08:54.246133    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4\": container with ID starting with cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4 not found: ID does not exist" containerID="cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4"
Jul 17 21:08:54.246237 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.246164    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4"} err="failed to get container status \"cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4\": rpc error: code = NotFound desc = could not find container \"cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4\": container with ID starting with cc11760351fbf42c0fd5b557f6eb5abfdb602e6ce1900ca8a8abbf995799d9f4 not found: ID does not exist"
Jul 17 21:08:54.266792 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.266739    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r" podStartSLOduration=1.647717121 podStartE2EDuration="4.266719819s" totalImagesPullingTime="2.619002698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:54.265159404 +0000 UTC m=+301.795067856" watchObservedRunningTime="2026-07-17 21:08:54.266719819 +0000 UTC m=+301.796628270"
Jul 17 21:08:54.296890 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.296850    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"]
Jul 17 21:08:54.331372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:54.331338    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-bch7f"]
Jul 17 21:08:55.039748 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:55.039718    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aeeb65f9-1432-4d32-9311-d0cc05c46085" path="/var/lib/kubelet/pods/aeeb65f9-1432-4d32-9311-d0cc05c46085/volumes"
Jul 17 21:08:55.242630 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:55.242536    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k" event={"ID":"8f80c1a6-430d-4629-a1d0-297973844e42","Type":"ContainerStarted","Data":"5b5aa7571e0dc56177f1ace8f3f0cf94bf5f3035e8967cef1864166673305061"}
Jul 17 21:08:55.242788 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:55.242634    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:08:55.260582 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:55.260535    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k" podStartSLOduration=1.939507341 podStartE2EDuration="5.260520538s" totalImagesPullingTime="3.321013197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:08:55.259751571 +0000 UTC m=+302.789660050" watchObservedRunningTime="2026-07-17 21:08:55.260520538 +0000 UTC m=+302.790428999"
Jul 17 21:08:57.204406 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:57.204378    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-96mgs"
Jul 17 21:08:58.206295 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:08:58.206242    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-tbwnk"
Jul 17 21:09:25.248996 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:25.248963    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-hqs6r"
Jul 17 21:09:26.249817 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:26.249787    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-x6l4k"
Jul 17 21:09:40.167210 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.167177    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:09:40.298705 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.298670    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gpkb"]
Jul 17 21:09:40.298979 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.298967    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aeeb65f9-1432-4d32-9311-d0cc05c46085" containerName="discovery"
Jul 17 21:09:40.299026 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.298980    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aeeb65f9-1432-4d32-9311-d0cc05c46085" containerName="discovery"
Jul 17 21:09:40.299060 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.299036    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aeeb65f9-1432-4d32-9311-d0cc05c46085" containerName="discovery"
Jul 17 21:09:40.307846 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.307816    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8gpkb"
Jul 17 21:09:40.310464 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.310439    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 21:09:40.310682 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.310661    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-x67vj\""
Jul 17 21:09:40.310897 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.310882    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 21:09:40.311946 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.311914    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gpkb"]
Jul 17 21:09:40.472054 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.471961    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjwm9\" (UniqueName: \"kubernetes.io/projected/58ca0caf-d3b1-4601-b3ca-e9311855c732-kube-api-access-zjwm9\") pod \"kuadrant-operator-catalog-8gpkb\" (UID: \"58ca0caf-d3b1-4601-b3ca-e9311855c732\") " pod="kuadrant-system/kuadrant-operator-catalog-8gpkb"
Jul 17 21:09:40.573245 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.573201    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjwm9\" (UniqueName: \"kubernetes.io/projected/58ca0caf-d3b1-4601-b3ca-e9311855c732-kube-api-access-zjwm9\") pod \"kuadrant-operator-catalog-8gpkb\" (UID: \"58ca0caf-d3b1-4601-b3ca-e9311855c732\") " pod="kuadrant-system/kuadrant-operator-catalog-8gpkb"
Jul 17 21:09:40.582583 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.582546    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjwm9\" (UniqueName: \"kubernetes.io/projected/58ca0caf-d3b1-4601-b3ca-e9311855c732-kube-api-access-zjwm9\") pod \"kuadrant-operator-catalog-8gpkb\" (UID: \"58ca0caf-d3b1-4601-b3ca-e9311855c732\") " pod="kuadrant-system/kuadrant-operator-catalog-8gpkb"
Jul 17 21:09:40.620729 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.620689    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8gpkb"
Jul 17 21:09:40.666679 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.666644    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gpkb"]
Jul 17 21:09:40.749039 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.748958    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gpkb"]
Jul 17 21:09:40.751932 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:09:40.751902    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ca0caf_d3b1_4601_b3ca_e9311855c732.slice/crio-b766f7f9fe143181ce9f1f585b928e2e5d85f20a3d9510aa2c40dcbe429ebed0 WatchSource:0}: Error finding container b766f7f9fe143181ce9f1f585b928e2e5d85f20a3d9510aa2c40dcbe429ebed0: Status 404 returned error can't find the container with id b766f7f9fe143181ce9f1f585b928e2e5d85f20a3d9510aa2c40dcbe429ebed0
Jul 17 21:09:40.753237 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.753221    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:09:40.877361 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.877333    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9bxkv"]
Jul 17 21:09:40.880114 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.880093    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9bxkv"
Jul 17 21:09:40.886766 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.886720    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9bxkv"]
Jul 17 21:09:40.976127 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:40.976094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frlnc\" (UniqueName: \"kubernetes.io/projected/0cc2e550-fbbc-48dd-bc54-0b8230894e6e-kube-api-access-frlnc\") pod \"kuadrant-operator-catalog-9bxkv\" (UID: \"0cc2e550-fbbc-48dd-bc54-0b8230894e6e\") " pod="kuadrant-system/kuadrant-operator-catalog-9bxkv"
Jul 17 21:09:41.076959 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:41.076861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlnc\" (UniqueName: \"kubernetes.io/projected/0cc2e550-fbbc-48dd-bc54-0b8230894e6e-kube-api-access-frlnc\") pod \"kuadrant-operator-catalog-9bxkv\" (UID: \"0cc2e550-fbbc-48dd-bc54-0b8230894e6e\") " pod="kuadrant-system/kuadrant-operator-catalog-9bxkv"
Jul 17 21:09:41.085090 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:41.085058    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frlnc\" (UniqueName: \"kubernetes.io/projected/0cc2e550-fbbc-48dd-bc54-0b8230894e6e-kube-api-access-frlnc\") pod \"kuadrant-operator-catalog-9bxkv\" (UID: \"0cc2e550-fbbc-48dd-bc54-0b8230894e6e\") " pod="kuadrant-system/kuadrant-operator-catalog-9bxkv"
Jul 17 21:09:41.190253 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:41.190219    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-9bxkv"
Jul 17 21:09:41.328396 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:41.328310    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-9bxkv"]
Jul 17 21:09:41.331113 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:09:41.331086    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cc2e550_fbbc_48dd_bc54_0b8230894e6e.slice/crio-eeb51976e8d5298eaee14733ca090b544becfd5384f4e065dbe1a985d8fa27f6 WatchSource:0}: Error finding container eeb51976e8d5298eaee14733ca090b544becfd5384f4e065dbe1a985d8fa27f6: Status 404 returned error can't find the container with id eeb51976e8d5298eaee14733ca090b544becfd5384f4e065dbe1a985d8fa27f6
Jul 17 21:09:41.426639 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:41.426607    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9bxkv" event={"ID":"0cc2e550-fbbc-48dd-bc54-0b8230894e6e","Type":"ContainerStarted","Data":"eeb51976e8d5298eaee14733ca090b544becfd5384f4e065dbe1a985d8fa27f6"}
Jul 17 21:09:41.427791 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:41.427763    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8gpkb" event={"ID":"58ca0caf-d3b1-4601-b3ca-e9311855c732","Type":"ContainerStarted","Data":"b766f7f9fe143181ce9f1f585b928e2e5d85f20a3d9510aa2c40dcbe429ebed0"}
Jul 17 21:09:41.456671 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:41.456639    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:09:43.439956 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:43.439914    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-9bxkv" event={"ID":"0cc2e550-fbbc-48dd-bc54-0b8230894e6e","Type":"ContainerStarted","Data":"1c9f40462442e62197e283ead7edb9078d4d53e1a7ff204f45a59dcb78fef907"}
Jul 17 21:09:43.441412 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:43.441388    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8gpkb" event={"ID":"58ca0caf-d3b1-4601-b3ca-e9311855c732","Type":"ContainerStarted","Data":"b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce"}
Jul 17 21:09:43.441493 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:43.441424    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-8gpkb" podUID="58ca0caf-d3b1-4601-b3ca-e9311855c732" containerName="registry-server" containerID="cri-o://b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce" gracePeriod=2
Jul 17 21:09:43.456456 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:43.456414    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-9bxkv" podStartSLOduration=1.7905803599999999 podStartE2EDuration="3.456398472s" totalImagesPullingTime="1.665818112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:09:43.455165551 +0000 UTC m=+350.985074026" watchObservedRunningTime="2026-07-17 21:09:43.456398472 +0000 UTC m=+350.986306955"
Jul 17 21:09:43.469594 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:43.469535    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8gpkb" podStartSLOduration=1.227096943 podStartE2EDuration="3.469514227s" totalImagesPullingTime="2.242417284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:09:43.4689908 +0000 UTC m=+350.998899253" watchObservedRunningTime="2026-07-17 21:09:43.469514227 +0000 UTC m=+350.999422680"
Jul 17 21:09:43.686463 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:43.686435    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8gpkb"
Jul 17 21:09:43.801466 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:43.801374    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjwm9\" (UniqueName: \"kubernetes.io/projected/58ca0caf-d3b1-4601-b3ca-e9311855c732-kube-api-access-zjwm9\") pod \"58ca0caf-d3b1-4601-b3ca-e9311855c732\" (UID: \"58ca0caf-d3b1-4601-b3ca-e9311855c732\") "
Jul 17 21:09:43.803614 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:43.803590    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58ca0caf-d3b1-4601-b3ca-e9311855c732-kube-api-access-zjwm9" (OuterVolumeSpecName: "kube-api-access-zjwm9") pod "58ca0caf-d3b1-4601-b3ca-e9311855c732" (UID: "58ca0caf-d3b1-4601-b3ca-e9311855c732"). InnerVolumeSpecName "kube-api-access-zjwm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:09:43.902452 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:43.902412    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjwm9\" (UniqueName: \"kubernetes.io/projected/58ca0caf-d3b1-4601-b3ca-e9311855c732-kube-api-access-zjwm9\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:09:44.446816 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:44.446782    2572 generic.go:356] "Generic (PLEG): container finished" podID="58ca0caf-d3b1-4601-b3ca-e9311855c732" containerID="b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce" exitCode=0
Jul 17 21:09:44.447220 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:44.446829    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8gpkb"
Jul 17 21:09:44.447220 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:44.446873    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8gpkb" event={"ID":"58ca0caf-d3b1-4601-b3ca-e9311855c732","Type":"ContainerDied","Data":"b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce"}
Jul 17 21:09:44.447220 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:44.446922    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8gpkb" event={"ID":"58ca0caf-d3b1-4601-b3ca-e9311855c732","Type":"ContainerDied","Data":"b766f7f9fe143181ce9f1f585b928e2e5d85f20a3d9510aa2c40dcbe429ebed0"}
Jul 17 21:09:44.447220 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:44.446950    2572 scope.go:117] "RemoveContainer" containerID="b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce"
Jul 17 21:09:44.456124 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:44.456106    2572 scope.go:117] "RemoveContainer" containerID="b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce"
Jul 17 21:09:44.456393 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:09:44.456377    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce\": container with ID starting with b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce not found: ID does not exist" containerID="b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce"
Jul 17 21:09:44.456450 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:44.456400    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce"} err="failed to get container status \"b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce\": rpc error: code = NotFound desc = could not find container \"b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce\": container with ID starting with b873719671d8e5d0dbbcbf437fafac7760821c1d315fe5fc184ded41764dd1ce not found: ID does not exist"
Jul 17 21:09:44.467862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:44.467839    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gpkb"]
Jul 17 21:09:44.471226 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:44.471206    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8gpkb"]
Jul 17 21:09:45.040638 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:45.040605    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58ca0caf-d3b1-4601-b3ca-e9311855c732" path="/var/lib/kubelet/pods/58ca0caf-d3b1-4601-b3ca-e9311855c732/volumes"
Jul 17 21:09:51.190733 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:51.190698    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-9bxkv"
Jul 17 21:09:51.191193 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:51.190778    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-9bxkv"
Jul 17 21:09:51.213964 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:51.213935    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-9bxkv"
Jul 17 21:09:51.498620 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:09:51.498543    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-9bxkv"
Jul 17 21:10:08.873817 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:08.873785    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:09.473256 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:09.473221    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:10.532540 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:10.532506    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:12.960328 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:12.960295    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj"]
Jul 17 21:10:12.960696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:12.960619    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ca0caf-d3b1-4601-b3ca-e9311855c732" containerName="registry-server"
Jul 17 21:10:12.960696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:12.960632    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ca0caf-d3b1-4601-b3ca-e9311855c732" containerName="registry-server"
Jul 17 21:10:12.960773 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:12.960700    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="58ca0caf-d3b1-4601-b3ca-e9311855c732" containerName="registry-server"
Jul 17 21:10:12.966464 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:12.966440    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj"
Jul 17 21:10:12.971447 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:12.971429    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-vkxm7\""
Jul 17 21:10:12.992130 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:12.992106    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj"]
Jul 17 21:10:13.017892 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:13.017863    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86bql\" (UniqueName: \"kubernetes.io/projected/31792ae5-ee4c-47fe-89a1-ce5b40032f12-kube-api-access-86bql\") pod \"authorino-operator-75cc8d5cb7-9g2lj\" (UID: \"31792ae5-ee4c-47fe-89a1-ce5b40032f12\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj"
Jul 17 21:10:13.119144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:13.119107    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86bql\" (UniqueName: \"kubernetes.io/projected/31792ae5-ee4c-47fe-89a1-ce5b40032f12-kube-api-access-86bql\") pod \"authorino-operator-75cc8d5cb7-9g2lj\" (UID: \"31792ae5-ee4c-47fe-89a1-ce5b40032f12\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj"
Jul 17 21:10:13.135335 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:13.135306    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86bql\" (UniqueName: \"kubernetes.io/projected/31792ae5-ee4c-47fe-89a1-ce5b40032f12-kube-api-access-86bql\") pod \"authorino-operator-75cc8d5cb7-9g2lj\" (UID: \"31792ae5-ee4c-47fe-89a1-ce5b40032f12\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj"
Jul 17 21:10:13.276575 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:13.276474    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj"
Jul 17 21:10:13.427369 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:13.427334    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj"]
Jul 17 21:10:13.430537 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:10:13.430508    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31792ae5_ee4c_47fe_89a1_ce5b40032f12.slice/crio-f39739668eb3be8f899252f19fcf7d2f62509ec40373fadf8a3d248cce060a1c WatchSource:0}: Error finding container f39739668eb3be8f899252f19fcf7d2f62509ec40373fadf8a3d248cce060a1c: Status 404 returned error can't find the container with id f39739668eb3be8f899252f19fcf7d2f62509ec40373fadf8a3d248cce060a1c
Jul 17 21:10:13.562515 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:13.562427    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj" event={"ID":"31792ae5-ee4c-47fe-89a1-ce5b40032f12","Type":"ContainerStarted","Data":"f39739668eb3be8f899252f19fcf7d2f62509ec40373fadf8a3d248cce060a1c"}
Jul 17 21:10:14.107762 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:14.107732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:15.759756 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:15.759722    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86"]
Jul 17 21:10:15.763638 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:15.763617    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86"
Jul 17 21:10:15.766033 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:15.765985    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-26svl\""
Jul 17 21:10:15.766033 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:15.766023    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 17 21:10:15.775677 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:15.775653    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86"]
Jul 17 21:10:15.840075 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:15.840052    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp8ll\" (UniqueName: \"kubernetes.io/projected/f7bb043b-89e3-49e3-bf16-8b2dfc74694c-kube-api-access-kp8ll\") pod \"dns-operator-controller-manager-864dd78c4c-lmr86\" (UID: \"f7bb043b-89e3-49e3-bf16-8b2dfc74694c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86"
Jul 17 21:10:15.941267 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:15.941238    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp8ll\" (UniqueName: \"kubernetes.io/projected/f7bb043b-89e3-49e3-bf16-8b2dfc74694c-kube-api-access-kp8ll\") pod \"dns-operator-controller-manager-864dd78c4c-lmr86\" (UID: \"f7bb043b-89e3-49e3-bf16-8b2dfc74694c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86"
Jul 17 21:10:15.950044 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:15.950016    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp8ll\" (UniqueName: \"kubernetes.io/projected/f7bb043b-89e3-49e3-bf16-8b2dfc74694c-kube-api-access-kp8ll\") pod \"dns-operator-controller-manager-864dd78c4c-lmr86\" (UID: \"f7bb043b-89e3-49e3-bf16-8b2dfc74694c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86"
Jul 17 21:10:16.077392 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:16.077299    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86"
Jul 17 21:10:16.206468 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:16.206445    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86"]
Jul 17 21:10:16.208714 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:10:16.208677    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7bb043b_89e3_49e3_bf16_8b2dfc74694c.slice/crio-4eed7014029bcf18a1c01f9bba77b5a30e504140a4368467bc8e7df7b11b2c70 WatchSource:0}: Error finding container 4eed7014029bcf18a1c01f9bba77b5a30e504140a4368467bc8e7df7b11b2c70: Status 404 returned error can't find the container with id 4eed7014029bcf18a1c01f9bba77b5a30e504140a4368467bc8e7df7b11b2c70
Jul 17 21:10:16.480975 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:16.480942    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:16.578496 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:16.578456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86" event={"ID":"f7bb043b-89e3-49e3-bf16-8b2dfc74694c","Type":"ContainerStarted","Data":"4eed7014029bcf18a1c01f9bba77b5a30e504140a4368467bc8e7df7b11b2c70"}
Jul 17 21:10:16.580076 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:16.580046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj" event={"ID":"31792ae5-ee4c-47fe-89a1-ce5b40032f12","Type":"ContainerStarted","Data":"75aab46d446cf31b48659f25fe90214ac55dd725d6afab1e4b8dda809f477981"}
Jul 17 21:10:16.580228 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:16.580152    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj"
Jul 17 21:10:16.631666 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:16.631609    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj" podStartSLOduration=2.227097749 podStartE2EDuration="4.631590817s" totalImagesPullingTime="2.404493068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:10:16.630933035 +0000 UTC m=+384.160841484" watchObservedRunningTime="2026-07-17 21:10:16.631590817 +0000 UTC m=+384.161499269"
Jul 17 21:10:16.846355 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:16.846254    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:18.528931 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.526621    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"]
Jul 17 21:10:18.531218 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.531185    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:18.535060 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.535013    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-qgzcr\""
Jul 17 21:10:18.543175 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.543146    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"]
Jul 17 21:10:18.565217 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.565188    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtjjj\" (UniqueName: \"kubernetes.io/projected/07132314-15d7-417f-9d7f-d7a06b7a0f79-kube-api-access-wtjjj\") pod \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" (UID: \"07132314-15d7-417f-9d7f-d7a06b7a0f79\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:18.590063 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.590036    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86" event={"ID":"f7bb043b-89e3-49e3-bf16-8b2dfc74694c","Type":"ContainerStarted","Data":"668b54ff2fb006bc7266d5c10f5f0680b8a0c4bf8ac80bf1043888989c495985"}
Jul 17 21:10:18.590212 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.590152    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86"
Jul 17 21:10:18.613317 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.613257    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86" podStartSLOduration=1.74327502 podStartE2EDuration="3.613243168s" totalImagesPullingTime="1.869968148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:10:18.611898618 +0000 UTC m=+386.141807103" watchObservedRunningTime="2026-07-17 21:10:18.613243168 +0000 UTC m=+386.143151620"
Jul 17 21:10:18.665868 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.665837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtjjj\" (UniqueName: \"kubernetes.io/projected/07132314-15d7-417f-9d7f-d7a06b7a0f79-kube-api-access-wtjjj\") pod \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" (UID: \"07132314-15d7-417f-9d7f-d7a06b7a0f79\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:18.676160 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.676132    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtjjj\" (UniqueName: \"kubernetes.io/projected/07132314-15d7-417f-9d7f-d7a06b7a0f79-kube-api-access-wtjjj\") pod \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" (UID: \"07132314-15d7-417f-9d7f-d7a06b7a0f79\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:18.843068 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.842978    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:18.970544 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.970515    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:18.980336 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:18.980236    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"]
Jul 17 21:10:18.982539 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:10:18.982518    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07132314_15d7_417f_9d7f_d7a06b7a0f79.slice/crio-bb00d17aa1ab7dbe2ff508c427120385f12a08baea6336c3cb1a267d54d2b660 WatchSource:0}: Error finding container bb00d17aa1ab7dbe2ff508c427120385f12a08baea6336c3cb1a267d54d2b660: Status 404 returned error can't find the container with id bb00d17aa1ab7dbe2ff508c427120385f12a08baea6336c3cb1a267d54d2b660
Jul 17 21:10:19.091591 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:19.091560    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:19.596080 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:19.596048    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8" event={"ID":"07132314-15d7-417f-9d7f-d7a06b7a0f79","Type":"ContainerStarted","Data":"bb00d17aa1ab7dbe2ff508c427120385f12a08baea6336c3cb1a267d54d2b660"}
Jul 17 21:10:21.579166 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:21.579138    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:21.606160 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:21.606129    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8" event={"ID":"07132314-15d7-417f-9d7f-d7a06b7a0f79","Type":"ContainerStarted","Data":"658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad"}
Jul 17 21:10:21.606339 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:21.606248    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:21.635844 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:21.635801    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8" podStartSLOduration=1.821945602 podStartE2EDuration="3.635785725s" totalImagesPullingTime="1.813840123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:10:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:10:21.634308962 +0000 UTC m=+389.164217427" watchObservedRunningTime="2026-07-17 21:10:21.635785725 +0000 UTC m=+389.165694176"
Jul 17 21:10:22.793022 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:22.792990    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"]
Jul 17 21:10:22.796257 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:22.796240    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:22.799933 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:22.799911    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wc476\""
Jul 17 21:10:22.817870 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:22.817845    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"]
Jul 17 21:10:22.901960 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:22.901930    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8491e444-f778-4203-bc8d-3b6466f25c36-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" (UID: \"8491e444-f778-4203-bc8d-3b6466f25c36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:22.901960 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:22.901964    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrdqg\" (UniqueName: \"kubernetes.io/projected/8491e444-f778-4203-bc8d-3b6466f25c36-kube-api-access-hrdqg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" (UID: \"8491e444-f778-4203-bc8d-3b6466f25c36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:23.003196 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:23.003160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrdqg\" (UniqueName: \"kubernetes.io/projected/8491e444-f778-4203-bc8d-3b6466f25c36-kube-api-access-hrdqg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" (UID: \"8491e444-f778-4203-bc8d-3b6466f25c36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:23.003400 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:23.003258    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8491e444-f778-4203-bc8d-3b6466f25c36-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" (UID: \"8491e444-f778-4203-bc8d-3b6466f25c36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:23.003600 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:23.003585    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8491e444-f778-4203-bc8d-3b6466f25c36-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" (UID: \"8491e444-f778-4203-bc8d-3b6466f25c36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:23.011669 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:23.011641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrdqg\" (UniqueName: \"kubernetes.io/projected/8491e444-f778-4203-bc8d-3b6466f25c36-kube-api-access-hrdqg\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" (UID: \"8491e444-f778-4203-bc8d-3b6466f25c36\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:23.105754 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:23.105661    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:23.248340 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:23.248236    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"]
Jul 17 21:10:23.250499 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:10:23.250470    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8491e444_f778_4203_bc8d_3b6466f25c36.slice/crio-e3aebce231c6462e49518850017cb69f5fd1ab6b732c449ba6c0526f30530c91 WatchSource:0}: Error finding container e3aebce231c6462e49518850017cb69f5fd1ab6b732c449ba6c0526f30530c91: Status 404 returned error can't find the container with id e3aebce231c6462e49518850017cb69f5fd1ab6b732c449ba6c0526f30530c91
Jul 17 21:10:23.615761 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:23.615728    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2" event={"ID":"8491e444-f778-4203-bc8d-3b6466f25c36","Type":"ContainerStarted","Data":"e3aebce231c6462e49518850017cb69f5fd1ab6b732c449ba6c0526f30530c91"}
Jul 17 21:10:24.104457 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:24.104420    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:24.235530 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:24.235497    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:24.372563 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:24.372485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:27.587335 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:27.587302    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9g2lj"
Jul 17 21:10:27.911110 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:27.911033    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:28.055134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:28.055107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:29.599542 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:29.599516    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-lmr86"
Jul 17 21:10:29.646556 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:29.646525    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2" event={"ID":"8491e444-f778-4203-bc8d-3b6466f25c36","Type":"ContainerStarted","Data":"14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90"}
Jul 17 21:10:29.646732 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:29.646637    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:29.674885 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:29.674839    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2" podStartSLOduration=1.8667892369999999 podStartE2EDuration="7.674823364s" totalImagesPullingTime="5.808034127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:10:29.672615542 +0000 UTC m=+397.202524013" watchObservedRunningTime="2026-07-17 21:10:29.674823364 +0000 UTC m=+397.204731815"
Jul 17 21:10:31.984347 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:31.984312    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"]
Jul 17 21:10:31.987676 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:31.987653    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:31.990369 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:31.990324    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 17 21:10:31.990477 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:31.990404    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 17 21:10:31.991131 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:31.991113    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4nk2c\""
Jul 17 21:10:32.000064 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.000043    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"]
Jul 17 21:10:32.012721 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.012700    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:32.081399 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.081373    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lmhtx\" (UID: \"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:32.081541 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.081414    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmhtx\" (UID: \"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:32.081541 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.081486    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7pxv\" (UniqueName: \"kubernetes.io/projected/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-kube-api-access-x7pxv\") pod \"kuadrant-console-plugin-66b5774985-lmhtx\" (UID: \"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:32.109522 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.109484    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:32.182712 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.182679    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lmhtx\" (UID: \"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:32.182884 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.182724    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmhtx\" (UID: \"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:32.182884 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.182750    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7pxv\" (UniqueName: \"kubernetes.io/projected/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-kube-api-access-x7pxv\") pod \"kuadrant-console-plugin-66b5774985-lmhtx\" (UID: \"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:32.182884 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:32.182841    2572 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 17 21:10:32.182982 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:32.182932    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-plugin-serving-cert podName:dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077 nodeName:}" failed. No retries permitted until 2026-07-17 21:10:32.682915526 +0000 UTC m=+400.212823960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-lmhtx" (UID: "dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077") : secret "plugin-serving-cert" not found
Jul 17 21:10:32.183367 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.183352    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lmhtx\" (UID: \"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:32.196172 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.196149    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7pxv\" (UniqueName: \"kubernetes.io/projected/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-kube-api-access-x7pxv\") pod \"kuadrant-console-plugin-66b5774985-lmhtx\" (UID: \"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:32.209502 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.209480    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:32.310011 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.309930    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:32.613475 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.613399    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:32.687927 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.687888    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmhtx\" (UID: \"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:32.690347 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.690328    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lmhtx\" (UID: \"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:32.897265 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:32.897185    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"
Jul 17 21:10:33.026023 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:33.025991    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx"]
Jul 17 21:10:33.028931 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:10:33.028896    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd0cb9b4_2ca1_4694_a704_8ecc1f2f9077.slice/crio-f03de3ef9e89b655ee75054d25e66ed6e6173714c947bc0ccd42f7d5fc7f1bc3 WatchSource:0}: Error finding container f03de3ef9e89b655ee75054d25e66ed6e6173714c947bc0ccd42f7d5fc7f1bc3: Status 404 returned error can't find the container with id f03de3ef9e89b655ee75054d25e66ed6e6173714c947bc0ccd42f7d5fc7f1bc3
Jul 17 21:10:33.667725 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:33.667689    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx" event={"ID":"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077","Type":"ContainerStarted","Data":"f03de3ef9e89b655ee75054d25e66ed6e6173714c947bc0ccd42f7d5fc7f1bc3"}
Jul 17 21:10:35.537331 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:35.537296    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:35.636266 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:35.636236    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:37.338788 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:37.338739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:37.419270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:37.419242    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:40.654860 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:40.654827    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:42.308197 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.308158    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"]
Jul 17 21:10:42.309373 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.308395    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" containerName="manager" containerID="cri-o://14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90" gracePeriod=2
Jul 17 21:10:42.320571 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.320504    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"]
Jul 17 21:10:42.327339 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:42.327299    2572 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8491e444-f778-4203-bc8d-3b6466f25c36\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\": pods \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:42.329874 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.329847    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"]
Jul 17 21:10:42.330173 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.330073    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" containerName="manager" containerID="cri-o://658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad" gracePeriod=2
Jul 17 21:10:42.332201 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:42.332167    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:42.336408 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.336385    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"]
Jul 17 21:10:42.336763 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.336748    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" containerName="manager"
Jul 17 21:10:42.336763 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.336764    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" containerName="manager"
Jul 17 21:10:42.336862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.336844    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" containerName="manager"
Jul 17 21:10:42.340697 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.340677    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:10:42.348335 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.348248    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"]
Jul 17 21:10:42.354843 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.354799    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz"]
Jul 17 21:10:42.356655 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.355261    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" containerName="manager"
Jul 17 21:10:42.356655 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.355295    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" containerName="manager"
Jul 17 21:10:42.356655 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.355381    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" containerName="manager"
Jul 17 21:10:42.357811 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:42.357776    2572 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"07132314-15d7-417f-9d7f-d7a06b7a0f79\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-4xsk8\": pods \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:42.359245 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.359215    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"]
Jul 17 21:10:42.359363 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.359339    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz"
Jul 17 21:10:42.361365 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:42.361337    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:42.364668 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:42.364636    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:42.374091 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.374065    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz"]
Jul 17 21:10:42.388270 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:42.388238    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:42.415664 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:42.415629    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:42.477241 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.477206    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6536edc7-e107-48cd-b55d-d267b079c1c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kfspx\" (UID: \"6536edc7-e107-48cd-b55d-d267b079c1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:10:42.477442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.477269    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtmb9\" (UniqueName: \"kubernetes.io/projected/6b4c8c2d-67a7-4590-83a3-07a8e4e82748-kube-api-access-wtmb9\") pod \"limitador-operator-controller-manager-859d7b78bd-bmzpz\" (UID: \"6b4c8c2d-67a7-4590-83a3-07a8e4e82748\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz"
Jul 17 21:10:42.477442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.477349    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc29f\" (UniqueName: \"kubernetes.io/projected/6536edc7-e107-48cd-b55d-d267b079c1c9-kube-api-access-vc29f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kfspx\" (UID: \"6536edc7-e107-48cd-b55d-d267b079c1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:10:42.578218 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.578124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6536edc7-e107-48cd-b55d-d267b079c1c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kfspx\" (UID: \"6536edc7-e107-48cd-b55d-d267b079c1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:10:42.578218 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.578186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtmb9\" (UniqueName: \"kubernetes.io/projected/6b4c8c2d-67a7-4590-83a3-07a8e4e82748-kube-api-access-wtmb9\") pod \"limitador-operator-controller-manager-859d7b78bd-bmzpz\" (UID: \"6b4c8c2d-67a7-4590-83a3-07a8e4e82748\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz"
Jul 17 21:10:42.578478 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.578221    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc29f\" (UniqueName: \"kubernetes.io/projected/6536edc7-e107-48cd-b55d-d267b079c1c9-kube-api-access-vc29f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kfspx\" (UID: \"6536edc7-e107-48cd-b55d-d267b079c1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:10:42.578583 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.578550    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6536edc7-e107-48cd-b55d-d267b079c1c9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kfspx\" (UID: \"6536edc7-e107-48cd-b55d-d267b079c1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:10:42.594558 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.594525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtmb9\" (UniqueName: \"kubernetes.io/projected/6b4c8c2d-67a7-4590-83a3-07a8e4e82748-kube-api-access-wtmb9\") pod \"limitador-operator-controller-manager-859d7b78bd-bmzpz\" (UID: \"6b4c8c2d-67a7-4590-83a3-07a8e4e82748\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz"
Jul 17 21:10:42.594823 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.594796    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc29f\" (UniqueName: \"kubernetes.io/projected/6536edc7-e107-48cd-b55d-d267b079c1c9-kube-api-access-vc29f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kfspx\" (UID: \"6536edc7-e107-48cd-b55d-d267b079c1c9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:10:42.741433 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.741399    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:10:42.748166 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:42.748135    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz"
Jul 17 21:10:43.039907 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:43.039859    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:43.042544 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:43.042505    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:43.348340 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:43.348237    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:43.451020 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:43.450981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:43.611991 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:43.611889    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.27:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 21:10:43.751496 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:43.751464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:43.848448 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:43.848413    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:46.317911 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:46.317880    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:46.414973 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:46.414930    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:47.823595 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:47.823563    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:47.923664 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:47.923630    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:48.001620 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:48.001588    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:51.515841 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:51.515805    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:51.616538 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:51.616504    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:55.133122 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:55.133088    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:55.210733 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:55.210699    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:10:56.273875 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.273850    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"]
Jul 17 21:10:56.290286 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.290229    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz"]
Jul 17 21:10:56.452489 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:10:56.452459    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6536edc7_e107_48cd_b55d_d267b079c1c9.slice/crio-c83117780fe1897b996a5230684386e37d15784b84fa1ba5c2c58ecbf50a3c23 WatchSource:0}: Error finding container c83117780fe1897b996a5230684386e37d15784b84fa1ba5c2c58ecbf50a3c23: Status 404 returned error can't find the container with id c83117780fe1897b996a5230684386e37d15784b84fa1ba5c2c58ecbf50a3c23
Jul 17 21:10:56.453971 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:10:56.453945    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4c8c2d_67a7_4590_83a3_07a8e4e82748.slice/crio-43036b09d77ba1403f7c23ef359673eae4a751ae7a9f622ad87ff88aba484f29 WatchSource:0}: Error finding container 43036b09d77ba1403f7c23ef359673eae4a751ae7a9f622ad87ff88aba484f29: Status 404 returned error can't find the container with id 43036b09d77ba1403f7c23ef359673eae4a751ae7a9f622ad87ff88aba484f29
Jul 17 21:10:56.487987 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.487965    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:56.490552 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:56.490526    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:56.508154 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.508133    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:56.510338 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:56.510317    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:56.512193 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:56.512167    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:56.598233 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.598209    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrdqg\" (UniqueName: \"kubernetes.io/projected/8491e444-f778-4203-bc8d-3b6466f25c36-kube-api-access-hrdqg\") pod \"8491e444-f778-4203-bc8d-3b6466f25c36\" (UID: \"8491e444-f778-4203-bc8d-3b6466f25c36\") "
Jul 17 21:10:56.598374 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.598263    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtjjj\" (UniqueName: \"kubernetes.io/projected/07132314-15d7-417f-9d7f-d7a06b7a0f79-kube-api-access-wtjjj\") pod \"07132314-15d7-417f-9d7f-d7a06b7a0f79\" (UID: \"07132314-15d7-417f-9d7f-d7a06b7a0f79\") "
Jul 17 21:10:56.598374 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.598308    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8491e444-f778-4203-bc8d-3b6466f25c36-extensions-socket-volume\") pod \"8491e444-f778-4203-bc8d-3b6466f25c36\" (UID: \"8491e444-f778-4203-bc8d-3b6466f25c36\") "
Jul 17 21:10:56.598832 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.598807    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8491e444-f778-4203-bc8d-3b6466f25c36-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8491e444-f778-4203-bc8d-3b6466f25c36" (UID: "8491e444-f778-4203-bc8d-3b6466f25c36"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:10:56.600395 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.600362    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8491e444-f778-4203-bc8d-3b6466f25c36-kube-api-access-hrdqg" (OuterVolumeSpecName: "kube-api-access-hrdqg") pod "8491e444-f778-4203-bc8d-3b6466f25c36" (UID: "8491e444-f778-4203-bc8d-3b6466f25c36"). InnerVolumeSpecName "kube-api-access-hrdqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:10:56.600499 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.600471    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07132314-15d7-417f-9d7f-d7a06b7a0f79-kube-api-access-wtjjj" (OuterVolumeSpecName: "kube-api-access-wtjjj") pod "07132314-15d7-417f-9d7f-d7a06b7a0f79" (UID: "07132314-15d7-417f-9d7f-d7a06b7a0f79"). InnerVolumeSpecName "kube-api-access-wtjjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:10:56.699538 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.699506    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrdqg\" (UniqueName: \"kubernetes.io/projected/8491e444-f778-4203-bc8d-3b6466f25c36-kube-api-access-hrdqg\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:10:56.699538 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.699536    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtjjj\" (UniqueName: \"kubernetes.io/projected/07132314-15d7-417f-9d7f-d7a06b7a0f79-kube-api-access-wtjjj\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:10:56.699728 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.699548    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8491e444-f778-4203-bc8d-3b6466f25c36-extensions-socket-volume\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:10:56.790340 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.790223    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx" event={"ID":"dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077","Type":"ContainerStarted","Data":"68e4be98ba60d3eef31d70c774fd9733c4b99d7c4c4a6f6519f5c09f2a53c7cd"}
Jul 17 21:10:56.791531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.791501    2572 generic.go:356] "Generic (PLEG): container finished" podID="07132314-15d7-417f-9d7f-d7a06b7a0f79" containerID="658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad" exitCode=0
Jul 17 21:10:56.791679 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.791544    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:56.791679 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.791559    2572 scope.go:117] "RemoveContainer" containerID="658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad"
Jul 17 21:10:56.792327 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:56.792296    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:56.793548 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.793513    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz" event={"ID":"6b4c8c2d-67a7-4590-83a3-07a8e4e82748","Type":"ContainerStarted","Data":"ccd276912b17aa78b67d3908e19a198f8887252df2ce2b37506f2c490a850d45"}
Jul 17 21:10:56.793669 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.793575    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz" event={"ID":"6b4c8c2d-67a7-4590-83a3-07a8e4e82748","Type":"ContainerStarted","Data":"43036b09d77ba1403f7c23ef359673eae4a751ae7a9f622ad87ff88aba484f29"}
Jul 17 21:10:56.793669 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.793610    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz"
Jul 17 21:10:56.795326 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.795302    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx" event={"ID":"6536edc7-e107-48cd-b55d-d267b079c1c9","Type":"ContainerStarted","Data":"abd3b738b9d4ccb1ef91ce69241128a96ebb3534fb14e379388427d20e71667d"}
Jul 17 21:10:56.795441 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.795357    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx" event={"ID":"6536edc7-e107-48cd-b55d-d267b079c1c9","Type":"ContainerStarted","Data":"c83117780fe1897b996a5230684386e37d15784b84fa1ba5c2c58ecbf50a3c23"}
Jul 17 21:10:56.795508 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.795458    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:10:56.796801 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.796778    2572 generic.go:356] "Generic (PLEG): container finished" podID="8491e444-f778-4203-bc8d-3b6466f25c36" containerID="14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90" exitCode=0
Jul 17 21:10:56.796893 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.796855    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:56.803247 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.803230    2572 scope.go:117] "RemoveContainer" containerID="658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad"
Jul 17 21:10:56.803522 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:56.803505    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad\": container with ID starting with 658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad not found: ID does not exist" containerID="658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad"
Jul 17 21:10:56.803586 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.803528    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad"} err="failed to get container status \"658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad\": rpc error: code = NotFound desc = could not find container \"658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad\": container with ID starting with 658c7f660507bd2c3eb5eb773c9423191b184be09e4bc72bac1da96ead2726ad not found: ID does not exist"
Jul 17 21:10:56.803586 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.803544    2572 scope.go:117] "RemoveContainer" containerID="14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90"
Jul 17 21:10:56.811837 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.811822    2572 scope.go:117] "RemoveContainer" containerID="14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90"
Jul 17 21:10:56.812080 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:56.812062    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90\": container with ID starting with 14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90 not found: ID does not exist" containerID="14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90"
Jul 17 21:10:56.812138 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.812089    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90"} err="failed to get container status \"14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90\": rpc error: code = NotFound desc = could not find container \"14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90\": container with ID starting with 14d2842cc50ef0494bcf3e6751efe71f56c073281851ed95fe2b03807dc3ba90 not found: ID does not exist"
Jul 17 21:10:56.812500 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.812457    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lmhtx" podStartSLOduration=2.325868732 podStartE2EDuration="25.81244501s" totalImagesPullingTime="23.486576278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:10:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:10:56.810924924 +0000 UTC m=+424.340833394" watchObservedRunningTime="2026-07-17 21:10:56.81244501 +0000 UTC m=+424.342353510"
Jul 17 21:10:56.812916 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:56.812895    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:56.815050 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:56.815031    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-4xsk8\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4xsk8"
Jul 17 21:10:56.837154 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.837095    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx" podStartSLOduration=14.837079612 podStartE2EDuration="14.837079612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:10:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:10:56.835095254 +0000 UTC m=+424.365003705" watchObservedRunningTime="2026-07-17 21:10:56.837079612 +0000 UTC m=+424.366988063"
Jul 17 21:10:56.853888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:56.853845    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz" podStartSLOduration=14.853829077 podStartE2EDuration="14.853829077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:10:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:10:56.851778887 +0000 UTC m=+424.381687342" watchObservedRunningTime="2026-07-17 21:10:56.853829077 +0000 UTC m=+424.383737535"
Jul 17 21:10:56.854036 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:10:56.853937    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7q2p2\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7q2p2"
Jul 17 21:10:57.040802 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:57.040724    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07132314-15d7-417f-9d7f-d7a06b7a0f79" path="/var/lib/kubelet/pods/07132314-15d7-417f-9d7f-d7a06b7a0f79/volumes"
Jul 17 21:10:57.041067 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:57.041055    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8491e444-f778-4203-bc8d-3b6466f25c36" path="/var/lib/kubelet/pods/8491e444-f778-4203-bc8d-3b6466f25c36/volumes"
Jul 17 21:10:59.688490 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:59.688453    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"]
Jul 17 21:10:59.688871 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:59.688651    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx" podUID="6536edc7-e107-48cd-b55d-d267b079c1c9" containerName="manager" containerID="cri-o://abd3b738b9d4ccb1ef91ce69241128a96ebb3534fb14e379388427d20e71667d" gracePeriod=10
Jul 17 21:10:59.813300 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:59.813255    2572 generic.go:356] "Generic (PLEG): container finished" podID="6536edc7-e107-48cd-b55d-d267b079c1c9" containerID="abd3b738b9d4ccb1ef91ce69241128a96ebb3534fb14e379388427d20e71667d" exitCode=0
Jul 17 21:10:59.813414 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:59.813310    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx" event={"ID":"6536edc7-e107-48cd-b55d-d267b079c1c9","Type":"ContainerDied","Data":"abd3b738b9d4ccb1ef91ce69241128a96ebb3534fb14e379388427d20e71667d"}
Jul 17 21:10:59.915976 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:59.914441    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"]
Jul 17 21:10:59.917514 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:59.917461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:10:59.933796 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:59.933765    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"]
Jul 17 21:10:59.950495 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:10:59.950472    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:11:00.031515 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.031483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvtfd\" (UniqueName: \"kubernetes.io/projected/e7e66b61-f187-4457-aea3-3a8b18c66ee6-kube-api-access-gvtfd\") pod \"kuadrant-operator-controller-manager-86878c769f-trmrb\" (UID: \"e7e66b61-f187-4457-aea3-3a8b18c66ee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:11:00.031707 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.031551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7e66b61-f187-4457-aea3-3a8b18c66ee6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-trmrb\" (UID: \"e7e66b61-f187-4457-aea3-3a8b18c66ee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:11:00.132362 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.132326    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6536edc7-e107-48cd-b55d-d267b079c1c9-extensions-socket-volume\") pod \"6536edc7-e107-48cd-b55d-d267b079c1c9\" (UID: \"6536edc7-e107-48cd-b55d-d267b079c1c9\") "
Jul 17 21:11:00.132563 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.132375    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc29f\" (UniqueName: \"kubernetes.io/projected/6536edc7-e107-48cd-b55d-d267b079c1c9-kube-api-access-vc29f\") pod \"6536edc7-e107-48cd-b55d-d267b079c1c9\" (UID: \"6536edc7-e107-48cd-b55d-d267b079c1c9\") "
Jul 17 21:11:00.132635 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.132601    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvtfd\" (UniqueName: \"kubernetes.io/projected/e7e66b61-f187-4457-aea3-3a8b18c66ee6-kube-api-access-gvtfd\") pod \"kuadrant-operator-controller-manager-86878c769f-trmrb\" (UID: \"e7e66b61-f187-4457-aea3-3a8b18c66ee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:11:00.132692 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.132679    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7e66b61-f187-4457-aea3-3a8b18c66ee6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-trmrb\" (UID: \"e7e66b61-f187-4457-aea3-3a8b18c66ee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:11:00.132781 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.132761    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6536edc7-e107-48cd-b55d-d267b079c1c9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6536edc7-e107-48cd-b55d-d267b079c1c9" (UID: "6536edc7-e107-48cd-b55d-d267b079c1c9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:11:00.133046 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.133026    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7e66b61-f187-4457-aea3-3a8b18c66ee6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-trmrb\" (UID: \"e7e66b61-f187-4457-aea3-3a8b18c66ee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:11:00.134599 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.134575    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6536edc7-e107-48cd-b55d-d267b079c1c9-kube-api-access-vc29f" (OuterVolumeSpecName: "kube-api-access-vc29f") pod "6536edc7-e107-48cd-b55d-d267b079c1c9" (UID: "6536edc7-e107-48cd-b55d-d267b079c1c9"). InnerVolumeSpecName "kube-api-access-vc29f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:11:00.158667 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.158641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvtfd\" (UniqueName: \"kubernetes.io/projected/e7e66b61-f187-4457-aea3-3a8b18c66ee6-kube-api-access-gvtfd\") pod \"kuadrant-operator-controller-manager-86878c769f-trmrb\" (UID: \"e7e66b61-f187-4457-aea3-3a8b18c66ee6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:11:00.233980 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.233895    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6536edc7-e107-48cd-b55d-d267b079c1c9-extensions-socket-volume\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:11:00.233980 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.233923    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc29f\" (UniqueName: \"kubernetes.io/projected/6536edc7-e107-48cd-b55d-d267b079c1c9-kube-api-access-vc29f\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:11:00.235813 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.235794    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:11:00.369109 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.369075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"]
Jul 17 21:11:00.371265 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:11:00.371238    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7e66b61_f187_4457_aea3_3a8b18c66ee6.slice/crio-524d7b73da18019bbce9ef710071e5519c76b0e6d19584c2340d1ce80bf3e94a WatchSource:0}: Error finding container 524d7b73da18019bbce9ef710071e5519c76b0e6d19584c2340d1ce80bf3e94a: Status 404 returned error can't find the container with id 524d7b73da18019bbce9ef710071e5519c76b0e6d19584c2340d1ce80bf3e94a
Jul 17 21:11:00.820305 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.820256    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"
Jul 17 21:11:00.820305 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.820260    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx" event={"ID":"6536edc7-e107-48cd-b55d-d267b079c1c9","Type":"ContainerDied","Data":"c83117780fe1897b996a5230684386e37d15784b84fa1ba5c2c58ecbf50a3c23"}
Jul 17 21:11:00.820911 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.820368    2572 scope.go:117] "RemoveContainer" containerID="abd3b738b9d4ccb1ef91ce69241128a96ebb3534fb14e379388427d20e71667d"
Jul 17 21:11:00.822491 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.822465    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb" event={"ID":"e7e66b61-f187-4457-aea3-3a8b18c66ee6","Type":"ContainerStarted","Data":"b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d"}
Jul 17 21:11:00.822603 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.822515    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb" event={"ID":"e7e66b61-f187-4457-aea3-3a8b18c66ee6","Type":"ContainerStarted","Data":"524d7b73da18019bbce9ef710071e5519c76b0e6d19584c2340d1ce80bf3e94a"}
Jul 17 21:11:00.822642 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.822609    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:11:00.845843 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.845803    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb" podStartSLOduration=1.8457902640000001 podStartE2EDuration="1.845790264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:10:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:11:00.844104954 +0000 UTC m=+428.374013425" watchObservedRunningTime="2026-07-17 21:11:00.845790264 +0000 UTC m=+428.375698797"
Jul 17 21:11:00.859733 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.859710    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"]
Jul 17 21:11:00.865916 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:00.865894    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kfspx"]
Jul 17 21:11:01.041147 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:01.041113    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6536edc7-e107-48cd-b55d-d267b079c1c9" path="/var/lib/kubelet/pods/6536edc7-e107-48cd-b55d-d267b079c1c9/volumes"
Jul 17 21:11:07.805545 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:07.805519    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bmzpz"
Jul 17 21:11:11.830086 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:11.830055    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:11:16.062550 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:16.062446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:16.581448 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:16.581403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:19.150355 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:19.150321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:28.491102 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.491064    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hbswk"]
Jul 17 21:11:28.491496 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.491418    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6536edc7-e107-48cd-b55d-d267b079c1c9" containerName="manager"
Jul 17 21:11:28.491496 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.491429    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6536edc7-e107-48cd-b55d-d267b079c1c9" containerName="manager"
Jul 17 21:11:28.491496 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.491489    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6536edc7-e107-48cd-b55d-d267b079c1c9" containerName="manager"
Jul 17 21:11:28.508255 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.508223    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:28.574053 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.574022    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hbswk"]
Jul 17 21:11:28.574223 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.574167    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:28.576558 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.576532    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 21:11:28.585166 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.585145    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hbswk"]
Jul 17 21:11:28.608242 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.608211    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:28.668708 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.668677    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-config-file\") pod \"limitador-limitador-64c94fd64f-hbswk\" (UID: \"aceb7f94-0f40-4257-a07a-9b28e14e2b4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:28.668869 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.668718    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5zv5\" (UniqueName: \"kubernetes.io/projected/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-kube-api-access-b5zv5\") pod \"limitador-limitador-64c94fd64f-hbswk\" (UID: \"aceb7f94-0f40-4257-a07a-9b28e14e2b4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:28.710481 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.710446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:28.769838 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.769752    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-config-file\") pod \"limitador-limitador-64c94fd64f-hbswk\" (UID: \"aceb7f94-0f40-4257-a07a-9b28e14e2b4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:28.769838 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.769798    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5zv5\" (UniqueName: \"kubernetes.io/projected/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-kube-api-access-b5zv5\") pod \"limitador-limitador-64c94fd64f-hbswk\" (UID: \"aceb7f94-0f40-4257-a07a-9b28e14e2b4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:28.770420 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.770401    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-config-file\") pod \"limitador-limitador-64c94fd64f-hbswk\" (UID: \"aceb7f94-0f40-4257-a07a-9b28e14e2b4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:28.778410 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.778388    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5zv5\" (UniqueName: \"kubernetes.io/projected/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-kube-api-access-b5zv5\") pod \"limitador-limitador-64c94fd64f-hbswk\" (UID: \"aceb7f94-0f40-4257-a07a-9b28e14e2b4e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:28.889955 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:28.889919    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:29.028817 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.028728    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hbswk"]
Jul 17 21:11:29.031701 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:11:29.031675    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaceb7f94_0f40_4257_a07a_9b28e14e2b4e.slice/crio-c7a36cc1d886b13d27eb1547f7594f030513f1de71e59f181a1dadfbdbdb2cd7 WatchSource:0}: Error finding container c7a36cc1d886b13d27eb1547f7594f030513f1de71e59f181a1dadfbdbdb2cd7: Status 404 returned error can't find the container with id c7a36cc1d886b13d27eb1547f7594f030513f1de71e59f181a1dadfbdbdb2cd7
Jul 17 21:11:29.312731 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.312647    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-hsmcc"]
Jul 17 21:11:29.317741 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.317718    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hsmcc"
Jul 17 21:11:29.319947 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.319923    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gdcvg\""
Jul 17 21:11:29.329658 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.329631    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hsmcc"]
Jul 17 21:11:29.364178 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.364131    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:29.375468 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.375445    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxxkk\" (UniqueName: \"kubernetes.io/projected/7f28805f-5146-460d-acce-7855c2b04311-kube-api-access-lxxkk\") pod \"authorino-58cd955675-hsmcc\" (UID: \"7f28805f-5146-460d-acce-7855c2b04311\") " pod="kuadrant-system/authorino-58cd955675-hsmcc"
Jul 17 21:11:29.475919 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.475885    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxxkk\" (UniqueName: \"kubernetes.io/projected/7f28805f-5146-460d-acce-7855c2b04311-kube-api-access-lxxkk\") pod \"authorino-58cd955675-hsmcc\" (UID: \"7f28805f-5146-460d-acce-7855c2b04311\") " pod="kuadrant-system/authorino-58cd955675-hsmcc"
Jul 17 21:11:29.484801 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.484768    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxxkk\" (UniqueName: \"kubernetes.io/projected/7f28805f-5146-460d-acce-7855c2b04311-kube-api-access-lxxkk\") pod \"authorino-58cd955675-hsmcc\" (UID: \"7f28805f-5146-460d-acce-7855c2b04311\") " pod="kuadrant-system/authorino-58cd955675-hsmcc"
Jul 17 21:11:29.548667 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.548635    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:29.627787 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.627716    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hsmcc"
Jul 17 21:11:29.761629 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.761600    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-hsmcc"]
Jul 17 21:11:29.763849 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:11:29.763775    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f28805f_5146_460d_acce_7855c2b04311.slice/crio-72b7b8311c24847024b375bf56ad41bc6818bf8b62cf12a6b96431fc529af250 WatchSource:0}: Error finding container 72b7b8311c24847024b375bf56ad41bc6818bf8b62cf12a6b96431fc529af250: Status 404 returned error can't find the container with id 72b7b8311c24847024b375bf56ad41bc6818bf8b62cf12a6b96431fc529af250
Jul 17 21:11:29.961774 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.961734    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk" event={"ID":"aceb7f94-0f40-4257-a07a-9b28e14e2b4e","Type":"ContainerStarted","Data":"c7a36cc1d886b13d27eb1547f7594f030513f1de71e59f181a1dadfbdbdb2cd7"}
Jul 17 21:11:29.963168 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:29.963139    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hsmcc" event={"ID":"7f28805f-5146-460d-acce-7855c2b04311","Type":"ContainerStarted","Data":"72b7b8311c24847024b375bf56ad41bc6818bf8b62cf12a6b96431fc529af250"}
Jul 17 21:11:33.906197 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:33.906118    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hsmcc"]
Jul 17 21:11:33.986490 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:33.986454    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk" event={"ID":"aceb7f94-0f40-4257-a07a-9b28e14e2b4e","Type":"ContainerStarted","Data":"44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d"}
Jul 17 21:11:33.986743 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:33.986698    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:33.987808 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:33.987778    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hsmcc" event={"ID":"7f28805f-5146-460d-acce-7855c2b04311","Type":"ContainerStarted","Data":"3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b"}
Jul 17 21:11:34.006399 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:34.006354    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk" podStartSLOduration=1.45084779 podStartE2EDuration="6.006340634s" totalImagesPullingTime="4.555492844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:11:34.004974047 +0000 UTC m=+461.534882518" watchObservedRunningTime="2026-07-17 21:11:34.006340634 +0000 UTC m=+461.536249139"
Jul 17 21:11:34.020800 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:34.020755    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-hsmcc" podStartSLOduration=1.135226667 podStartE2EDuration="5.020741283s" totalImagesPullingTime="3.885514616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:11:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:11:34.02002506 +0000 UTC m=+461.549933517" watchObservedRunningTime="2026-07-17 21:11:34.020741283 +0000 UTC m=+461.550649735"
Jul 17 21:11:34.991870 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:34.991822    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-hsmcc" podUID="7f28805f-5146-460d-acce-7855c2b04311" containerName="authorino" containerID="cri-o://3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b" gracePeriod=30
Jul 17 21:11:35.242445 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:35.242384    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hsmcc"
Jul 17 21:11:35.326771 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:35.326740    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxxkk\" (UniqueName: \"kubernetes.io/projected/7f28805f-5146-460d-acce-7855c2b04311-kube-api-access-lxxkk\") pod \"7f28805f-5146-460d-acce-7855c2b04311\" (UID: \"7f28805f-5146-460d-acce-7855c2b04311\") "
Jul 17 21:11:35.328757 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:35.328725    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f28805f-5146-460d-acce-7855c2b04311-kube-api-access-lxxkk" (OuterVolumeSpecName: "kube-api-access-lxxkk") pod "7f28805f-5146-460d-acce-7855c2b04311" (UID: "7f28805f-5146-460d-acce-7855c2b04311"). InnerVolumeSpecName "kube-api-access-lxxkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:11:35.427597 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:35.427553    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxxkk\" (UniqueName: \"kubernetes.io/projected/7f28805f-5146-460d-acce-7855c2b04311-kube-api-access-lxxkk\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:11:35.996866 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:35.996828    2572 generic.go:356] "Generic (PLEG): container finished" podID="7f28805f-5146-460d-acce-7855c2b04311" containerID="3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b" exitCode=0
Jul 17 21:11:35.996866 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:35.996867    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-hsmcc"
Jul 17 21:11:35.997413 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:35.996921    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hsmcc" event={"ID":"7f28805f-5146-460d-acce-7855c2b04311","Type":"ContainerDied","Data":"3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b"}
Jul 17 21:11:35.997413 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:35.996962    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-hsmcc" event={"ID":"7f28805f-5146-460d-acce-7855c2b04311","Type":"ContainerDied","Data":"72b7b8311c24847024b375bf56ad41bc6818bf8b62cf12a6b96431fc529af250"}
Jul 17 21:11:35.997413 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:35.996982    2572 scope.go:117] "RemoveContainer" containerID="3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b"
Jul 17 21:11:36.005810 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:36.005793    2572 scope.go:117] "RemoveContainer" containerID="3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b"
Jul 17 21:11:36.006064 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:11:36.006045    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b\": container with ID starting with 3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b not found: ID does not exist" containerID="3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b"
Jul 17 21:11:36.006114 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:36.006073    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b"} err="failed to get container status \"3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b\": rpc error: code = NotFound desc = could not find container \"3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b\": container with ID starting with 3a4c1ad6b8fcca1619bfa36a3f334060ca68347754385f0ec549eb1ea41b788b not found: ID does not exist"
Jul 17 21:11:36.018069 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:36.018038    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-hsmcc"]
Jul 17 21:11:36.022480 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:36.022453    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-hsmcc"]
Jul 17 21:11:37.040411 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:37.040376    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f28805f-5146-460d-acce-7855c2b04311" path="/var/lib/kubelet/pods/7f28805f-5146-460d-acce-7855c2b04311/volumes"
Jul 17 21:11:44.907566 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:44.907534    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hbswk"]
Jul 17 21:11:44.908121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:44.907775    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk" podUID="aceb7f94-0f40-4257-a07a-9b28e14e2b4e" containerName="limitador" containerID="cri-o://44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d" gracePeriod=30
Jul 17 21:11:44.908567 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:44.908424    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:45.461532 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:45.461509    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:45.616235 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:45.616131    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-config-file\") pod \"aceb7f94-0f40-4257-a07a-9b28e14e2b4e\" (UID: \"aceb7f94-0f40-4257-a07a-9b28e14e2b4e\") "
Jul 17 21:11:45.616409 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:45.616306    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5zv5\" (UniqueName: \"kubernetes.io/projected/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-kube-api-access-b5zv5\") pod \"aceb7f94-0f40-4257-a07a-9b28e14e2b4e\" (UID: \"aceb7f94-0f40-4257-a07a-9b28e14e2b4e\") "
Jul 17 21:11:45.616598 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:45.616578    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-config-file" (OuterVolumeSpecName: "config-file") pod "aceb7f94-0f40-4257-a07a-9b28e14e2b4e" (UID: "aceb7f94-0f40-4257-a07a-9b28e14e2b4e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:11:45.618339 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:45.618319    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-kube-api-access-b5zv5" (OuterVolumeSpecName: "kube-api-access-b5zv5") pod "aceb7f94-0f40-4257-a07a-9b28e14e2b4e" (UID: "aceb7f94-0f40-4257-a07a-9b28e14e2b4e"). InnerVolumeSpecName "kube-api-access-b5zv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:11:45.717391 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:45.717357    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5zv5\" (UniqueName: \"kubernetes.io/projected/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-kube-api-access-b5zv5\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:11:45.717391 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:45.717385    2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aceb7f94-0f40-4257-a07a-9b28e14e2b4e-config-file\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:11:46.044515 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:46.044474    2572 generic.go:356] "Generic (PLEG): container finished" podID="aceb7f94-0f40-4257-a07a-9b28e14e2b4e" containerID="44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d" exitCode=0
Jul 17 21:11:46.044515 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:46.044522    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk"
Jul 17 21:11:46.045022 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:46.044560    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk" event={"ID":"aceb7f94-0f40-4257-a07a-9b28e14e2b4e","Type":"ContainerDied","Data":"44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d"}
Jul 17 21:11:46.045022 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:46.044608    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hbswk" event={"ID":"aceb7f94-0f40-4257-a07a-9b28e14e2b4e","Type":"ContainerDied","Data":"c7a36cc1d886b13d27eb1547f7594f030513f1de71e59f181a1dadfbdbdb2cd7"}
Jul 17 21:11:46.045022 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:46.044634    2572 scope.go:117] "RemoveContainer" containerID="44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d"
Jul 17 21:11:46.053637 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:46.053618    2572 scope.go:117] "RemoveContainer" containerID="44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d"
Jul 17 21:11:46.053875 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:11:46.053858    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d\": container with ID starting with 44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d not found: ID does not exist" containerID="44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d"
Jul 17 21:11:46.053942 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:46.053882    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d"} err="failed to get container status \"44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d\": rpc error: code = NotFound desc = could not find container \"44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d\": container with ID starting with 44ace5df7a7719de7b48ab8a3edcb9dec589451982239efaa6c629d95625820d not found: ID does not exist"
Jul 17 21:11:46.067823 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:46.067788    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hbswk"]
Jul 17 21:11:46.071042 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:46.071019    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hbswk"]
Jul 17 21:11:47.040319 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:47.040263    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aceb7f94-0f40-4257-a07a-9b28e14e2b4e" path="/var/lib/kubelet/pods/aceb7f94-0f40-4257-a07a-9b28e14e2b4e/volumes"
Jul 17 21:11:49.545270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.545239    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:49.675079 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.675048    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:49.944690 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.944658    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"]
Jul 17 21:11:49.945041 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.945026    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aceb7f94-0f40-4257-a07a-9b28e14e2b4e" containerName="limitador"
Jul 17 21:11:49.945115 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.945043    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aceb7f94-0f40-4257-a07a-9b28e14e2b4e" containerName="limitador"
Jul 17 21:11:49.945115 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.945055    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f28805f-5146-460d-acce-7855c2b04311" containerName="authorino"
Jul 17 21:11:49.945115 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.945061    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f28805f-5146-460d-acce-7855c2b04311" containerName="authorino"
Jul 17 21:11:49.945270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.945144    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aceb7f94-0f40-4257-a07a-9b28e14e2b4e" containerName="limitador"
Jul 17 21:11:49.945270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.945155    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f28805f-5146-460d-acce-7855c2b04311" containerName="authorino"
Jul 17 21:11:49.953849 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.953814    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"
Jul 17 21:11:49.956626 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.956599    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4jpd6\""
Jul 17 21:11:49.957055 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.957035    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 21:11:49.957437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.957418    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 21:11:49.957533 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.957524    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 21:11:49.965212 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:49.965187    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"]
Jul 17 21:11:50.017090 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:50.017055    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:11:50.056372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:50.056337    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dff61145-beb0-467e-8287-bef2e511a2dd-data\") pod \"postgres-69fb4594cf-5xrkd\" (UID: \"dff61145-beb0-467e-8287-bef2e511a2dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"
Jul 17 21:11:50.056372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:50.056375    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnx6t\" (UniqueName: \"kubernetes.io/projected/dff61145-beb0-467e-8287-bef2e511a2dd-kube-api-access-lnx6t\") pod \"postgres-69fb4594cf-5xrkd\" (UID: \"dff61145-beb0-467e-8287-bef2e511a2dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"
Jul 17 21:11:50.157215 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:50.157187    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dff61145-beb0-467e-8287-bef2e511a2dd-data\") pod \"postgres-69fb4594cf-5xrkd\" (UID: \"dff61145-beb0-467e-8287-bef2e511a2dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"
Jul 17 21:11:50.157215 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:50.157221    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnx6t\" (UniqueName: \"kubernetes.io/projected/dff61145-beb0-467e-8287-bef2e511a2dd-kube-api-access-lnx6t\") pod \"postgres-69fb4594cf-5xrkd\" (UID: \"dff61145-beb0-467e-8287-bef2e511a2dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"
Jul 17 21:11:50.157624 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:50.157605    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dff61145-beb0-467e-8287-bef2e511a2dd-data\") pod \"postgres-69fb4594cf-5xrkd\" (UID: \"dff61145-beb0-467e-8287-bef2e511a2dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"
Jul 17 21:11:50.170118 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:50.170084    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnx6t\" (UniqueName: \"kubernetes.io/projected/dff61145-beb0-467e-8287-bef2e511a2dd-kube-api-access-lnx6t\") pod \"postgres-69fb4594cf-5xrkd\" (UID: \"dff61145-beb0-467e-8287-bef2e511a2dd\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"
Jul 17 21:11:50.265684 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:50.265601    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"
Jul 17 21:11:50.399613 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:50.399588    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"]
Jul 17 21:11:50.401990 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:11:50.401946    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff61145_beb0_467e_8287_bef2e511a2dd.slice/crio-4fbd74a7221bdeb2467cc802baa8b65dc7c00b5ac106c827fbad105eec41c437 WatchSource:0}: Error finding container 4fbd74a7221bdeb2467cc802baa8b65dc7c00b5ac106c827fbad105eec41c437: Status 404 returned error can't find the container with id 4fbd74a7221bdeb2467cc802baa8b65dc7c00b5ac106c827fbad105eec41c437
Jul 17 21:11:51.072523 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:51.072439    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd" event={"ID":"dff61145-beb0-467e-8287-bef2e511a2dd","Type":"ContainerStarted","Data":"4fbd74a7221bdeb2467cc802baa8b65dc7c00b5ac106c827fbad105eec41c437"}
Jul 17 21:11:54.947005 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:54.946983    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 21:11:55.094313 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:55.094269    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd" event={"ID":"dff61145-beb0-467e-8287-bef2e511a2dd","Type":"ContainerStarted","Data":"cf960d152e349abc6e0011d643bd2357495435e3634e41272ce10949ad274617"}
Jul 17 21:11:55.094475 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:55.094393    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"
Jul 17 21:11:55.112056 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:11:55.112011    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd" podStartSLOduration=1.571093332 podStartE2EDuration="6.111996743s" totalImagesPullingTime="4.540903411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:11:55.110535152 +0000 UTC m=+482.640443603" watchObservedRunningTime="2026-07-17 21:11:55.111996743 +0000 UTC m=+482.641905198"
Jul 17 21:12:01.127144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:01.127114    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-5xrkd"
Jul 17 21:12:01.443751 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:01.443719    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:02.198115 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.198081    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:02.761186 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.761153    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85dc68b7f5-7vkbv"]
Jul 17 21:12:02.822746 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.822712    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85dc68b7f5-7vkbv"]
Jul 17 21:12:02.822905 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.822809    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85dc68b7f5-7vkbv"
Jul 17 21:12:02.826212 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.826180    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 21:12:02.826212 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.826188    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gdcvg\""
Jul 17 21:12:02.861592 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.861558    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7d9ca88-fc6e-427e-b42c-1526f8e154af-tls-cert\") pod \"authorino-85dc68b7f5-7vkbv\" (UID: \"a7d9ca88-fc6e-427e-b42c-1526f8e154af\") " pod="kuadrant-system/authorino-85dc68b7f5-7vkbv"
Jul 17 21:12:02.861592 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.861596    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s66b\" (UniqueName: \"kubernetes.io/projected/a7d9ca88-fc6e-427e-b42c-1526f8e154af-kube-api-access-6s66b\") pod \"authorino-85dc68b7f5-7vkbv\" (UID: \"a7d9ca88-fc6e-427e-b42c-1526f8e154af\") " pod="kuadrant-system/authorino-85dc68b7f5-7vkbv"
Jul 17 21:12:02.962734 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.962695    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7d9ca88-fc6e-427e-b42c-1526f8e154af-tls-cert\") pod \"authorino-85dc68b7f5-7vkbv\" (UID: \"a7d9ca88-fc6e-427e-b42c-1526f8e154af\") " pod="kuadrant-system/authorino-85dc68b7f5-7vkbv"
Jul 17 21:12:02.962920 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.962743    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s66b\" (UniqueName: \"kubernetes.io/projected/a7d9ca88-fc6e-427e-b42c-1526f8e154af-kube-api-access-6s66b\") pod \"authorino-85dc68b7f5-7vkbv\" (UID: \"a7d9ca88-fc6e-427e-b42c-1526f8e154af\") " pod="kuadrant-system/authorino-85dc68b7f5-7vkbv"
Jul 17 21:12:02.965342 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.965316    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7d9ca88-fc6e-427e-b42c-1526f8e154af-tls-cert\") pod \"authorino-85dc68b7f5-7vkbv\" (UID: \"a7d9ca88-fc6e-427e-b42c-1526f8e154af\") " pod="kuadrant-system/authorino-85dc68b7f5-7vkbv"
Jul 17 21:12:02.971728 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:02.971708    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s66b\" (UniqueName: \"kubernetes.io/projected/a7d9ca88-fc6e-427e-b42c-1526f8e154af-kube-api-access-6s66b\") pod \"authorino-85dc68b7f5-7vkbv\" (UID: \"a7d9ca88-fc6e-427e-b42c-1526f8e154af\") " pod="kuadrant-system/authorino-85dc68b7f5-7vkbv"
Jul 17 21:12:03.131876 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:03.131793    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85dc68b7f5-7vkbv"
Jul 17 21:12:03.283170 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:03.283077    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85dc68b7f5-7vkbv"]
Jul 17 21:12:03.285559 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:12:03.285533    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7d9ca88_fc6e_427e_b42c_1526f8e154af.slice/crio-8a5fb138e9dd8e8e2d9f77b380ab24b8e57524746f682e81b080ccfa2fed69c5 WatchSource:0}: Error finding container 8a5fb138e9dd8e8e2d9f77b380ab24b8e57524746f682e81b080ccfa2fed69c5: Status 404 returned error can't find the container with id 8a5fb138e9dd8e8e2d9f77b380ab24b8e57524746f682e81b080ccfa2fed69c5
Jul 17 21:12:04.134522 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:04.134490    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85dc68b7f5-7vkbv" event={"ID":"a7d9ca88-fc6e-427e-b42c-1526f8e154af","Type":"ContainerStarted","Data":"0f16dfcd3db72e4a87f57fa8926d5f4cd7e8891563c5125d55d3d5d1dc6ec2ba"}
Jul 17 21:12:04.134522 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:04.134529    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85dc68b7f5-7vkbv" event={"ID":"a7d9ca88-fc6e-427e-b42c-1526f8e154af","Type":"ContainerStarted","Data":"8a5fb138e9dd8e8e2d9f77b380ab24b8e57524746f682e81b080ccfa2fed69c5"}
Jul 17 21:12:04.150299 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:04.150214    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85dc68b7f5-7vkbv" podStartSLOduration=1.5025158680000001 podStartE2EDuration="2.150194032s" totalImagesPullingTime="647.678164ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:12:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:12:04.149944568 +0000 UTC m=+491.679853033" watchObservedRunningTime="2026-07-17 21:12:04.150194032 +0000 UTC m=+491.680102484"
Jul 17 21:12:08.692270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.692238    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:08.700016 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.699984    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-9bfcd7976-lq429"]
Jul 17 21:12:08.714918 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.714888    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:08.716963 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.716937    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9bfcd7976-lq429"]
Jul 17 21:12:08.717849 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.717682    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 21:12:08.717849 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.717709    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 21:12:08.717849 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.717715    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w7w99\""
Jul 17 21:12:08.803877 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.803844    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:08.810986 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.810958    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5kdv\" (UniqueName: \"kubernetes.io/projected/0a1ca2f6-c102-49a2-8198-13984fc98d42-kube-api-access-k5kdv\") pod \"maas-controller-9bfcd7976-lq429\" (UID: \"0a1ca2f6-c102-49a2-8198-13984fc98d42\") " pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:08.811112 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.811010    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a1ca2f6-c102-49a2-8198-13984fc98d42-webhook-cert\") pod \"maas-controller-9bfcd7976-lq429\" (UID: \"0a1ca2f6-c102-49a2-8198-13984fc98d42\") " pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:08.899263 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.899225    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76fff89cdb-wncwd"]
Jul 17 21:12:08.901810 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.901788    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:12:08.911672 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.911639    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qqzl\" (UniqueName: \"kubernetes.io/projected/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-kube-api-access-5qqzl\") pod \"maas-controller-76fff89cdb-wncwd\" (UID: \"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b\") " pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:12:08.911780 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.911712    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5kdv\" (UniqueName: \"kubernetes.io/projected/0a1ca2f6-c102-49a2-8198-13984fc98d42-kube-api-access-k5kdv\") pod \"maas-controller-9bfcd7976-lq429\" (UID: \"0a1ca2f6-c102-49a2-8198-13984fc98d42\") " pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:08.911780 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.911745    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-webhook-cert\") pod \"maas-controller-76fff89cdb-wncwd\" (UID: \"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b\") " pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:12:08.911780 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.911770    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a1ca2f6-c102-49a2-8198-13984fc98d42-webhook-cert\") pod \"maas-controller-9bfcd7976-lq429\" (UID: \"0a1ca2f6-c102-49a2-8198-13984fc98d42\") " pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:08.914516 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.914492    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a1ca2f6-c102-49a2-8198-13984fc98d42-webhook-cert\") pod \"maas-controller-9bfcd7976-lq429\" (UID: \"0a1ca2f6-c102-49a2-8198-13984fc98d42\") " pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:08.916019 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.915996    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-wncwd"]
Jul 17 21:12:08.923465 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.923446    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5kdv\" (UniqueName: \"kubernetes.io/projected/0a1ca2f6-c102-49a2-8198-13984fc98d42-kube-api-access-k5kdv\") pod \"maas-controller-9bfcd7976-lq429\" (UID: \"0a1ca2f6-c102-49a2-8198-13984fc98d42\") " pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:08.924718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:08.924688    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:09.012345 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:09.012233    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-webhook-cert\") pod \"maas-controller-76fff89cdb-wncwd\" (UID: \"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b\") " pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:12:09.012345 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:09.012325    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qqzl\" (UniqueName: \"kubernetes.io/projected/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-kube-api-access-5qqzl\") pod \"maas-controller-76fff89cdb-wncwd\" (UID: \"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b\") " pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:12:09.014752 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:09.014730    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-webhook-cert\") pod \"maas-controller-76fff89cdb-wncwd\" (UID: \"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b\") " pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:12:09.022637 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:09.022619    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qqzl\" (UniqueName: \"kubernetes.io/projected/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-kube-api-access-5qqzl\") pod \"maas-controller-76fff89cdb-wncwd\" (UID: \"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b\") " pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:12:09.027442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:09.027414    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:09.162857 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:09.162825    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-9bfcd7976-lq429"]
Jul 17 21:12:09.166371 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:12:09.166343    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1ca2f6_c102_49a2_8198_13984fc98d42.slice/crio-415281b85fa6753e94d30023a296da98c75889f86424714a08bbc2a4e6a7c4b7 WatchSource:0}: Error finding container 415281b85fa6753e94d30023a296da98c75889f86424714a08bbc2a4e6a7c4b7: Status 404 returned error can't find the container with id 415281b85fa6753e94d30023a296da98c75889f86424714a08bbc2a4e6a7c4b7
Jul 17 21:12:09.212031 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:09.212012    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:12:09.341169 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:09.341147    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-wncwd"]
Jul 17 21:12:09.343694 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:12:09.343670    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24245d5_a7bb_4ba3_b8ab_ab283a5bc18b.slice/crio-f9a3acfdb741185945086332bd598c795b4762ef384423302092d66ce84b69d8 WatchSource:0}: Error finding container f9a3acfdb741185945086332bd598c795b4762ef384423302092d66ce84b69d8: Status 404 returned error can't find the container with id f9a3acfdb741185945086332bd598c795b4762ef384423302092d66ce84b69d8
Jul 17 21:12:10.165326 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:10.165177    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fff89cdb-wncwd" event={"ID":"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b","Type":"ContainerStarted","Data":"f9a3acfdb741185945086332bd598c795b4762ef384423302092d66ce84b69d8"}
Jul 17 21:12:10.167705 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:10.167660    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9bfcd7976-lq429" event={"ID":"0a1ca2f6-c102-49a2-8198-13984fc98d42","Type":"ContainerStarted","Data":"415281b85fa6753e94d30023a296da98c75889f86424714a08bbc2a4e6a7c4b7"}
Jul 17 21:12:11.203951 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:11.203915    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:11.292539 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:11.292496    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:12.001964 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:12.001927    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:12.109247 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:12.109140    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:12.179195 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:12.179152    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fff89cdb-wncwd" event={"ID":"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b","Type":"ContainerStarted","Data":"3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35"}
Jul 17 21:12:12.179402 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:12.179316    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:12:12.180656 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:12.180633    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9bfcd7976-lq429" event={"ID":"0a1ca2f6-c102-49a2-8198-13984fc98d42","Type":"ContainerStarted","Data":"a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e"}
Jul 17 21:12:12.180754 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:12.180683    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:12.205236 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:12.205190    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76fff89cdb-wncwd" podStartSLOduration=1.777237961 podStartE2EDuration="4.205176372s" totalImagesPullingTime="2.427938411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:12:12.202891332 +0000 UTC m=+499.732799809" watchObservedRunningTime="2026-07-17 21:12:12.205176372 +0000 UTC m=+499.735084824"
Jul 17 21:12:12.222089 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:12.222038    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-9bfcd7976-lq429" podStartSLOduration=1.621529491 podStartE2EDuration="4.222021962s" totalImagesPullingTime="2.600492471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:12:12.221722073 +0000 UTC m=+499.751630523" watchObservedRunningTime="2026-07-17 21:12:12.222021962 +0000 UTC m=+499.751930414"
Jul 17 21:12:23.187758 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.187725    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:23.188181 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.187814    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:12:23.252298 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.252237    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9bfcd7976-lq429"]
Jul 17 21:12:23.252515 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.252489    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-9bfcd7976-lq429" podUID="0a1ca2f6-c102-49a2-8198-13984fc98d42" containerName="manager" containerID="cri-o://a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e" gracePeriod=30
Jul 17 21:12:23.500563 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.500542    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:23.551374 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.551344    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5kdv\" (UniqueName: \"kubernetes.io/projected/0a1ca2f6-c102-49a2-8198-13984fc98d42-kube-api-access-k5kdv\") pod \"0a1ca2f6-c102-49a2-8198-13984fc98d42\" (UID: \"0a1ca2f6-c102-49a2-8198-13984fc98d42\") "
Jul 17 21:12:23.551522 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.551393    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a1ca2f6-c102-49a2-8198-13984fc98d42-webhook-cert\") pod \"0a1ca2f6-c102-49a2-8198-13984fc98d42\" (UID: \"0a1ca2f6-c102-49a2-8198-13984fc98d42\") "
Jul 17 21:12:23.553539 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.553498    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a1ca2f6-c102-49a2-8198-13984fc98d42-kube-api-access-k5kdv" (OuterVolumeSpecName: "kube-api-access-k5kdv") pod "0a1ca2f6-c102-49a2-8198-13984fc98d42" (UID: "0a1ca2f6-c102-49a2-8198-13984fc98d42"). InnerVolumeSpecName "kube-api-access-k5kdv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:12:23.553663 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.553594    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a1ca2f6-c102-49a2-8198-13984fc98d42-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0a1ca2f6-c102-49a2-8198-13984fc98d42" (UID: "0a1ca2f6-c102-49a2-8198-13984fc98d42"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:12:23.652294 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.652250    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5kdv\" (UniqueName: \"kubernetes.io/projected/0a1ca2f6-c102-49a2-8198-13984fc98d42-kube-api-access-k5kdv\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:12:23.652459 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:23.652309    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0a1ca2f6-c102-49a2-8198-13984fc98d42-webhook-cert\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:12:24.239415 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:24.239377    2572 generic.go:356] "Generic (PLEG): container finished" podID="0a1ca2f6-c102-49a2-8198-13984fc98d42" containerID="a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e" exitCode=0
Jul 17 21:12:24.239828 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:24.239424    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-9bfcd7976-lq429"
Jul 17 21:12:24.239828 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:24.239465    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9bfcd7976-lq429" event={"ID":"0a1ca2f6-c102-49a2-8198-13984fc98d42","Type":"ContainerDied","Data":"a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e"}
Jul 17 21:12:24.239828 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:24.239523    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-9bfcd7976-lq429" event={"ID":"0a1ca2f6-c102-49a2-8198-13984fc98d42","Type":"ContainerDied","Data":"415281b85fa6753e94d30023a296da98c75889f86424714a08bbc2a4e6a7c4b7"}
Jul 17 21:12:24.239828 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:24.239549    2572 scope.go:117] "RemoveContainer" containerID="a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e"
Jul 17 21:12:24.248702 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:24.248687    2572 scope.go:117] "RemoveContainer" containerID="a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e"
Jul 17 21:12:24.248945 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:12:24.248927    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e\": container with ID starting with a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e not found: ID does not exist" containerID="a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e"
Jul 17 21:12:24.248993 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:24.248954    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e"} err="failed to get container status \"a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e\": rpc error: code = NotFound desc = could not find container \"a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e\": container with ID starting with a9ec5e122679307137332de68b149a0f0cd09294bb9c2ba0670535cba3c4ec8e not found: ID does not exist"
Jul 17 21:12:24.261922 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:24.261898    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-9bfcd7976-lq429"]
Jul 17 21:12:24.265650 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:24.265620    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-9bfcd7976-lq429"]
Jul 17 21:12:25.040788 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:25.040759    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a1ca2f6-c102-49a2-8198-13984fc98d42" path="/var/lib/kubelet/pods/0a1ca2f6-c102-49a2-8198-13984fc98d42/volumes"
Jul 17 21:12:36.765497 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:36.765456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:43.668174 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:43.668134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:43.767489 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:43.767459    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:44.165036 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.165008    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:44.294104 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.294071    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"]
Jul 17 21:12:44.294447 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.294433    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1ca2f6-c102-49a2-8198-13984fc98d42" containerName="manager"
Jul 17 21:12:44.294507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.294448    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1ca2f6-c102-49a2-8198-13984fc98d42" containerName="manager"
Jul 17 21:12:44.294550 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.294517    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a1ca2f6-c102-49a2-8198-13984fc98d42" containerName="manager"
Jul 17 21:12:44.350472 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.350448    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"]
Jul 17 21:12:44.350637 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.350537    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.352817 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.352797    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 21:12:44.353204 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.353184    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fstp6\""
Jul 17 21:12:44.423825 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.423748    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0bb288e-236e-453e-a823-9df9323cea17-maas-api-tls\") pod \"maas-api-6d79756bc8-k7fcw\" (UID: \"d0bb288e-236e-453e-a823-9df9323cea17\") " pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.423825 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.423795    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpwr5\" (UniqueName: \"kubernetes.io/projected/d0bb288e-236e-453e-a823-9df9323cea17-kube-api-access-rpwr5\") pod \"maas-api-6d79756bc8-k7fcw\" (UID: \"d0bb288e-236e-453e-a823-9df9323cea17\") " pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.424009 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.423837    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0bb288e-236e-453e-a823-9df9323cea17-openshift-service-ca\") pod \"maas-api-6d79756bc8-k7fcw\" (UID: \"d0bb288e-236e-453e-a823-9df9323cea17\") " pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.523043 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.523007    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:44.525174 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.525148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0bb288e-236e-453e-a823-9df9323cea17-maas-api-tls\") pod \"maas-api-6d79756bc8-k7fcw\" (UID: \"d0bb288e-236e-453e-a823-9df9323cea17\") " pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.525348 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.525190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpwr5\" (UniqueName: \"kubernetes.io/projected/d0bb288e-236e-453e-a823-9df9323cea17-kube-api-access-rpwr5\") pod \"maas-api-6d79756bc8-k7fcw\" (UID: \"d0bb288e-236e-453e-a823-9df9323cea17\") " pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.525348 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.525233    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0bb288e-236e-453e-a823-9df9323cea17-openshift-service-ca\") pod \"maas-api-6d79756bc8-k7fcw\" (UID: \"d0bb288e-236e-453e-a823-9df9323cea17\") " pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.525927 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.525903    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0bb288e-236e-453e-a823-9df9323cea17-openshift-service-ca\") pod \"maas-api-6d79756bc8-k7fcw\" (UID: \"d0bb288e-236e-453e-a823-9df9323cea17\") " pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.527525 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.527505    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0bb288e-236e-453e-a823-9df9323cea17-maas-api-tls\") pod \"maas-api-6d79756bc8-k7fcw\" (UID: \"d0bb288e-236e-453e-a823-9df9323cea17\") " pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.534285 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.534260    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpwr5\" (UniqueName: \"kubernetes.io/projected/d0bb288e-236e-453e-a823-9df9323cea17-kube-api-access-rpwr5\") pod \"maas-api-6d79756bc8-k7fcw\" (UID: \"d0bb288e-236e-453e-a823-9df9323cea17\") " pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.661062 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.661029    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:44.745918 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.745886    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:44.811099 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.811068    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"]
Jul 17 21:12:44.813663 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:12:44.813632    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bb288e_236e_453e_a823_9df9323cea17.slice/crio-61c1cd0531bc63d9d5a4e27446286301ee07d98817e700dcfacb2ada2ac0d8db WatchSource:0}: Error finding container 61c1cd0531bc63d9d5a4e27446286301ee07d98817e700dcfacb2ada2ac0d8db: Status 404 returned error can't find the container with id 61c1cd0531bc63d9d5a4e27446286301ee07d98817e700dcfacb2ada2ac0d8db
Jul 17 21:12:44.838795 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.838765    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-5gczm"]
Jul 17 21:12:44.842074 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.842053    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm"
Jul 17 21:12:44.844739 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.844720    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tfm7j\""
Jul 17 21:12:44.844888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.844720    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 21:12:44.853800 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.853773    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-5gczm"]
Jul 17 21:12:44.855596 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.855560    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:44.928799 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.928762    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmmvw\" (UniqueName: \"kubernetes.io/projected/58556bff-d5df-461a-885f-f59b30a0c9a2-kube-api-access-tmmvw\") pod \"payload-pre-processing-7677b774bb-5gczm\" (UID: \"58556bff-d5df-461a-885f-f59b30a0c9a2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm"
Jul 17 21:12:44.928966 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:44.928869    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58556bff-d5df-461a-885f-f59b30a0c9a2-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-5gczm\" (UID: \"58556bff-d5df-461a-885f-f59b30a0c9a2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm"
Jul 17 21:12:45.030297 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:45.030192    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58556bff-d5df-461a-885f-f59b30a0c9a2-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-5gczm\" (UID: \"58556bff-d5df-461a-885f-f59b30a0c9a2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm"
Jul 17 21:12:45.030466 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:45.030312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmmvw\" (UniqueName: \"kubernetes.io/projected/58556bff-d5df-461a-885f-f59b30a0c9a2-kube-api-access-tmmvw\") pod \"payload-pre-processing-7677b774bb-5gczm\" (UID: \"58556bff-d5df-461a-885f-f59b30a0c9a2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm"
Jul 17 21:12:45.031129 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:45.031099    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58556bff-d5df-461a-885f-f59b30a0c9a2-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-5gczm\" (UID: \"58556bff-d5df-461a-885f-f59b30a0c9a2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm"
Jul 17 21:12:45.041297 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:45.041249    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmmvw\" (UniqueName: \"kubernetes.io/projected/58556bff-d5df-461a-885f-f59b30a0c9a2-kube-api-access-tmmvw\") pod \"payload-pre-processing-7677b774bb-5gczm\" (UID: \"58556bff-d5df-461a-885f-f59b30a0c9a2\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm"
Jul 17 21:12:45.154163 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:45.154128    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm"
Jul 17 21:12:45.313723 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:45.313694    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-5gczm"]
Jul 17 21:12:45.316048 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:12:45.316025    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58556bff_d5df_461a_885f_f59b30a0c9a2.slice/crio-543b36b7cb274e556fecc47d991c22cf4a13f8bc6b4c5b15bb3cea1917dd74c4 WatchSource:0}: Error finding container 543b36b7cb274e556fecc47d991c22cf4a13f8bc6b4c5b15bb3cea1917dd74c4: Status 404 returned error can't find the container with id 543b36b7cb274e556fecc47d991c22cf4a13f8bc6b4c5b15bb3cea1917dd74c4
Jul 17 21:12:45.341442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:45.341414    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm" event={"ID":"58556bff-d5df-461a-885f-f59b30a0c9a2","Type":"ContainerStarted","Data":"543b36b7cb274e556fecc47d991c22cf4a13f8bc6b4c5b15bb3cea1917dd74c4"}
Jul 17 21:12:45.342861 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:45.342831    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw" event={"ID":"d0bb288e-236e-453e-a823-9df9323cea17","Type":"ContainerStarted","Data":"61c1cd0531bc63d9d5a4e27446286301ee07d98817e700dcfacb2ada2ac0d8db"}
Jul 17 21:12:47.355479 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:47.355398    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw" event={"ID":"d0bb288e-236e-453e-a823-9df9323cea17","Type":"ContainerStarted","Data":"753ef402e380834cce588f54ea990ecef5a5043c72355fea06b65852b0aa09e0"}
Jul 17 21:12:47.355479 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:47.355461    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:47.356986 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:47.356963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm" event={"ID":"58556bff-d5df-461a-885f-f59b30a0c9a2","Type":"ContainerStarted","Data":"17736288ee479a83ee3a702b8bd6f6cc3d04295130b967e3a5de8c031e2b2ce2"}
Jul 17 21:12:47.357096 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:47.357008    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm"
Jul 17 21:12:47.373264 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:47.373214    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw" podStartSLOduration=1.172229476 podStartE2EDuration="3.373198022s" totalImagesPullingTime="2.200968546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:12:47.372697982 +0000 UTC m=+534.902606444" watchObservedRunningTime="2026-07-17 21:12:47.373198022 +0000 UTC m=+534.903106473"
Jul 17 21:12:47.389571 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:47.389531    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm" podStartSLOduration=1.685523232 podStartE2EDuration="3.389516827s" totalImagesPullingTime="1.703993595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:12:47.38793665 +0000 UTC m=+534.917845103" watchObservedRunningTime="2026-07-17 21:12:47.389516827 +0000 UTC m=+534.919425331"
Jul 17 21:12:48.498254 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:48.498224    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:48.599314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:48.599264    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:53.369355 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:53.369324    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d79756bc8-k7fcw"
Jul 17 21:12:54.962999 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:54.962962    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:55.066018 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:55.065986    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:12:58.366292 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:12:58.366243    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-5gczm"
Jul 17 21:13:21.692161 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:13:21.692127    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:13:32.524704 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:13:32.524669    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:13:50.675945 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:13:50.675913    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:14:04.703657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:04.703622    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:14:06.593304 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.593254    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"]
Jul 17 21:14:06.604335 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.604289    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.608165 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.608136    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lhl2r\""
Jul 17 21:14:06.608165 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.608136    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 21:14:06.608370 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.608146    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 21:14:06.608614 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.608598    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 21:14:06.615612 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.615589    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97acd03c-19ad-4cae-acd3-ca9736f9531c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.615701 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.615620    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwbtk\" (UniqueName: \"kubernetes.io/projected/97acd03c-19ad-4cae-acd3-ca9736f9531c-kube-api-access-zwbtk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.615701 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.615642    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.615812 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.615747    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.615812 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.615795    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.615905 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.615847    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.620552 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.620530    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"]
Jul 17 21:14:06.716790 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.716747    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.716981 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.716816    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.716981 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.716848    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.716981 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.716890    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.716981 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.716925    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97acd03c-19ad-4cae-acd3-ca9736f9531c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.716981 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.716949    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwbtk\" (UniqueName: \"kubernetes.io/projected/97acd03c-19ad-4cae-acd3-ca9736f9531c-kube-api-access-zwbtk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.717233 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.717205    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.717335 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.717303    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.717395 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.717363    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.719250 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.719217    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97acd03c-19ad-4cae-acd3-ca9736f9531c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.719978 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.719812    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97acd03c-19ad-4cae-acd3-ca9736f9531c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.739763 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.739731    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwbtk\" (UniqueName: \"kubernetes.io/projected/97acd03c-19ad-4cae-acd3-ca9736f9531c-kube-api-access-zwbtk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9\" (UID: \"97acd03c-19ad-4cae-acd3-ca9736f9531c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:06.759048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.759023    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:14:06.916560 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:06.916527    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:07.050421 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:07.050399    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"]
Jul 17 21:14:07.052551 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:14:07.052516    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97acd03c_19ad_4cae_acd3_ca9736f9531c.slice/crio-2a5e0456f27b441f3fda33af0133e0777ab4b87e56182bf73ceed5b5bf0106cc WatchSource:0}: Error finding container 2a5e0456f27b441f3fda33af0133e0777ab4b87e56182bf73ceed5b5bf0106cc: Status 404 returned error can't find the container with id 2a5e0456f27b441f3fda33af0133e0777ab4b87e56182bf73ceed5b5bf0106cc
Jul 17 21:14:07.746665 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:07.746627    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9" event={"ID":"97acd03c-19ad-4cae-acd3-ca9736f9531c","Type":"ContainerStarted","Data":"2a5e0456f27b441f3fda33af0133e0777ab4b87e56182bf73ceed5b5bf0106cc"}
Jul 17 21:14:08.754094 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:08.754057    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9" event={"ID":"97acd03c-19ad-4cae-acd3-ca9736f9531c","Type":"ContainerStarted","Data":"33ccd7533dd8940f5c4e7c7252ef0fcd060880c604b07f8380c01952afb4e6ae"}
Jul 17 21:14:08.775696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:08.775636    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9" podStartSLOduration=1.740174077 podStartE2EDuration="2.775618144s" totalImagesPullingTime="1.035444067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:14:08.774301338 +0000 UTC m=+616.304209805" watchObservedRunningTime="2026-07-17 21:14:08.775618144 +0000 UTC m=+616.305526595"
Jul 17 21:14:12.615841 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:12.615806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:14:13.810429 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:13.810392    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:14:15.825869 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:15.825839    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:14:15.926838 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:15.926805    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:14:16.917475 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:16.917436    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:16.917869 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:16.917495    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:16.930067 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:16.930037    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:17.809009 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:17.808984    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9"
Jul 17 21:14:30.089314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.089268    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"]
Jul 17 21:14:30.094199 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.094179    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.096731 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.096710    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 17 21:14:30.103186 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.103166    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"]
Jul 17 21:14:30.203267 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.203234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:14:30.224462 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.224429    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw99l\" (UniqueName: \"kubernetes.io/projected/f1489b04-5279-4f64-999a-a0e4648dc660-kube-api-access-bw99l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.224462 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.224465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.224674 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.224502    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1489b04-5279-4f64-999a-a0e4648dc660-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.224674 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.224581    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.224674 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.224609    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.224674 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.224645    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.325645 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.325598    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.325832 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.325661    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw99l\" (UniqueName: \"kubernetes.io/projected/f1489b04-5279-4f64-999a-a0e4648dc660-kube-api-access-bw99l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.325832 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.325690    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.325832 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.325738    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1489b04-5279-4f64-999a-a0e4648dc660-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.326004 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.325881    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.326004 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.325942    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.326122 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.326099    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.326230 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.326210    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.326305 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.326268    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.328460 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.328431    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1489b04-5279-4f64-999a-a0e4648dc660-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.329096 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.329053    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1489b04-5279-4f64-999a-a0e4648dc660-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.333911 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.333886    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw99l\" (UniqueName: \"kubernetes.io/projected/f1489b04-5279-4f64-999a-a0e4648dc660-kube-api-access-bw99l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t\" (UID: \"f1489b04-5279-4f64-999a-a0e4648dc660\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.403899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.403810    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:30.536239 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.536141    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"]
Jul 17 21:14:30.538536 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:14:30.538508    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1489b04_5279_4f64_999a_a0e4648dc660.slice/crio-d5ca6d2953a63dd42129f4ea7cf6a5650cc9098f8ff9930065f61512eb9330fd WatchSource:0}: Error finding container d5ca6d2953a63dd42129f4ea7cf6a5650cc9098f8ff9930065f61512eb9330fd: Status 404 returned error can't find the container with id d5ca6d2953a63dd42129f4ea7cf6a5650cc9098f8ff9930065f61512eb9330fd
Jul 17 21:14:30.859587 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.859502    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t" event={"ID":"f1489b04-5279-4f64-999a-a0e4648dc660","Type":"ContainerStarted","Data":"b4f060cb25f110f44c06fd4bde05b3c929e878d8ade97be9a511e72e6cfda157"}
Jul 17 21:14:30.859587 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.859556    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t" event={"ID":"f1489b04-5279-4f64-999a-a0e4648dc660","Type":"ContainerStarted","Data":"d5ca6d2953a63dd42129f4ea7cf6a5650cc9098f8ff9930065f61512eb9330fd"}
Jul 17 21:14:30.878593 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:30.878547    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t" podStartSLOduration=0.676842478 podStartE2EDuration="878.530031ms" totalImagesPullingTime="201.687553ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:14:30.876772027 +0000 UTC m=+638.406680480" watchObservedRunningTime="2026-07-17 21:14:30.878530031 +0000 UTC m=+638.408438540"
Jul 17 21:14:40.404909 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:40.404871    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:40.404909 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:40.404917    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:40.417349 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:40.417325    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:14:40.915790 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:14:40.915759    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t"
Jul 17 21:15:42.656828 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:42.656794    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:15:44.041363 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.040532    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85dc68b7f5-7vkbv"]
Jul 17 21:15:44.041363 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.040848    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-85dc68b7f5-7vkbv" podUID="a7d9ca88-fc6e-427e-b42c-1526f8e154af" containerName="authorino" containerID="cri-o://0f16dfcd3db72e4a87f57fa8926d5f4cd7e8891563c5125d55d3d5d1dc6ec2ba" gracePeriod=30
Jul 17 21:15:44.143760 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.143708    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:15:44.213640 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.213605    2572 generic.go:356] "Generic (PLEG): container finished" podID="a7d9ca88-fc6e-427e-b42c-1526f8e154af" containerID="0f16dfcd3db72e4a87f57fa8926d5f4cd7e8891563c5125d55d3d5d1dc6ec2ba" exitCode=0
Jul 17 21:15:44.213803 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.213655    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85dc68b7f5-7vkbv" event={"ID":"a7d9ca88-fc6e-427e-b42c-1526f8e154af","Type":"ContainerDied","Data":"0f16dfcd3db72e4a87f57fa8926d5f4cd7e8891563c5125d55d3d5d1dc6ec2ba"}
Jul 17 21:15:44.303634 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.303570    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85dc68b7f5-7vkbv"
Jul 17 21:15:44.442344 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.442308    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7d9ca88-fc6e-427e-b42c-1526f8e154af-tls-cert\") pod \"a7d9ca88-fc6e-427e-b42c-1526f8e154af\" (UID: \"a7d9ca88-fc6e-427e-b42c-1526f8e154af\") "
Jul 17 21:15:44.442515 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.442356    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s66b\" (UniqueName: \"kubernetes.io/projected/a7d9ca88-fc6e-427e-b42c-1526f8e154af-kube-api-access-6s66b\") pod \"a7d9ca88-fc6e-427e-b42c-1526f8e154af\" (UID: \"a7d9ca88-fc6e-427e-b42c-1526f8e154af\") "
Jul 17 21:15:44.444351 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.444329    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7d9ca88-fc6e-427e-b42c-1526f8e154af-kube-api-access-6s66b" (OuterVolumeSpecName: "kube-api-access-6s66b") pod "a7d9ca88-fc6e-427e-b42c-1526f8e154af" (UID: "a7d9ca88-fc6e-427e-b42c-1526f8e154af"). InnerVolumeSpecName "kube-api-access-6s66b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:15:44.452987 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.452962    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7d9ca88-fc6e-427e-b42c-1526f8e154af-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a7d9ca88-fc6e-427e-b42c-1526f8e154af" (UID: "a7d9ca88-fc6e-427e-b42c-1526f8e154af"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:15:44.543637 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.543602    2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a7d9ca88-fc6e-427e-b42c-1526f8e154af-tls-cert\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:15:44.543637 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:44.543632    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s66b\" (UniqueName: \"kubernetes.io/projected/a7d9ca88-fc6e-427e-b42c-1526f8e154af-kube-api-access-6s66b\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:15:45.220464 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:45.220432    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85dc68b7f5-7vkbv"
Jul 17 21:15:45.220896 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:45.220431    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85dc68b7f5-7vkbv" event={"ID":"a7d9ca88-fc6e-427e-b42c-1526f8e154af","Type":"ContainerDied","Data":"8a5fb138e9dd8e8e2d9f77b380ab24b8e57524746f682e81b080ccfa2fed69c5"}
Jul 17 21:15:45.220896 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:45.220563    2572 scope.go:117] "RemoveContainer" containerID="0f16dfcd3db72e4a87f57fa8926d5f4cd7e8891563c5125d55d3d5d1dc6ec2ba"
Jul 17 21:15:45.236415 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:45.236393    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85dc68b7f5-7vkbv"]
Jul 17 21:15:45.240265 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:45.240246    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85dc68b7f5-7vkbv"]
Jul 17 21:15:47.040774 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:47.040741    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7d9ca88-fc6e-427e-b42c-1526f8e154af" path="/var/lib/kubelet/pods/a7d9ca88-fc6e-427e-b42c-1526f8e154af/volumes"
Jul 17 21:15:49.590153 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:15:49.590109    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:16:29.007492 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.007459    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-wncwd"]
Jul 17 21:16:29.008002 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.007681    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76fff89cdb-wncwd" podUID="b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b" containerName="manager" containerID="cri-o://3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35" gracePeriod=30
Jul 17 21:16:29.266064 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.266004    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:16:29.309959 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.309918    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qqzl\" (UniqueName: \"kubernetes.io/projected/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-kube-api-access-5qqzl\") pod \"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b\" (UID: \"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b\") "
Jul 17 21:16:29.310112 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.309995    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-webhook-cert\") pod \"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b\" (UID: \"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b\") "
Jul 17 21:16:29.311994 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.311967    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b" (UID: "b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:16:29.311994 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.311981    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-kube-api-access-5qqzl" (OuterVolumeSpecName: "kube-api-access-5qqzl") pod "b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b" (UID: "b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b"). InnerVolumeSpecName "kube-api-access-5qqzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:16:29.410931 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.410900    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qqzl\" (UniqueName: \"kubernetes.io/projected/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-kube-api-access-5qqzl\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:16:29.410931 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.410926    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b-webhook-cert\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:16:29.426888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.426860    2572 generic.go:356] "Generic (PLEG): container finished" podID="b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b" containerID="3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35" exitCode=0
Jul 17 21:16:29.427638 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.427182    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fff89cdb-wncwd" event={"ID":"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b","Type":"ContainerDied","Data":"3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35"}
Jul 17 21:16:29.427638 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.427324    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fff89cdb-wncwd"
Jul 17 21:16:29.427638 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.427354    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fff89cdb-wncwd" event={"ID":"b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b","Type":"ContainerDied","Data":"f9a3acfdb741185945086332bd598c795b4762ef384423302092d66ce84b69d8"}
Jul 17 21:16:29.427638 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.427403    2572 scope.go:117] "RemoveContainer" containerID="3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35"
Jul 17 21:16:29.442076 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.442049    2572 scope.go:117] "RemoveContainer" containerID="3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35"
Jul 17 21:16:29.442419 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:16:29.442402    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35\": container with ID starting with 3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35 not found: ID does not exist" containerID="3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35"
Jul 17 21:16:29.442473 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.442428    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35"} err="failed to get container status \"3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35\": rpc error: code = NotFound desc = could not find container \"3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35\": container with ID starting with 3e802c3f39ea0ceb4a8d0f67c18a424dc12e78fadb7ffae1e8fa1ea139aaee35 not found: ID does not exist"
Jul 17 21:16:29.452874 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.452852    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-wncwd"]
Jul 17 21:16:29.456510 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:29.456489    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-wncwd"]
Jul 17 21:16:31.041326 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:16:31.041293    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b" path="/var/lib/kubelet/pods/b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b/volumes"
Jul 17 21:17:30.244337 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.244230    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76fff89cdb-hhlql"]
Jul 17 21:17:30.244808 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.244745    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7d9ca88-fc6e-427e-b42c-1526f8e154af" containerName="authorino"
Jul 17 21:17:30.244808 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.244760    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7d9ca88-fc6e-427e-b42c-1526f8e154af" containerName="authorino"
Jul 17 21:17:30.244808 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.244770    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b" containerName="manager"
Jul 17 21:17:30.244808 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.244776    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b" containerName="manager"
Jul 17 21:17:30.244944 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.244840    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7d9ca88-fc6e-427e-b42c-1526f8e154af" containerName="authorino"
Jul 17 21:17:30.244944 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.244852    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b24245d5-a7bb-4ba3-b8ab-ab283a5bc18b" containerName="manager"
Jul 17 21:17:30.247823 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.247802    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:30.251043 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.251028    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w7w99\""
Jul 17 21:17:30.251120 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.251031    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 21:17:30.251120 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.251072    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 21:17:30.258944 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.258923    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-hhlql"]
Jul 17 21:17:30.338891 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.338857    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31380f38-ce1a-4249-8e3f-82c9949e30fa-webhook-cert\") pod \"maas-controller-76fff89cdb-hhlql\" (UID: \"31380f38-ce1a-4249-8e3f-82c9949e30fa\") " pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:30.339060 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.338901    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmkcl\" (UniqueName: \"kubernetes.io/projected/31380f38-ce1a-4249-8e3f-82c9949e30fa-kube-api-access-dmkcl\") pod \"maas-controller-76fff89cdb-hhlql\" (UID: \"31380f38-ce1a-4249-8e3f-82c9949e30fa\") " pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:30.439621 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.439587    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31380f38-ce1a-4249-8e3f-82c9949e30fa-webhook-cert\") pod \"maas-controller-76fff89cdb-hhlql\" (UID: \"31380f38-ce1a-4249-8e3f-82c9949e30fa\") " pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:30.439777 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.439636    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmkcl\" (UniqueName: \"kubernetes.io/projected/31380f38-ce1a-4249-8e3f-82c9949e30fa-kube-api-access-dmkcl\") pod \"maas-controller-76fff89cdb-hhlql\" (UID: \"31380f38-ce1a-4249-8e3f-82c9949e30fa\") " pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:30.442110 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.442088    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31380f38-ce1a-4249-8e3f-82c9949e30fa-webhook-cert\") pod \"maas-controller-76fff89cdb-hhlql\" (UID: \"31380f38-ce1a-4249-8e3f-82c9949e30fa\") " pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:30.448038 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.448018    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmkcl\" (UniqueName: \"kubernetes.io/projected/31380f38-ce1a-4249-8e3f-82c9949e30fa-kube-api-access-dmkcl\") pod \"maas-controller-76fff89cdb-hhlql\" (UID: \"31380f38-ce1a-4249-8e3f-82c9949e30fa\") " pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:30.558952 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.558867    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:30.695405 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.695380    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-hhlql"]
Jul 17 21:17:30.697643 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:17:30.697618    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31380f38_ce1a_4249_8e3f_82c9949e30fa.slice/crio-168aa11ba75afda64e22a7fd3d6e58b31edf7b510cfa50170cc5791c28b29590 WatchSource:0}: Error finding container 168aa11ba75afda64e22a7fd3d6e58b31edf7b510cfa50170cc5791c28b29590: Status 404 returned error can't find the container with id 168aa11ba75afda64e22a7fd3d6e58b31edf7b510cfa50170cc5791c28b29590
Jul 17 21:17:30.699037 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.699018    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:17:30.711504 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:30.711472    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fff89cdb-hhlql" event={"ID":"31380f38-ce1a-4249-8e3f-82c9949e30fa","Type":"ContainerStarted","Data":"168aa11ba75afda64e22a7fd3d6e58b31edf7b510cfa50170cc5791c28b29590"}
Jul 17 21:17:31.717372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:31.717336    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fff89cdb-hhlql" event={"ID":"31380f38-ce1a-4249-8e3f-82c9949e30fa","Type":"ContainerStarted","Data":"2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a"}
Jul 17 21:17:31.717788 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:31.717490    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:31.738540 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:31.738493    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76fff89cdb-hhlql" podStartSLOduration=1.277844743 podStartE2EDuration="1.738477588s" totalImagesPullingTime="460.632845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:31.737007098 +0000 UTC m=+819.266915552" watchObservedRunningTime="2026-07-17 21:17:31.738477588 +0000 UTC m=+819.268386059"
Jul 17 21:17:42.724747 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:42.724715    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:47.327587 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.327553    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:17:47.422385 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.422344    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-hhlql"]
Jul 17 21:17:47.422655 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.422595    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76fff89cdb-hhlql" podUID="31380f38-ce1a-4249-8e3f-82c9949e30fa" containerName="manager" containerID="cri-o://2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a" gracePeriod=30
Jul 17 21:17:47.671673 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.671649    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:47.791021 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.790987    2572 generic.go:356] "Generic (PLEG): container finished" podID="31380f38-ce1a-4249-8e3f-82c9949e30fa" containerID="2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a" exitCode=0
Jul 17 21:17:47.791210 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.791036    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fff89cdb-hhlql"
Jul 17 21:17:47.791210 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.791059    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fff89cdb-hhlql" event={"ID":"31380f38-ce1a-4249-8e3f-82c9949e30fa","Type":"ContainerDied","Data":"2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a"}
Jul 17 21:17:47.791210 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.791100    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fff89cdb-hhlql" event={"ID":"31380f38-ce1a-4249-8e3f-82c9949e30fa","Type":"ContainerDied","Data":"168aa11ba75afda64e22a7fd3d6e58b31edf7b510cfa50170cc5791c28b29590"}
Jul 17 21:17:47.791210 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.791122    2572 scope.go:117] "RemoveContainer" containerID="2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a"
Jul 17 21:17:47.798485 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.798460    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmkcl\" (UniqueName: \"kubernetes.io/projected/31380f38-ce1a-4249-8e3f-82c9949e30fa-kube-api-access-dmkcl\") pod \"31380f38-ce1a-4249-8e3f-82c9949e30fa\" (UID: \"31380f38-ce1a-4249-8e3f-82c9949e30fa\") "
Jul 17 21:17:47.798605 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.798570    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31380f38-ce1a-4249-8e3f-82c9949e30fa-webhook-cert\") pod \"31380f38-ce1a-4249-8e3f-82c9949e30fa\" (UID: \"31380f38-ce1a-4249-8e3f-82c9949e30fa\") "
Jul 17 21:17:47.799791 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.799770    2572 scope.go:117] "RemoveContainer" containerID="2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a"
Jul 17 21:17:47.800127 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:17:47.800092    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a\": container with ID starting with 2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a not found: ID does not exist" containerID="2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a"
Jul 17 21:17:47.800231 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.800139    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a"} err="failed to get container status \"2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a\": rpc error: code = NotFound desc = could not find container \"2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a\": container with ID starting with 2f82725939e9abd85a9949ad0f539dadbdb578336f0c93157783eafee86f488a not found: ID does not exist"
Jul 17 21:17:47.800630 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.800600    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31380f38-ce1a-4249-8e3f-82c9949e30fa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "31380f38-ce1a-4249-8e3f-82c9949e30fa" (UID: "31380f38-ce1a-4249-8e3f-82c9949e30fa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:17:47.800717 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.800687    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31380f38-ce1a-4249-8e3f-82c9949e30fa-kube-api-access-dmkcl" (OuterVolumeSpecName: "kube-api-access-dmkcl") pod "31380f38-ce1a-4249-8e3f-82c9949e30fa" (UID: "31380f38-ce1a-4249-8e3f-82c9949e30fa"). InnerVolumeSpecName "kube-api-access-dmkcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:17:47.904746 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.899946    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmkcl\" (UniqueName: \"kubernetes.io/projected/31380f38-ce1a-4249-8e3f-82c9949e30fa-kube-api-access-dmkcl\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:17:47.904746 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:47.899983    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/31380f38-ce1a-4249-8e3f-82c9949e30fa-webhook-cert\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:17:48.113211 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.113177    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-hhlql"]
Jul 17 21:17:48.117070 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.117042    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-hhlql"]
Jul 17 21:17:48.814486 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.814455    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:17:48.924878 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.924842    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76fff89cdb-jp2hh"]
Jul 17 21:17:48.925322 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.925307    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31380f38-ce1a-4249-8e3f-82c9949e30fa" containerName="manager"
Jul 17 21:17:48.925369 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.925324    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="31380f38-ce1a-4249-8e3f-82c9949e30fa" containerName="manager"
Jul 17 21:17:48.925408 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.925381    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="31380f38-ce1a-4249-8e3f-82c9949e30fa" containerName="manager"
Jul 17 21:17:48.929528 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.929506    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fff89cdb-jp2hh"
Jul 17 21:17:48.931999 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.931978    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 21:17:48.932831 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.932810    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w7w99\""
Jul 17 21:17:48.932946 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.932815    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 21:17:48.939143 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:48.939121    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-jp2hh"]
Jul 17 21:17:49.040887 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:49.040858    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31380f38-ce1a-4249-8e3f-82c9949e30fa" path="/var/lib/kubelet/pods/31380f38-ce1a-4249-8e3f-82c9949e30fa/volumes"
Jul 17 21:17:49.110473 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:49.110394    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z429\" (UniqueName: \"kubernetes.io/projected/b763b34b-ddcd-44ec-96b9-3ddd38339327-kube-api-access-7z429\") pod \"maas-controller-76fff89cdb-jp2hh\" (UID: \"b763b34b-ddcd-44ec-96b9-3ddd38339327\") " pod="opendatahub/maas-controller-76fff89cdb-jp2hh"
Jul 17 21:17:49.110473 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:49.110450    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b763b34b-ddcd-44ec-96b9-3ddd38339327-webhook-cert\") pod \"maas-controller-76fff89cdb-jp2hh\" (UID: \"b763b34b-ddcd-44ec-96b9-3ddd38339327\") " pod="opendatahub/maas-controller-76fff89cdb-jp2hh"
Jul 17 21:17:49.210849 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:49.210815    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z429\" (UniqueName: \"kubernetes.io/projected/b763b34b-ddcd-44ec-96b9-3ddd38339327-kube-api-access-7z429\") pod \"maas-controller-76fff89cdb-jp2hh\" (UID: \"b763b34b-ddcd-44ec-96b9-3ddd38339327\") " pod="opendatahub/maas-controller-76fff89cdb-jp2hh"
Jul 17 21:17:49.211046 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:49.210873    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b763b34b-ddcd-44ec-96b9-3ddd38339327-webhook-cert\") pod \"maas-controller-76fff89cdb-jp2hh\" (UID: \"b763b34b-ddcd-44ec-96b9-3ddd38339327\") " pod="opendatahub/maas-controller-76fff89cdb-jp2hh"
Jul 17 21:17:49.213236 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:49.213209    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b763b34b-ddcd-44ec-96b9-3ddd38339327-webhook-cert\") pod \"maas-controller-76fff89cdb-jp2hh\" (UID: \"b763b34b-ddcd-44ec-96b9-3ddd38339327\") " pod="opendatahub/maas-controller-76fff89cdb-jp2hh"
Jul 17 21:17:49.220106 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:49.220083    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z429\" (UniqueName: \"kubernetes.io/projected/b763b34b-ddcd-44ec-96b9-3ddd38339327-kube-api-access-7z429\") pod \"maas-controller-76fff89cdb-jp2hh\" (UID: \"b763b34b-ddcd-44ec-96b9-3ddd38339327\") " pod="opendatahub/maas-controller-76fff89cdb-jp2hh"
Jul 17 21:17:49.241980 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:49.241960    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fff89cdb-jp2hh"
Jul 17 21:17:49.379195 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:49.379121    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fff89cdb-jp2hh"]
Jul 17 21:17:49.382213 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:17:49.382187    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb763b34b_ddcd_44ec_96b9_3ddd38339327.slice/crio-f5bf42137aa1b6baad57519eb701005661368fe8d5aa48f5cd689eb22ab7021a WatchSource:0}: Error finding container f5bf42137aa1b6baad57519eb701005661368fe8d5aa48f5cd689eb22ab7021a: Status 404 returned error can't find the container with id f5bf42137aa1b6baad57519eb701005661368fe8d5aa48f5cd689eb22ab7021a
Jul 17 21:17:49.803189 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:49.803156    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fff89cdb-jp2hh" event={"ID":"b763b34b-ddcd-44ec-96b9-3ddd38339327","Type":"ContainerStarted","Data":"f5bf42137aa1b6baad57519eb701005661368fe8d5aa48f5cd689eb22ab7021a"}
Jul 17 21:17:50.809314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:50.809268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fff89cdb-jp2hh" event={"ID":"b763b34b-ddcd-44ec-96b9-3ddd38339327","Type":"ContainerStarted","Data":"29377dbdd1bce854c722c1dc4471f45cd074bfa14b43ea5d601ae6cced2094e9"}
Jul 17 21:17:50.809721 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:50.809390    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76fff89cdb-jp2hh"
Jul 17 21:17:50.830652 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:17:50.830596    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76fff89cdb-jp2hh" podStartSLOduration=2.441372347 podStartE2EDuration="2.830575031s" totalImagesPullingTime="389.202684ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:17:50.829726593 +0000 UTC m=+838.359635070" watchObservedRunningTime="2026-07-17 21:17:50.830575031 +0000 UTC m=+838.360483484"
Jul 17 21:18:01.815860 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:01.815830    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76fff89cdb-jp2hh"
Jul 17 21:18:28.125246 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:28.125183    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:18:28.214849 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:28.214817    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:18:28.370922 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:28.370891    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:18:34.346090 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:34.346050    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:18:34.407766 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:34.407731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:18:34.503711 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:34.503674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:18:34.602065 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:34.601979    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:18:34.715239 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:34.715204    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:18:41.292429 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:41.292390    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:18:41.401330 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:41.401295    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:18:45.227077 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:18:45.226987    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:19:52.608719 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:19:52.608675    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:20:36.348814 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:20:36.348735    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:20:36.448846 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:20:36.448813    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:22:43.284432 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:43.284399    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"]
Jul 17 21:22:43.285043 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:43.284613    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb" podUID="e7e66b61-f187-4457-aea3-3a8b18c66ee6" containerName="manager" containerID="cri-o://b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d" gracePeriod=10
Jul 17 21:22:45.542404 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:45.542382    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:22:45.722391 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:45.722352    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvtfd\" (UniqueName: \"kubernetes.io/projected/e7e66b61-f187-4457-aea3-3a8b18c66ee6-kube-api-access-gvtfd\") pod \"e7e66b61-f187-4457-aea3-3a8b18c66ee6\" (UID: \"e7e66b61-f187-4457-aea3-3a8b18c66ee6\") "
Jul 17 21:22:45.722609 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:45.722482    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7e66b61-f187-4457-aea3-3a8b18c66ee6-extensions-socket-volume\") pod \"e7e66b61-f187-4457-aea3-3a8b18c66ee6\" (UID: \"e7e66b61-f187-4457-aea3-3a8b18c66ee6\") "
Jul 17 21:22:45.722864 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:45.722839    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7e66b61-f187-4457-aea3-3a8b18c66ee6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e7e66b61-f187-4457-aea3-3a8b18c66ee6" (UID: "e7e66b61-f187-4457-aea3-3a8b18c66ee6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:22:45.724534 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:45.724505    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e66b61-f187-4457-aea3-3a8b18c66ee6-kube-api-access-gvtfd" (OuterVolumeSpecName: "kube-api-access-gvtfd") pod "e7e66b61-f187-4457-aea3-3a8b18c66ee6" (UID: "e7e66b61-f187-4457-aea3-3a8b18c66ee6"). InnerVolumeSpecName "kube-api-access-gvtfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:22:45.824017 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:45.823987    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7e66b61-f187-4457-aea3-3a8b18c66ee6-extensions-socket-volume\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:22:45.824017 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:45.824015    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvtfd\" (UniqueName: \"kubernetes.io/projected/e7e66b61-f187-4457-aea3-3a8b18c66ee6-kube-api-access-gvtfd\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:22:46.189091 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:46.189058    2572 generic.go:356] "Generic (PLEG): container finished" podID="e7e66b61-f187-4457-aea3-3a8b18c66ee6" containerID="b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d" exitCode=0
Jul 17 21:22:46.189258 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:46.189105    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"
Jul 17 21:22:46.189258 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:46.189134    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb" event={"ID":"e7e66b61-f187-4457-aea3-3a8b18c66ee6","Type":"ContainerDied","Data":"b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d"}
Jul 17 21:22:46.189258 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:46.189191    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb" event={"ID":"e7e66b61-f187-4457-aea3-3a8b18c66ee6","Type":"ContainerDied","Data":"524d7b73da18019bbce9ef710071e5519c76b0e6d19584c2340d1ce80bf3e94a"}
Jul 17 21:22:46.189258 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:46.189215    2572 scope.go:117] "RemoveContainer" containerID="b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d"
Jul 17 21:22:46.199462 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:46.199439    2572 scope.go:117] "RemoveContainer" containerID="b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d"
Jul 17 21:22:46.199697 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:22:46.199673    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d\": container with ID starting with b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d not found: ID does not exist" containerID="b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d"
Jul 17 21:22:46.199782 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:46.199707    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d"} err="failed to get container status \"b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d\": rpc error: code = NotFound desc = could not find container \"b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d\": container with ID starting with b9130e31ecca7ad674d4136714cf086039954ce411cd8430a2bf3a8bc201906d not found: ID does not exist"
Jul 17 21:22:46.210506 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:46.210483    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"]
Jul 17 21:22:46.213927 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:46.213905    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-trmrb"]
Jul 17 21:22:47.040805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:22:47.040776    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e66b61-f187-4457-aea3-3a8b18c66ee6" path="/var/lib/kubelet/pods/e7e66b61-f187-4457-aea3-3a8b18c66ee6/volumes"
Jul 17 21:23:20.174882 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:20.174781    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:23:21.489165 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:21.489124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:23:44.535441 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.535406    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"]
Jul 17 21:23:44.535895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.535783    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e66b61-f187-4457-aea3-3a8b18c66ee6" containerName="manager"
Jul 17 21:23:44.535895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.535794    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e66b61-f187-4457-aea3-3a8b18c66ee6" containerName="manager"
Jul 17 21:23:44.535895 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.535861    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e66b61-f187-4457-aea3-3a8b18c66ee6" containerName="manager"
Jul 17 21:23:44.538985 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.538966    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"
Jul 17 21:23:44.541360 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.541342    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wc476\""
Jul 17 21:23:44.550649 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.550627    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"]
Jul 17 21:23:44.631254 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.631221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5khpd\" (UniqueName: \"kubernetes.io/projected/124f99b5-53da-4dce-8c3e-7766e3c87e12-kube-api-access-5khpd\") pod \"kuadrant-operator-controller-manager-86878c769f-ns7q4\" (UID: \"124f99b5-53da-4dce-8c3e-7766e3c87e12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"
Jul 17 21:23:44.631467 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.631267    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/124f99b5-53da-4dce-8c3e-7766e3c87e12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ns7q4\" (UID: \"124f99b5-53da-4dce-8c3e-7766e3c87e12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"
Jul 17 21:23:44.732233 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.732195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5khpd\" (UniqueName: \"kubernetes.io/projected/124f99b5-53da-4dce-8c3e-7766e3c87e12-kube-api-access-5khpd\") pod \"kuadrant-operator-controller-manager-86878c769f-ns7q4\" (UID: \"124f99b5-53da-4dce-8c3e-7766e3c87e12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"
Jul 17 21:23:44.732233 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.732238    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/124f99b5-53da-4dce-8c3e-7766e3c87e12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ns7q4\" (UID: \"124f99b5-53da-4dce-8c3e-7766e3c87e12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"
Jul 17 21:23:44.732611 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.732595    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/124f99b5-53da-4dce-8c3e-7766e3c87e12-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ns7q4\" (UID: \"124f99b5-53da-4dce-8c3e-7766e3c87e12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"
Jul 17 21:23:44.744670 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.744637    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5khpd\" (UniqueName: \"kubernetes.io/projected/124f99b5-53da-4dce-8c3e-7766e3c87e12-kube-api-access-5khpd\") pod \"kuadrant-operator-controller-manager-86878c769f-ns7q4\" (UID: \"124f99b5-53da-4dce-8c3e-7766e3c87e12\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"
Jul 17 21:23:44.849316 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.849219    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"
Jul 17 21:23:44.993262 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:44.993237    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"]
Jul 17 21:23:44.996506 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:23:44.996473    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124f99b5_53da_4dce_8c3e_7766e3c87e12.slice/crio-3d0cf52f56ae23b2962aa13dc66c96c75d1757fadf024881f40bcd35131a7ad4 WatchSource:0}: Error finding container 3d0cf52f56ae23b2962aa13dc66c96c75d1757fadf024881f40bcd35131a7ad4: Status 404 returned error can't find the container with id 3d0cf52f56ae23b2962aa13dc66c96c75d1757fadf024881f40bcd35131a7ad4
Jul 17 21:23:45.471520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:45.471483    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4" event={"ID":"124f99b5-53da-4dce-8c3e-7766e3c87e12","Type":"ContainerStarted","Data":"976ed8cce8ae69b4438c3ff91cf5b31e791fbd977104ed3d45e22856ba084859"}
Jul 17 21:23:45.471706 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:45.471572    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4" event={"ID":"124f99b5-53da-4dce-8c3e-7766e3c87e12","Type":"ContainerStarted","Data":"3d0cf52f56ae23b2962aa13dc66c96c75d1757fadf024881f40bcd35131a7ad4"}
Jul 17 21:23:45.471706 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:45.471599    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"
Jul 17 21:23:45.494121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:45.494069    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4" podStartSLOduration=1.49405545 podStartE2EDuration="1.49405545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:23:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:23:45.492701077 +0000 UTC m=+1193.022609529" watchObservedRunningTime="2026-07-17 21:23:45.49405545 +0000 UTC m=+1193.023963901"
Jul 17 21:23:56.478187 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:56.478157    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ns7q4"
Jul 17 21:23:58.526640 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:23:58.526566    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:28:19.201026 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:28:19.200932    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:28:19.291201 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:28:19.291169    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:29:04.428049 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:29:04.428014    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:29:33.305916 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:29:33.305834    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:29:38.660000 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:29:38.659965    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:29:46.910905 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:29:46.910864    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:29:52.056834 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:29:52.056804    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:29:54.942572 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:29:54.942536    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:29:55.043969 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:29:55.043938    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:29:55.398482 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:29:55.398396    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:01.377146 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:01.377115    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:01.527772 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:01.527733    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:01.711719 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:01.711691    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:01.873303 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:01.873243    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:02.147405 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:02.147327    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:04.577464 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.577430    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:04.645861 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.645806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:04.646706 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.646680    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"]
Jul 17 21:30:04.650182 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.650162    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:04.652317 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.652298    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-98ea8db6-serving-cert\""
Jul 17 21:30:04.662088 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.662065    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"]
Jul 17 21:30:04.706425 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.706398    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:04.785084 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.785044    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d6c3df7-2d04-421a-84f0-6aa212334d3c-maas-api-tls\") pod \"maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:04.785240 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.785155    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6c3df7-2d04-421a-84f0-6aa212334d3c-openshift-service-ca\") pod \"maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:04.785310 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.785252    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz6c5\" (UniqueName: \"kubernetes.io/projected/1d6c3df7-2d04-421a-84f0-6aa212334d3c-kube-api-access-pz6c5\") pod \"maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:04.886678 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.886602    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz6c5\" (UniqueName: \"kubernetes.io/projected/1d6c3df7-2d04-421a-84f0-6aa212334d3c-kube-api-access-pz6c5\") pod \"maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:04.886678 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.886642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d6c3df7-2d04-421a-84f0-6aa212334d3c-maas-api-tls\") pod \"maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:04.886863 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.886696    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6c3df7-2d04-421a-84f0-6aa212334d3c-openshift-service-ca\") pod \"maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:04.886863 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:30:04.886837    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-serving-cert: secret "maas-api-e2e-ait-98ea8db6-serving-cert" not found
Jul 17 21:30:04.886937 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:30:04.886915    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6c3df7-2d04-421a-84f0-6aa212334d3c-maas-api-tls podName:1d6c3df7-2d04-421a-84f0-6aa212334d3c nodeName:}" failed. No retries permitted until 2026-07-17 21:30:05.386892943 +0000 UTC m=+1572.916801385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1d6c3df7-2d04-421a-84f0-6aa212334d3c-maas-api-tls") pod "maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9" (UID: "1d6c3df7-2d04-421a-84f0-6aa212334d3c") : secret "maas-api-e2e-ait-98ea8db6-serving-cert" not found
Jul 17 21:30:04.887257 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.887240    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6c3df7-2d04-421a-84f0-6aa212334d3c-openshift-service-ca\") pod \"maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:04.895741 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.895722    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz6c5\" (UniqueName: \"kubernetes.io/projected/1d6c3df7-2d04-421a-84f0-6aa212334d3c-kube-api-access-pz6c5\") pod \"maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:04.948738 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:04.948706    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:05.157586 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:05.157487    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:05.257822 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:05.257781    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:05.391029 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:05.390994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d6c3df7-2d04-421a-84f0-6aa212334d3c-maas-api-tls\") pod \"maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:05.393387 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:05.393366    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d6c3df7-2d04-421a-84f0-6aa212334d3c-maas-api-tls\") pod \"maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:05.562022 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:05.561983    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:05.908409 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:05.908374    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"]
Jul 17 21:30:05.909694 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:30:05.909661    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6c3df7_2d04_421a_84f0_6aa212334d3c.slice/crio-a03eb5aa58240495abb1c13c1c02da8794bcf2663a60726d35372c917b61f636 WatchSource:0}: Error finding container a03eb5aa58240495abb1c13c1c02da8794bcf2663a60726d35372c917b61f636: Status 404 returned error can't find the container with id a03eb5aa58240495abb1c13c1c02da8794bcf2663a60726d35372c917b61f636
Jul 17 21:30:05.911071 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:05.911049    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:30:06.233382 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:06.233345    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9" event={"ID":"1d6c3df7-2d04-421a-84f0-6aa212334d3c","Type":"ContainerStarted","Data":"a03eb5aa58240495abb1c13c1c02da8794bcf2663a60726d35372c917b61f636"}
Jul 17 21:30:07.239736 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:07.239699    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9" event={"ID":"1d6c3df7-2d04-421a-84f0-6aa212334d3c","Type":"ContainerStarted","Data":"ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67"}
Jul 17 21:30:07.240127 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:07.239799    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:07.258718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:07.258674    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9" podStartSLOduration=2.683959981 podStartE2EDuration="3.258658262s" totalImagesPullingTime="574.698281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:30:07.255828291 +0000 UTC m=+1574.785736744" watchObservedRunningTime="2026-07-17 21:30:07.258658262 +0000 UTC m=+1574.788566752"
Jul 17 21:30:13.249357 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:13.249332    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:30.134392 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:30.134355    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"]
Jul 17 21:30:30.138297 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:30.138258    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"
Jul 17 21:30:30.140707 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:30.140685    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:30:30.144387 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:30.144360    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"]
Jul 17 21:30:30.208230 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:30.208198    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc203eb-ddcd-4ec9-9edb-c76a2719bf21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng\" (UID: \"dbc203eb-ddcd-4ec9-9edb-c76a2719bf21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"
Jul 17 21:30:30.309097 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:30.309063    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc203eb-ddcd-4ec9-9edb-c76a2719bf21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng\" (UID: \"dbc203eb-ddcd-4ec9-9edb-c76a2719bf21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"
Jul 17 21:30:30.309709 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:30.309689    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc203eb-ddcd-4ec9-9edb-c76a2719bf21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng\" (UID: \"dbc203eb-ddcd-4ec9-9edb-c76a2719bf21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"
Jul 17 21:30:30.451833 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:30.451801    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"
Jul 17 21:30:30.589415 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:30.589392    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"]
Jul 17 21:30:30.591899 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:30:30.591869    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc203eb_ddcd_4ec9_9edb_c76a2719bf21.slice/crio-ced42d52c6061d05e8443fd452e59bef350e2f8599b77768950a718667dbf6f5 WatchSource:0}: Error finding container ced42d52c6061d05e8443fd452e59bef350e2f8599b77768950a718667dbf6f5: Status 404 returned error can't find the container with id ced42d52c6061d05e8443fd452e59bef350e2f8599b77768950a718667dbf6f5
Jul 17 21:30:31.352338 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:31.352304    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng" event={"ID":"dbc203eb-ddcd-4ec9-9edb-c76a2719bf21","Type":"ContainerStarted","Data":"ced42d52c6061d05e8443fd452e59bef350e2f8599b77768950a718667dbf6f5"}
Jul 17 21:30:33.362882 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:33.362849    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng" event={"ID":"dbc203eb-ddcd-4ec9-9edb-c76a2719bf21","Type":"ContainerStarted","Data":"3e8f8b6922e3783aca51ace9118d7fb63439d8b2ee69b378bafc176d05f6f74e"}
Jul 17 21:30:33.380323 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:33.380256    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng" podStartSLOduration=0.969958709 podStartE2EDuration="3.380237704s" totalImagesPullingTime="2.410278995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:30:33.378418196 +0000 UTC m=+1600.908326666" watchObservedRunningTime="2026-07-17 21:30:33.380237704 +0000 UTC m=+1600.910146156"
Jul 17 21:30:34.368880 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:34.368847    2572 generic.go:356] "Generic (PLEG): container finished" podID="dbc203eb-ddcd-4ec9-9edb-c76a2719bf21" containerID="3e8f8b6922e3783aca51ace9118d7fb63439d8b2ee69b378bafc176d05f6f74e" exitCode=0
Jul 17 21:30:34.369260 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:34.368933    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng" event={"ID":"dbc203eb-ddcd-4ec9-9edb-c76a2719bf21","Type":"ContainerDied","Data":"3e8f8b6922e3783aca51ace9118d7fb63439d8b2ee69b378bafc176d05f6f74e"}
Jul 17 21:30:35.509099 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:35.509072    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"
Jul 17 21:30:35.659426 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:35.659308    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc203eb-ddcd-4ec9-9edb-c76a2719bf21-maas-api-service-ca\") pod \"dbc203eb-ddcd-4ec9-9edb-c76a2719bf21\" (UID: \"dbc203eb-ddcd-4ec9-9edb-c76a2719bf21\") "
Jul 17 21:30:35.659673 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:35.659649    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbc203eb-ddcd-4ec9-9edb-c76a2719bf21-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dbc203eb-ddcd-4ec9-9edb-c76a2719bf21" (UID: "dbc203eb-ddcd-4ec9-9edb-c76a2719bf21"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:30:35.760466 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:35.760430    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbc203eb-ddcd-4ec9-9edb-c76a2719bf21-maas-api-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:30:36.378780 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:36.378755    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"
Jul 17 21:30:36.378780 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:36.378768    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng" event={"ID":"dbc203eb-ddcd-4ec9-9edb-c76a2719bf21","Type":"ContainerDied","Data":"ced42d52c6061d05e8443fd452e59bef350e2f8599b77768950a718667dbf6f5"}
Jul 17 21:30:36.378996 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:36.378812    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ced42d52c6061d05e8443fd452e59bef350e2f8599b77768950a718667dbf6f5"
Jul 17 21:30:40.766702 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:40.766668    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"]
Jul 17 21:30:40.767171 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:40.766916    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9" podUID="1d6c3df7-2d04-421a-84f0-6aa212334d3c" containerName="maas-api" containerID="cri-o://ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67" gracePeriod=30
Jul 17 21:30:40.786664 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:40.786637    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:41.032032 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.031969    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:41.108142 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.106951    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz6c5\" (UniqueName: \"kubernetes.io/projected/1d6c3df7-2d04-421a-84f0-6aa212334d3c-kube-api-access-pz6c5\") pod \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") "
Jul 17 21:30:41.108142 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.107041    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d6c3df7-2d04-421a-84f0-6aa212334d3c-maas-api-tls\") pod \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") "
Jul 17 21:30:41.108142 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.107118    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6c3df7-2d04-421a-84f0-6aa212334d3c-openshift-service-ca\") pod \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\" (UID: \"1d6c3df7-2d04-421a-84f0-6aa212334d3c\") "
Jul 17 21:30:41.110423 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.108571    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d6c3df7-2d04-421a-84f0-6aa212334d3c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1d6c3df7-2d04-421a-84f0-6aa212334d3c" (UID: "1d6c3df7-2d04-421a-84f0-6aa212334d3c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:30:41.114393 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.114339    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d6c3df7-2d04-421a-84f0-6aa212334d3c-kube-api-access-pz6c5" (OuterVolumeSpecName: "kube-api-access-pz6c5") pod "1d6c3df7-2d04-421a-84f0-6aa212334d3c" (UID: "1d6c3df7-2d04-421a-84f0-6aa212334d3c"). InnerVolumeSpecName "kube-api-access-pz6c5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:30:41.115751 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.115729    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d6c3df7-2d04-421a-84f0-6aa212334d3c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1d6c3df7-2d04-421a-84f0-6aa212334d3c" (UID: "1d6c3df7-2d04-421a-84f0-6aa212334d3c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:30:41.208333 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.208298    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d6c3df7-2d04-421a-84f0-6aa212334d3c-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:30:41.208333 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.208331    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d6c3df7-2d04-421a-84f0-6aa212334d3c-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:30:41.208569 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.208347    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz6c5\" (UniqueName: \"kubernetes.io/projected/1d6c3df7-2d04-421a-84f0-6aa212334d3c-kube-api-access-pz6c5\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:30:41.402786 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.402688    2572 generic.go:356] "Generic (PLEG): container finished" podID="1d6c3df7-2d04-421a-84f0-6aa212334d3c" containerID="ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67" exitCode=0
Jul 17 21:30:41.402786 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.402754    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"
Jul 17 21:30:41.402786 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.402772    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9" event={"ID":"1d6c3df7-2d04-421a-84f0-6aa212334d3c","Type":"ContainerDied","Data":"ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67"}
Jul 17 21:30:41.403027 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.402859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9" event={"ID":"1d6c3df7-2d04-421a-84f0-6aa212334d3c","Type":"ContainerDied","Data":"a03eb5aa58240495abb1c13c1c02da8794bcf2663a60726d35372c917b61f636"}
Jul 17 21:30:41.403027 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.402889    2572 scope.go:117] "RemoveContainer" containerID="ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67"
Jul 17 21:30:41.411892 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.411871    2572 scope.go:117] "RemoveContainer" containerID="ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67"
Jul 17 21:30:41.412144 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:30:41.412122    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67\": container with ID starting with ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67 not found: ID does not exist" containerID="ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67"
Jul 17 21:30:41.412213 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.412156    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67"} err="failed to get container status \"ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67\": rpc error: code = NotFound desc = could not find container \"ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67\": container with ID starting with ef19422251805ccd9d38b45265f028158988c2920ce407c76bd700a91390da67 not found: ID does not exist"
Jul 17 21:30:41.425244 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.425216    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"]
Jul 17 21:30:41.428724 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:41.428697    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-98ea8db6-788fb9b646-tqjh9"]
Jul 17 21:30:43.041416 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:43.041385    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d6c3df7-2d04-421a-84f0-6aa212334d3c" path="/var/lib/kubelet/pods/1d6c3df7-2d04-421a-84f0-6aa212334d3c/volumes"
Jul 17 21:30:45.208295 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:45.208195    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"]
Jul 17 21:30:45.209736 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:45.209704    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-98ea8db6-2k4ng"]
Jul 17 21:30:45.210207 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:45.210189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:45.372263 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:45.372231    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:45.586135 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:45.586016    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:45.829522 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:45.829488    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:45.931228 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:45.931173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:46.040017 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:46.039969    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:46.433040 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:46.433008    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:46.748360 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:46.748246    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:47.040809 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:47.040735    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbc203eb-ddcd-4ec9-9edb-c76a2719bf21" path="/var/lib/kubelet/pods/dbc203eb-ddcd-4ec9-9edb-c76a2719bf21/volumes"
Jul 17 21:30:48.971765 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:48.971709    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:49.049746 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.049714    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"]
Jul 17 21:30:49.050334 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.050263    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d6c3df7-2d04-421a-84f0-6aa212334d3c" containerName="maas-api"
Jul 17 21:30:49.050334 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.050305    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d6c3df7-2d04-421a-84f0-6aa212334d3c" containerName="maas-api"
Jul 17 21:30:49.050334 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.050322    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc203eb-ddcd-4ec9-9edb-c76a2719bf21" containerName="revoke-keys"
Jul 17 21:30:49.050334 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.050332    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc203eb-ddcd-4ec9-9edb-c76a2719bf21" containerName="revoke-keys"
Jul 17 21:30:49.050571 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.050463    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d6c3df7-2d04-421a-84f0-6aa212334d3c" containerName="maas-api"
Jul 17 21:30:49.050571 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.050476    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc203eb-ddcd-4ec9-9edb-c76a2719bf21" containerName="revoke-keys"
Jul 17 21:30:49.054991 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.054969    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.057350 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.057330    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-8795fd2a-serving-cert\""
Jul 17 21:30:49.064180 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.064155    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"]
Jul 17 21:30:49.077404 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.077380    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:49.147358 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.147326    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:49.179587 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.179554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b5845e-0d81-4bb1-a481-249c8d23ac6c-openshift-service-ca\") pod \"maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.179737 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.179603    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b5845e-0d81-4bb1-a481-249c8d23ac6c-maas-api-tls\") pod \"maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.179737 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.179628    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkm87\" (UniqueName: \"kubernetes.io/projected/88b5845e-0d81-4bb1-a481-249c8d23ac6c-kube-api-access-vkm87\") pod \"maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.280787 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.280698    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b5845e-0d81-4bb1-a481-249c8d23ac6c-openshift-service-ca\") pod \"maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.280787 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.280751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b5845e-0d81-4bb1-a481-249c8d23ac6c-maas-api-tls\") pod \"maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.281027 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.280869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkm87\" (UniqueName: \"kubernetes.io/projected/88b5845e-0d81-4bb1-a481-249c8d23ac6c-kube-api-access-vkm87\") pod \"maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.281452 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.281429    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b5845e-0d81-4bb1-a481-249c8d23ac6c-openshift-service-ca\") pod \"maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.283248 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.283226    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b5845e-0d81-4bb1-a481-249c8d23ac6c-maas-api-tls\") pod \"maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.288623 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.288604    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkm87\" (UniqueName: \"kubernetes.io/projected/88b5845e-0d81-4bb1-a481-249c8d23ac6c-kube-api-access-vkm87\") pod \"maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.368785 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.368755    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:49.509230 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.509208    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"]
Jul 17 21:30:49.511186 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:30:49.511161    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b5845e_0d81_4bb1_a481_249c8d23ac6c.slice/crio-0baf65a8b880f9d9f493422ebfee3ebd3591f18741941afbe8264acaf8160cd0 WatchSource:0}: Error finding container 0baf65a8b880f9d9f493422ebfee3ebd3591f18741941afbe8264acaf8160cd0: Status 404 returned error can't find the container with id 0baf65a8b880f9d9f493422ebfee3ebd3591f18741941afbe8264acaf8160cd0
Jul 17 21:30:49.586629 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.586524    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:49.690527 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:49.690500    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:30:50.451505 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:50.451471    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg" event={"ID":"88b5845e-0d81-4bb1-a481-249c8d23ac6c","Type":"ContainerStarted","Data":"e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235"}
Jul 17 21:30:50.451890 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:50.451530    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg" event={"ID":"88b5845e-0d81-4bb1-a481-249c8d23ac6c","Type":"ContainerStarted","Data":"0baf65a8b880f9d9f493422ebfee3ebd3591f18741941afbe8264acaf8160cd0"}
Jul 17 21:30:50.451890 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:50.451570    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:30:50.473124 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:50.473056    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg" podStartSLOduration=1.130613987 podStartE2EDuration="1.47303985s" totalImagesPullingTime="342.425863ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:30:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:30:50.471667578 +0000 UTC m=+1618.001576052" watchObservedRunningTime="2026-07-17 21:30:50.47303985 +0000 UTC m=+1618.002948302"
Jul 17 21:30:56.462483 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:30:56.462455    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:31:13.959371 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:13.959337    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"]
Jul 17 21:31:13.966456 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:13.966438    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"
Jul 17 21:31:13.969060 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:13.969033    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:31:13.970361 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:13.970327    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"]
Jul 17 21:31:14.092362 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:14.092325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w\" (UID: \"ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"
Jul 17 21:31:14.193713 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:14.193678    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w\" (UID: \"ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"
Jul 17 21:31:14.194316 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:14.194299    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w\" (UID: \"ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"
Jul 17 21:31:14.279521 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:14.279447    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"
Jul 17 21:31:14.415384 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:14.415332    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"]
Jul 17 21:31:14.417656 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:31:14.417628    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0eb3c0_b3f3_49c0_af75_e7e9ae4ce995.slice/crio-4c3f102919746de5b14e0f6c61b0ff3a294e6ccc3be230906dc4d5642032ed67 WatchSource:0}: Error finding container 4c3f102919746de5b14e0f6c61b0ff3a294e6ccc3be230906dc4d5642032ed67: Status 404 returned error can't find the container with id 4c3f102919746de5b14e0f6c61b0ff3a294e6ccc3be230906dc4d5642032ed67
Jul 17 21:31:14.569399 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:14.569366    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w" event={"ID":"ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995","Type":"ContainerStarted","Data":"4c3f102919746de5b14e0f6c61b0ff3a294e6ccc3be230906dc4d5642032ed67"}
Jul 17 21:31:15.575367 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:15.575336    2572 generic.go:356] "Generic (PLEG): container finished" podID="ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995" containerID="4928f6c1f4154adebb2be60f427152b240acfee71953ec4b3718b6918ee890eb" exitCode=0
Jul 17 21:31:15.575367 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:15.575372    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w" event={"ID":"ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995","Type":"ContainerDied","Data":"4928f6c1f4154adebb2be60f427152b240acfee71953ec4b3718b6918ee890eb"}
Jul 17 21:31:16.720171 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:16.720146    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"
Jul 17 21:31:16.815552 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:16.815516    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995-maas-api-service-ca\") pod \"ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995\" (UID: \"ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995\") "
Jul 17 21:31:16.815859 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:16.815835    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995" (UID: "ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:31:16.916879 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:16.916853    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995-maas-api-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:31:17.585261 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:17.585228    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"
Jul 17 21:31:17.585261 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:17.585253    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w" event={"ID":"ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995","Type":"ContainerDied","Data":"4c3f102919746de5b14e0f6c61b0ff3a294e6ccc3be230906dc4d5642032ed67"}
Jul 17 21:31:17.585527 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:17.585317    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c3f102919746de5b14e0f6c61b0ff3a294e6ccc3be230906dc4d5642032ed67"
Jul 17 21:31:24.512493 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.512456    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"]
Jul 17 21:31:24.513345 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.513265    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg" podUID="88b5845e-0d81-4bb1-a481-249c8d23ac6c" containerName="maas-api" containerID="cri-o://e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235" gracePeriod=30
Jul 17 21:31:24.540129 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.540098    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:24.758105 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.758081    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:31:24.884475 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.884384    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b5845e-0d81-4bb1-a481-249c8d23ac6c-openshift-service-ca\") pod \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") "
Jul 17 21:31:24.884475 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.884424    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b5845e-0d81-4bb1-a481-249c8d23ac6c-maas-api-tls\") pod \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") "
Jul 17 21:31:24.884704 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.884505    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkm87\" (UniqueName: \"kubernetes.io/projected/88b5845e-0d81-4bb1-a481-249c8d23ac6c-kube-api-access-vkm87\") pod \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\" (UID: \"88b5845e-0d81-4bb1-a481-249c8d23ac6c\") "
Jul 17 21:31:24.884757 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.884724    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88b5845e-0d81-4bb1-a481-249c8d23ac6c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88b5845e-0d81-4bb1-a481-249c8d23ac6c" (UID: "88b5845e-0d81-4bb1-a481-249c8d23ac6c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:31:24.884812 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.884787    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88b5845e-0d81-4bb1-a481-249c8d23ac6c-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:31:24.886609 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.886582    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88b5845e-0d81-4bb1-a481-249c8d23ac6c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88b5845e-0d81-4bb1-a481-249c8d23ac6c" (UID: "88b5845e-0d81-4bb1-a481-249c8d23ac6c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:31:24.886725 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.886689    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b5845e-0d81-4bb1-a481-249c8d23ac6c-kube-api-access-vkm87" (OuterVolumeSpecName: "kube-api-access-vkm87") pod "88b5845e-0d81-4bb1-a481-249c8d23ac6c" (UID: "88b5845e-0d81-4bb1-a481-249c8d23ac6c"). InnerVolumeSpecName "kube-api-access-vkm87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:31:24.986075 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.986040    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkm87\" (UniqueName: \"kubernetes.io/projected/88b5845e-0d81-4bb1-a481-249c8d23ac6c-kube-api-access-vkm87\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:31:24.986075 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:24.986069    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88b5845e-0d81-4bb1-a481-249c8d23ac6c-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:31:25.627098 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:25.627063    2572 generic.go:356] "Generic (PLEG): container finished" podID="88b5845e-0d81-4bb1-a481-249c8d23ac6c" containerID="e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235" exitCode=0
Jul 17 21:31:25.627586 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:25.627113    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg" event={"ID":"88b5845e-0d81-4bb1-a481-249c8d23ac6c","Type":"ContainerDied","Data":"e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235"}
Jul 17 21:31:25.627586 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:25.627121    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"
Jul 17 21:31:25.627586 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:25.627194    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg" event={"ID":"88b5845e-0d81-4bb1-a481-249c8d23ac6c","Type":"ContainerDied","Data":"0baf65a8b880f9d9f493422ebfee3ebd3591f18741941afbe8264acaf8160cd0"}
Jul 17 21:31:25.627586 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:25.627226    2572 scope.go:117] "RemoveContainer" containerID="e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235"
Jul 17 21:31:25.635955 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:25.635937    2572 scope.go:117] "RemoveContainer" containerID="e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235"
Jul 17 21:31:25.636181 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:31:25.636164    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235\": container with ID starting with e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235 not found: ID does not exist" containerID="e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235"
Jul 17 21:31:25.636229 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:25.636189    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235"} err="failed to get container status \"e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235\": rpc error: code = NotFound desc = could not find container \"e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235\": container with ID starting with e354022d71de9ecb21deaa263457f3e60bf7f9aa031532af2c7938d9d3e0f235 not found: ID does not exist"
Jul 17 21:31:25.643734 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:25.643710    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"]
Jul 17 21:31:25.647189 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:25.647170    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-8795fd2a-8447cc969b-bnkwg"]
Jul 17 21:31:27.041307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:27.041258    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88b5845e-0d81-4bb1-a481-249c8d23ac6c" path="/var/lib/kubelet/pods/88b5845e-0d81-4bb1-a481-249c8d23ac6c/volumes"
Jul 17 21:31:29.041192 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:29.041161    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:29.041930 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:29.041911    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"]
Jul 17 21:31:29.041983 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:29.041944    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8795fd2a-wdz6w"]
Jul 17 21:31:29.198154 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:29.198119    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:29.431695 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:29.431641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:29.675579 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:29.675549    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:29.986987 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:29.986933    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:30.121416 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:30.121383    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:31.042039 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:31.042008    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995" path="/var/lib/kubelet/pods/ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995/volumes"
Jul 17 21:31:32.109251 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.109206    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:32.190962 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.190922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:32.195691 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.195661    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"]
Jul 17 21:31:32.196242 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.196228    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995" containerName="revoke-keys"
Jul 17 21:31:32.196309 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.196246    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995" containerName="revoke-keys"
Jul 17 21:31:32.196309 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.196260    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b5845e-0d81-4bb1-a481-249c8d23ac6c" containerName="maas-api"
Jul 17 21:31:32.196309 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.196269    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b5845e-0d81-4bb1-a481-249c8d23ac6c" containerName="maas-api"
Jul 17 21:31:32.196415 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.196381    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef0eb3c0-b3f3-49c0-af75-e7e9ae4ce995" containerName="revoke-keys"
Jul 17 21:31:32.196415 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.196397    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="88b5845e-0d81-4bb1-a481-249c8d23ac6c" containerName="maas-api"
Jul 17 21:31:32.200931 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.200912    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.203239 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.203217    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-3ed68410-serving-cert\""
Jul 17 21:31:32.207147 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.207118    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"]
Jul 17 21:31:32.253611 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.253582    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:32.349115 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.349084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-openshift-service-ca\") pod \"maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.349314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.349151    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-maas-api-tls\") pod \"maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.349314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.349176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54vwb\" (UniqueName: \"kubernetes.io/projected/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-kube-api-access-54vwb\") pod \"maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.354088 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.354059    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:32.450052 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.450021    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-openshift-service-ca\") pod \"maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.450188 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.450084    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-maas-api-tls\") pod \"maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.450188 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.450121    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54vwb\" (UniqueName: \"kubernetes.io/projected/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-kube-api-access-54vwb\") pod \"maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.450759 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.450740    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-openshift-service-ca\") pod \"maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.452451 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.452434    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-maas-api-tls\") pod \"maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.458102 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.458082    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54vwb\" (UniqueName: \"kubernetes.io/projected/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-kube-api-access-54vwb\") pod \"maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.513734 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.513704    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:32.659244 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.659220    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"]
Jul 17 21:31:32.660789 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:31:32.660757    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09d6ce8_d8c8_479c_a14f_6fed8ec2dc10.slice/crio-54741c29d2e3b963a00ab929e1aea053b68c5ae8c2e6b5768eea3792d2f3005b WatchSource:0}: Error finding container 54741c29d2e3b963a00ab929e1aea053b68c5ae8c2e6b5768eea3792d2f3005b: Status 404 returned error can't find the container with id 54741c29d2e3b963a00ab929e1aea053b68c5ae8c2e6b5768eea3792d2f3005b
Jul 17 21:31:32.678239 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.678211    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:32.776918 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:32.776828    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:33.667847 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:33.667812    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7" event={"ID":"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10","Type":"ContainerStarted","Data":"f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804"}
Jul 17 21:31:33.668300 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:33.667859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7" event={"ID":"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10","Type":"ContainerStarted","Data":"54741c29d2e3b963a00ab929e1aea053b68c5ae8c2e6b5768eea3792d2f3005b"}
Jul 17 21:31:33.668300 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:33.667937    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:33.687089 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:33.687042    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7" podStartSLOduration=1.3557858870000001 podStartE2EDuration="1.687028123s" totalImagesPullingTime="331.242236ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:31:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:31:33.685710374 +0000 UTC m=+1661.215618881" watchObservedRunningTime="2026-07-17 21:31:33.687028123 +0000 UTC m=+1661.216936571"
Jul 17 21:31:39.677862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:39.677828    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:31:57.876123 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:57.876090    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"]
Jul 17 21:31:57.880578 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:57.880560    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"
Jul 17 21:31:57.883510 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:57.883485    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:31:57.889365 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:57.889342    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"]
Jul 17 21:31:57.972745 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:57.972711    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef6b694-43f1-4e63-b01c-fe6ae084a7fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ed68410-98hcf\" (UID: \"3ef6b694-43f1-4e63-b01c-fe6ae084a7fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"
Jul 17 21:31:58.073199 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:58.073162    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef6b694-43f1-4e63-b01c-fe6ae084a7fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ed68410-98hcf\" (UID: \"3ef6b694-43f1-4e63-b01c-fe6ae084a7fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"
Jul 17 21:31:58.073808 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:58.073787    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef6b694-43f1-4e63-b01c-fe6ae084a7fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-3ed68410-98hcf\" (UID: \"3ef6b694-43f1-4e63-b01c-fe6ae084a7fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"
Jul 17 21:31:58.191726 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:58.191696    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"
Jul 17 21:31:58.321827 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:58.321804    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"]
Jul 17 21:31:58.324040 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:31:58.324014    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef6b694_43f1_4e63_b01c_fe6ae084a7fd.slice/crio-c8db98ec7e96fd01bd9b1c59e0907e0b773736d2c307c7dd3883716ebc4ef548 WatchSource:0}: Error finding container c8db98ec7e96fd01bd9b1c59e0907e0b773736d2c307c7dd3883716ebc4ef548: Status 404 returned error can't find the container with id c8db98ec7e96fd01bd9b1c59e0907e0b773736d2c307c7dd3883716ebc4ef548
Jul 17 21:31:58.509890 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:58.509819    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:58.576079 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:58.576051    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:31:58.787184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:58.787105    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf" event={"ID":"3ef6b694-43f1-4e63-b01c-fe6ae084a7fd","Type":"ContainerStarted","Data":"41de52b2af396d8c9e50420afd6d7ccbe5bda712cb99cdb78441003aaa57fc9b"}
Jul 17 21:31:58.787184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:58.787150    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf" event={"ID":"3ef6b694-43f1-4e63-b01c-fe6ae084a7fd","Type":"ContainerStarted","Data":"c8db98ec7e96fd01bd9b1c59e0907e0b773736d2c307c7dd3883716ebc4ef548"}
Jul 17 21:31:58.804256 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:58.804210    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf" podStartSLOduration=1.8041947999999999 podStartE2EDuration="1.8041948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:31:58.802420627 +0000 UTC m=+1686.332329079" watchObservedRunningTime="2026-07-17 21:31:58.8041948 +0000 UTC m=+1686.334103251"
Jul 17 21:31:59.793144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:59.793106    2572 generic.go:356] "Generic (PLEG): container finished" podID="3ef6b694-43f1-4e63-b01c-fe6ae084a7fd" containerID="41de52b2af396d8c9e50420afd6d7ccbe5bda712cb99cdb78441003aaa57fc9b" exitCode=0
Jul 17 21:31:59.793528 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:31:59.793193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf" event={"ID":"3ef6b694-43f1-4e63-b01c-fe6ae084a7fd","Type":"ContainerDied","Data":"41de52b2af396d8c9e50420afd6d7ccbe5bda712cb99cdb78441003aaa57fc9b"}
Jul 17 21:32:00.921919 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:00.921887    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"
Jul 17 21:32:00.998526 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:00.998491    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef6b694-43f1-4e63-b01c-fe6ae084a7fd-maas-api-service-ca\") pod \"3ef6b694-43f1-4e63-b01c-fe6ae084a7fd\" (UID: \"3ef6b694-43f1-4e63-b01c-fe6ae084a7fd\") "
Jul 17 21:32:00.998828 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:00.998807    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ef6b694-43f1-4e63-b01c-fe6ae084a7fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ef6b694-43f1-4e63-b01c-fe6ae084a7fd" (UID: "3ef6b694-43f1-4e63-b01c-fe6ae084a7fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:32:01.099430 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:01.099349    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ef6b694-43f1-4e63-b01c-fe6ae084a7fd-maas-api-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:32:01.803935 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:01.803903    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"
Jul 17 21:32:01.804109 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:01.803902    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf" event={"ID":"3ef6b694-43f1-4e63-b01c-fe6ae084a7fd","Type":"ContainerDied","Data":"c8db98ec7e96fd01bd9b1c59e0907e0b773736d2c307c7dd3883716ebc4ef548"}
Jul 17 21:32:01.804109 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:01.804024    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8db98ec7e96fd01bd9b1c59e0907e0b773736d2c307c7dd3883716ebc4ef548"
Jul 17 21:32:08.288513 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.288479    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"]
Jul 17 21:32:08.288965 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.288712    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7" podUID="f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10" containerName="maas-api" containerID="cri-o://f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804" gracePeriod=30
Jul 17 21:32:08.314739 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.314711    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:08.545004 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.544950    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:32:08.665353 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.665320    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54vwb\" (UniqueName: \"kubernetes.io/projected/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-kube-api-access-54vwb\") pod \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") "
Jul 17 21:32:08.665536 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.665390    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-openshift-service-ca\") pod \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") "
Jul 17 21:32:08.665536 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.665451    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-maas-api-tls\") pod \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\" (UID: \"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10\") "
Jul 17 21:32:08.665752 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.665726    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10" (UID: "f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:32:08.667357 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.667329    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10" (UID: "f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:32:08.667357 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.667339    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-kube-api-access-54vwb" (OuterVolumeSpecName: "kube-api-access-54vwb") pod "f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10" (UID: "f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10"). InnerVolumeSpecName "kube-api-access-54vwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:32:08.766681 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.766648    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:32:08.766681 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.766676    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:32:08.766681 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.766685    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54vwb\" (UniqueName: \"kubernetes.io/projected/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10-kube-api-access-54vwb\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:32:08.841098 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.841008    2572 generic.go:356] "Generic (PLEG): container finished" podID="f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10" containerID="f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804" exitCode=0
Jul 17 21:32:08.841098 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.841046    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"
Jul 17 21:32:08.841098 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.841090    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7" event={"ID":"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10","Type":"ContainerDied","Data":"f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804"}
Jul 17 21:32:08.841518 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.841141    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7" event={"ID":"f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10","Type":"ContainerDied","Data":"54741c29d2e3b963a00ab929e1aea053b68c5ae8c2e6b5768eea3792d2f3005b"}
Jul 17 21:32:08.841518 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.841166    2572 scope.go:117] "RemoveContainer" containerID="f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804"
Jul 17 21:32:08.849759 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.849742    2572 scope.go:117] "RemoveContainer" containerID="f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804"
Jul 17 21:32:08.850016 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:32:08.850000    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804\": container with ID starting with f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804 not found: ID does not exist" containerID="f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804"
Jul 17 21:32:08.850057 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.850028    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804"} err="failed to get container status \"f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804\": rpc error: code = NotFound desc = could not find container \"f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804\": container with ID starting with f5b191136b5b0e2b682149e5f10ef140a95d82efcc8c26adb34dd0d66a2b1804 not found: ID does not exist"
Jul 17 21:32:08.861435 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.861415    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"]
Jul 17 21:32:08.863010 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:08.862993    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-3ed68410-789ccfcd-dsnw7"]
Jul 17 21:32:09.041017 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:09.040985    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10" path="/var/lib/kubelet/pods/f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10/volumes"
Jul 17 21:32:12.955025 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:12.954990    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"]
Jul 17 21:32:12.957892 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:12.957865    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-3ed68410-98hcf"]
Jul 17 21:32:12.961455 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:12.961434    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:13.041517 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:13.041484    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ef6b694-43f1-4e63-b01c-fe6ae084a7fd" path="/var/lib/kubelet/pods/3ef6b694-43f1-4e63-b01c-fe6ae084a7fd/volumes"
Jul 17 21:32:14.137675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:14.137597    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:14.358532 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:14.358503    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:14.574860 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:14.574830    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:14.896952 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:14.896877    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:15.271468 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:15.271438    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:17.358884 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.358851    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:17.459693 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.459662    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:17.666842 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.666816    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"]
Jul 17 21:32:17.667183 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.667169    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ef6b694-43f1-4e63-b01c-fe6ae084a7fd" containerName="revoke-keys"
Jul 17 21:32:17.667226 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.667186    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ef6b694-43f1-4e63-b01c-fe6ae084a7fd" containerName="revoke-keys"
Jul 17 21:32:17.667226 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.667198    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10" containerName="maas-api"
Jul 17 21:32:17.667226 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.667204    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10" containerName="maas-api"
Jul 17 21:32:17.667333 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.667317    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ef6b694-43f1-4e63-b01c-fe6ae084a7fd" containerName="revoke-keys"
Jul 17 21:32:17.667333 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.667328    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f09d6ce8-d8c8-479c-a14f-6fed8ec2dc10" containerName="maas-api"
Jul 17 21:32:17.671638 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.671621    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:17.678367 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.678342    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5b4896c2-serving-cert\""
Jul 17 21:32:17.693377 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.693345    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"]
Jul 17 21:32:17.726508 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.726472    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:17.747203 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.747179    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78cd6816-5602-4fc7-9407-6501f3e82eb8-maas-api-tls\") pod \"maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:17.747401 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.747214    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5c6b\" (UniqueName: \"kubernetes.io/projected/78cd6816-5602-4fc7-9407-6501f3e82eb8-kube-api-access-r5c6b\") pod \"maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:17.747401 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.747255    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78cd6816-5602-4fc7-9407-6501f3e82eb8-openshift-service-ca\") pod \"maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:17.848661 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.848626    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5c6b\" (UniqueName: \"kubernetes.io/projected/78cd6816-5602-4fc7-9407-6501f3e82eb8-kube-api-access-r5c6b\") pod \"maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:17.848875 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.848671    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78cd6816-5602-4fc7-9407-6501f3e82eb8-openshift-service-ca\") pod \"maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:17.848875 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.848741    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78cd6816-5602-4fc7-9407-6501f3e82eb8-maas-api-tls\") pod \"maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:17.848875 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:32:17.848853    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-serving-cert: secret "maas-api-e2e-derive-5b4896c2-serving-cert" not found
Jul 17 21:32:17.849038 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:32:17.848934    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78cd6816-5602-4fc7-9407-6501f3e82eb8-maas-api-tls podName:78cd6816-5602-4fc7-9407-6501f3e82eb8 nodeName:}" failed. No retries permitted until 2026-07-17 21:32:18.348912026 +0000 UTC m=+1705.878820456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/78cd6816-5602-4fc7-9407-6501f3e82eb8-maas-api-tls") pod "maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9" (UID: "78cd6816-5602-4fc7-9407-6501f3e82eb8") : secret "maas-api-e2e-derive-5b4896c2-serving-cert" not found
Jul 17 21:32:17.849447 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.849429    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78cd6816-5602-4fc7-9407-6501f3e82eb8-openshift-service-ca\") pod \"maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:17.857823 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.857795    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5c6b\" (UniqueName: \"kubernetes.io/projected/78cd6816-5602-4fc7-9407-6501f3e82eb8-kube-api-access-r5c6b\") pod \"maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:17.908626 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:17.908568    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:18.214947 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:18.214891    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:18.314956 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:18.314927    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:18.352958 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:18.352924    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78cd6816-5602-4fc7-9407-6501f3e82eb8-maas-api-tls\") pod \"maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:18.355268 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:18.355250    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78cd6816-5602-4fc7-9407-6501f3e82eb8-maas-api-tls\") pod \"maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:18.581562 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:18.581469    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:18.715694 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:18.715664    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"]
Jul 17 21:32:18.717705 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:32:18.717675    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78cd6816_5602_4fc7_9407_6501f3e82eb8.slice/crio-fe0d7b764eec71386b7a72631448bac6cc4dfe86ced135ea6aebe41252d995f2 WatchSource:0}: Error finding container fe0d7b764eec71386b7a72631448bac6cc4dfe86ced135ea6aebe41252d995f2: Status 404 returned error can't find the container with id fe0d7b764eec71386b7a72631448bac6cc4dfe86ced135ea6aebe41252d995f2
Jul 17 21:32:18.890593 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:18.890510    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9" event={"ID":"78cd6816-5602-4fc7-9407-6501f3e82eb8","Type":"ContainerStarted","Data":"fe0d7b764eec71386b7a72631448bac6cc4dfe86ced135ea6aebe41252d995f2"}
Jul 17 21:32:19.899567 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:19.899539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9" event={"ID":"78cd6816-5602-4fc7-9407-6501f3e82eb8","Type":"ContainerStarted","Data":"fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512"}
Jul 17 21:32:19.899957 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:19.899673    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:19.919742 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:19.919684    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9" podStartSLOduration=2.600628712 podStartE2EDuration="2.919665184s" totalImagesPullingTime="319.036472ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:32:19.917040895 +0000 UTC m=+1707.446949356" watchObservedRunningTime="2026-07-17 21:32:19.919665184 +0000 UTC m=+1707.449573642"
Jul 17 21:32:25.910768 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:25.910739    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:42.216692 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:42.216606    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"]
Jul 17 21:32:42.220291 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:42.220256    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"
Jul 17 21:32:42.222967 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:42.222948    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:32:42.227015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:42.226990    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"]
Jul 17 21:32:42.357631 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:42.357595    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce31d54-a7bb-419c-b82f-42d9f8163910-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94\" (UID: \"0ce31d54-a7bb-419c-b82f-42d9f8163910\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"
Jul 17 21:32:42.458571 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:42.458540    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce31d54-a7bb-419c-b82f-42d9f8163910-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94\" (UID: \"0ce31d54-a7bb-419c-b82f-42d9f8163910\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"
Jul 17 21:32:42.459149 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:42.459128    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce31d54-a7bb-419c-b82f-42d9f8163910-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94\" (UID: \"0ce31d54-a7bb-419c-b82f-42d9f8163910\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"
Jul 17 21:32:42.532675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:42.532579    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"
Jul 17 21:32:42.663960 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:42.663925    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"]
Jul 17 21:32:42.666205 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:32:42.666180    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ce31d54_a7bb_419c_b82f_42d9f8163910.slice/crio-afd2f22011091345f690609eaab2b3baef9742cd8f3108ae46316bd3e9241517 WatchSource:0}: Error finding container afd2f22011091345f690609eaab2b3baef9742cd8f3108ae46316bd3e9241517: Status 404 returned error can't find the container with id afd2f22011091345f690609eaab2b3baef9742cd8f3108ae46316bd3e9241517
Jul 17 21:32:43.012189 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:43.012158    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94" event={"ID":"0ce31d54-a7bb-419c-b82f-42d9f8163910","Type":"ContainerStarted","Data":"84e68ecd44f01c7f4c23536c49e3f674c6a1664c7087d0137f9857762ef4e31c"}
Jul 17 21:32:43.012389 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:43.012210    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94" event={"ID":"0ce31d54-a7bb-419c-b82f-42d9f8163910","Type":"ContainerStarted","Data":"afd2f22011091345f690609eaab2b3baef9742cd8f3108ae46316bd3e9241517"}
Jul 17 21:32:43.029031 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:43.028962    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94" podStartSLOduration=1.028946714 podStartE2EDuration="1.028946714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:32:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:32:43.027180905 +0000 UTC m=+1730.557089400" watchObservedRunningTime="2026-07-17 21:32:43.028946714 +0000 UTC m=+1730.558855164"
Jul 17 21:32:44.018766 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:44.018728    2572 generic.go:356] "Generic (PLEG): container finished" podID="0ce31d54-a7bb-419c-b82f-42d9f8163910" containerID="84e68ecd44f01c7f4c23536c49e3f674c6a1664c7087d0137f9857762ef4e31c" exitCode=0
Jul 17 21:32:44.018766 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:44.018765    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94" event={"ID":"0ce31d54-a7bb-419c-b82f-42d9f8163910","Type":"ContainerDied","Data":"84e68ecd44f01c7f4c23536c49e3f674c6a1664c7087d0137f9857762ef4e31c"}
Jul 17 21:32:45.157072 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:45.157048    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"
Jul 17 21:32:45.286630 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:45.286548    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce31d54-a7bb-419c-b82f-42d9f8163910-maas-api-service-ca\") pod \"0ce31d54-a7bb-419c-b82f-42d9f8163910\" (UID: \"0ce31d54-a7bb-419c-b82f-42d9f8163910\") "
Jul 17 21:32:45.286931 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:45.286898    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ce31d54-a7bb-419c-b82f-42d9f8163910-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0ce31d54-a7bb-419c-b82f-42d9f8163910" (UID: "0ce31d54-a7bb-419c-b82f-42d9f8163910"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:32:45.387981 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:45.387949    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ce31d54-a7bb-419c-b82f-42d9f8163910-maas-api-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:32:46.035485 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:46.035453    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"
Jul 17 21:32:46.035485 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:46.035476    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94" event={"ID":"0ce31d54-a7bb-419c-b82f-42d9f8163910","Type":"ContainerDied","Data":"afd2f22011091345f690609eaab2b3baef9742cd8f3108ae46316bd3e9241517"}
Jul 17 21:32:46.035693 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:46.035511    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afd2f22011091345f690609eaab2b3baef9742cd8f3108ae46316bd3e9241517"
Jul 17 21:32:52.763006 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:52.762972    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"]
Jul 17 21:32:52.763862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:52.763824    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9" podUID="78cd6816-5602-4fc7-9407-6501f3e82eb8" containerName="maas-api" containerID="cri-o://fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512" gracePeriod=30
Jul 17 21:32:52.795045 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:52.795015    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:53.015559 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.015491    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:53.043828 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.043801    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78cd6816-5602-4fc7-9407-6501f3e82eb8-openshift-service-ca\") pod \"78cd6816-5602-4fc7-9407-6501f3e82eb8\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") "
Jul 17 21:32:53.043980 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.043858    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5c6b\" (UniqueName: \"kubernetes.io/projected/78cd6816-5602-4fc7-9407-6501f3e82eb8-kube-api-access-r5c6b\") pod \"78cd6816-5602-4fc7-9407-6501f3e82eb8\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") "
Jul 17 21:32:53.043980 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.043899    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78cd6816-5602-4fc7-9407-6501f3e82eb8-maas-api-tls\") pod \"78cd6816-5602-4fc7-9407-6501f3e82eb8\" (UID: \"78cd6816-5602-4fc7-9407-6501f3e82eb8\") "
Jul 17 21:32:53.044174 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.044154    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78cd6816-5602-4fc7-9407-6501f3e82eb8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "78cd6816-5602-4fc7-9407-6501f3e82eb8" (UID: "78cd6816-5602-4fc7-9407-6501f3e82eb8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:32:53.045900 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.045866    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78cd6816-5602-4fc7-9407-6501f3e82eb8-kube-api-access-r5c6b" (OuterVolumeSpecName: "kube-api-access-r5c6b") pod "78cd6816-5602-4fc7-9407-6501f3e82eb8" (UID: "78cd6816-5602-4fc7-9407-6501f3e82eb8"). InnerVolumeSpecName "kube-api-access-r5c6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:32:53.046267 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.046238    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78cd6816-5602-4fc7-9407-6501f3e82eb8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "78cd6816-5602-4fc7-9407-6501f3e82eb8" (UID: "78cd6816-5602-4fc7-9407-6501f3e82eb8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:32:53.068511 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.068489    2572 generic.go:356] "Generic (PLEG): container finished" podID="78cd6816-5602-4fc7-9407-6501f3e82eb8" containerID="fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512" exitCode=0
Jul 17 21:32:53.068632 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.068520    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9" event={"ID":"78cd6816-5602-4fc7-9407-6501f3e82eb8","Type":"ContainerDied","Data":"fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512"}
Jul 17 21:32:53.068632 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.068532    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"
Jul 17 21:32:53.068632 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.068555    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9" event={"ID":"78cd6816-5602-4fc7-9407-6501f3e82eb8","Type":"ContainerDied","Data":"fe0d7b764eec71386b7a72631448bac6cc4dfe86ced135ea6aebe41252d995f2"}
Jul 17 21:32:53.068632 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.068577    2572 scope.go:117] "RemoveContainer" containerID="fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512"
Jul 17 21:32:53.077042 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.077027    2572 scope.go:117] "RemoveContainer" containerID="fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512"
Jul 17 21:32:53.077268 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:32:53.077247    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512\": container with ID starting with fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512 not found: ID does not exist" containerID="fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512"
Jul 17 21:32:53.077403 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.077383    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512"} err="failed to get container status \"fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512\": rpc error: code = NotFound desc = could not find container \"fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512\": container with ID starting with fa813c36f6f8925a358092da8e00ec2c9cb33105051f0a97ee396468dfe2d512 not found: ID does not exist"
Jul 17 21:32:53.088742 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.088724    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"]
Jul 17 21:32:53.092184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.092164    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5b4896c2-7c7d6c54f5-d6qz9"]
Jul 17 21:32:53.144634 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.144611    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78cd6816-5602-4fc7-9407-6501f3e82eb8-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:32:53.144634 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.144635    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78cd6816-5602-4fc7-9407-6501f3e82eb8-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:32:53.144810 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:53.144646    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5c6b\" (UniqueName: \"kubernetes.io/projected/78cd6816-5602-4fc7-9407-6501f3e82eb8-kube-api-access-r5c6b\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:32:55.041151 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:55.041122    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78cd6816-5602-4fc7-9407-6501f3e82eb8" path="/var/lib/kubelet/pods/78cd6816-5602-4fc7-9407-6501f3e82eb8/volumes"
Jul 17 21:32:57.290608 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:57.290576    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"]
Jul 17 21:32:57.295163 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:57.295135    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5b4896c2-l6r94"]
Jul 17 21:32:57.295538 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:57.295515    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:57.444940 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:57.444889    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:57.665269 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:57.665234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:58.119378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:58.119299    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:58.216596 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:58.216563    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:58.319036 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:58.319008    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:32:59.040718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:59.040687    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ce31d54-a7bb-419c-b82f-42d9f8163910" path="/var/lib/kubelet/pods/0ce31d54-a7bb-419c-b82f-42d9f8163910/volumes"
Jul 17 21:32:59.701525 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:32:59.701494    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:06.369707 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:06.369647    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:06.485392 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:06.485330    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:06.604155 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:06.604123    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:06.697112 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:06.697086    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:07.086726 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:07.086614    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:11.079631 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:11.079600    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:11.181018 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:11.180983    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:33.091166 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:33.091136    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:40.379175 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:40.379138    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:40.497191 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:40.497158    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:40.625506 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:40.625472    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:33:56.569652 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:33:56.569620    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:02.639213 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:02.639178    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:02.702711 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:02.702685    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:02.789034 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:02.789005    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:02.872741 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:02.872710    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:13.446330 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:13.446292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:15.821696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:15.821663    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:23.530730 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:23.530698    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:23.645822 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:23.645793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:23.758997 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:23.758968    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:23.849667 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:23.849595    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:24.663452 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:24.663410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:24.790207 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:24.790178    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:24.903176 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:24.903143    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:26.529164 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:26.529129    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:33.069543 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:33.069514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:33.170116 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:33.170082    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:33.798223 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:33.798190    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:40.131699 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:40.131666    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:40.230069 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:40.230035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:40.385685 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:40.385596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:40.796186 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:40.796150    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:40.958746 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:40.958711    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:43.778162 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.778124    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:43.865753 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.865700    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:43.905831 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.905795    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"]
Jul 17 21:34:43.906253 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.906236    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78cd6816-5602-4fc7-9407-6501f3e82eb8" containerName="maas-api"
Jul 17 21:34:43.906372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.906255    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="78cd6816-5602-4fc7-9407-6501f3e82eb8" containerName="maas-api"
Jul 17 21:34:43.906372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.906307    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ce31d54-a7bb-419c-b82f-42d9f8163910" containerName="revoke-keys"
Jul 17 21:34:43.906372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.906316    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ce31d54-a7bb-419c-b82f-42d9f8163910" containerName="revoke-keys"
Jul 17 21:34:43.906527 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.906403    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ce31d54-a7bb-419c-b82f-42d9f8163910" containerName="revoke-keys"
Jul 17 21:34:43.906527 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.906419    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="78cd6816-5602-4fc7-9407-6501f3e82eb8" containerName="maas-api"
Jul 17 21:34:43.909569 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.909548    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:43.911963 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.911937    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-4ad88838-serving-cert\""
Jul 17 21:34:43.924066 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.924037    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"]
Jul 17 21:34:43.950521 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:43.950485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:44.084453 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.084362    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e2c6a4-a65f-4917-b5b6-845375f0290f-maas-api-tls\") pod \"maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:44.084453 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.084405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmpx6\" (UniqueName: \"kubernetes.io/projected/56e2c6a4-a65f-4917-b5b6-845375f0290f-kube-api-access-mmpx6\") pod \"maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:44.084453 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.084430    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e2c6a4-a65f-4917-b5b6-845375f0290f-openshift-service-ca\") pod \"maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:44.154507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.154474    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:44.185463 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.185433    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e2c6a4-a65f-4917-b5b6-845375f0290f-openshift-service-ca\") pod \"maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:44.185633 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.185528    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e2c6a4-a65f-4917-b5b6-845375f0290f-maas-api-tls\") pod \"maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:44.185633 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.185553    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmpx6\" (UniqueName: \"kubernetes.io/projected/56e2c6a4-a65f-4917-b5b6-845375f0290f-kube-api-access-mmpx6\") pod \"maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:44.186084 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.186065    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e2c6a4-a65f-4917-b5b6-845375f0290f-openshift-service-ca\") pod \"maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:44.188203 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.188182    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e2c6a4-a65f-4917-b5b6-845375f0290f-maas-api-tls\") pod \"maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:44.197522 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.197501    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmpx6\" (UniqueName: \"kubernetes.io/projected/56e2c6a4-a65f-4917-b5b6-845375f0290f-kube-api-access-mmpx6\") pod \"maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:44.220657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.220617    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:44.362876 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.362803    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"]
Jul 17 21:34:44.365207 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:34:44.365175    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e2c6a4_a65f_4917_b5b6_845375f0290f.slice/crio-83eb906374043ce2926f941a709bbdc37f81a0fa740b1c6e35f29432745315b8 WatchSource:0}: Error finding container 83eb906374043ce2926f941a709bbdc37f81a0fa740b1c6e35f29432745315b8: Status 404 returned error can't find the container with id 83eb906374043ce2926f941a709bbdc37f81a0fa740b1c6e35f29432745315b8
Jul 17 21:34:44.593757 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.593725    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:44.597951 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.597923    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k" event={"ID":"56e2c6a4-a65f-4917-b5b6-845375f0290f","Type":"ContainerStarted","Data":"83eb906374043ce2926f941a709bbdc37f81a0fa740b1c6e35f29432745315b8"}
Jul 17 21:34:44.693241 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:44.693209    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:45.604003 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:45.603964    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k" event={"ID":"56e2c6a4-a65f-4917-b5b6-845375f0290f","Type":"ContainerStarted","Data":"402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f"}
Jul 17 21:34:45.604485 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:45.604044    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:45.621951 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:45.621902    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k" podStartSLOduration=2.201077642 podStartE2EDuration="2.621886112s" totalImagesPullingTime="420.80847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:34:45.621676848 +0000 UTC m=+1853.151585352" watchObservedRunningTime="2026-07-17 21:34:45.621886112 +0000 UTC m=+1853.151794566"
Jul 17 21:34:48.252669 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:48.252635    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:48.907883 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:48.907812    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:49.008358 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:49.008325    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:49.325804 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:49.325776    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:51.614849 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:51.614818    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:34:55.196577 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:55.196538    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:55.298464 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:55.298431    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:34:55.570574 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:55.570494    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"]
Jul 17 21:34:55.573938 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:55.573922    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"
Jul 17 21:34:55.576718 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:55.576697    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:34:55.582690 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:55.582668    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"]
Jul 17 21:34:55.686068 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:55.686027    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0dabfb-6b9d-457f-8deb-a290a8debc1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz\" (UID: \"8e0dabfb-6b9d-457f-8deb-a290a8debc1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"
Jul 17 21:34:55.786504 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:55.786469    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0dabfb-6b9d-457f-8deb-a290a8debc1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz\" (UID: \"8e0dabfb-6b9d-457f-8deb-a290a8debc1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"
Jul 17 21:34:55.787073 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:55.787048    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0dabfb-6b9d-457f-8deb-a290a8debc1c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz\" (UID: \"8e0dabfb-6b9d-457f-8deb-a290a8debc1c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"
Jul 17 21:34:55.884937 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:55.884855    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"
Jul 17 21:34:56.017625 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:56.017600    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"]
Jul 17 21:34:56.020216 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:34:56.020184    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0dabfb_6b9d_457f_8deb_a290a8debc1c.slice/crio-3a55e6e1e747b82350c4cdd5723e5748646e7ffc2aebffb65d59fc92f3d0f325 WatchSource:0}: Error finding container 3a55e6e1e747b82350c4cdd5723e5748646e7ffc2aebffb65d59fc92f3d0f325: Status 404 returned error can't find the container with id 3a55e6e1e747b82350c4cdd5723e5748646e7ffc2aebffb65d59fc92f3d0f325
Jul 17 21:34:56.660991 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:56.660903    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz" event={"ID":"8e0dabfb-6b9d-457f-8deb-a290a8debc1c","Type":"ContainerStarted","Data":"bf410df5a080e3b0b12744fad1110125bd3309ca2626fea2a674af0840e1f466"}
Jul 17 21:34:56.660991 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:56.660962    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz" event={"ID":"8e0dabfb-6b9d-457f-8deb-a290a8debc1c","Type":"ContainerStarted","Data":"3a55e6e1e747b82350c4cdd5723e5748646e7ffc2aebffb65d59fc92f3d0f325"}
Jul 17 21:34:56.677015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:56.676964    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz" podStartSLOduration=1.676948119 podStartE2EDuration="1.676948119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:34:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:34:56.675744117 +0000 UTC m=+1864.205652568" watchObservedRunningTime="2026-07-17 21:34:56.676948119 +0000 UTC m=+1864.206856570"
Jul 17 21:34:57.666986 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:57.666952    2572 generic.go:356] "Generic (PLEG): container finished" podID="8e0dabfb-6b9d-457f-8deb-a290a8debc1c" containerID="bf410df5a080e3b0b12744fad1110125bd3309ca2626fea2a674af0840e1f466" exitCode=0
Jul 17 21:34:57.667448 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:57.667037    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz" event={"ID":"8e0dabfb-6b9d-457f-8deb-a290a8debc1c","Type":"ContainerDied","Data":"bf410df5a080e3b0b12744fad1110125bd3309ca2626fea2a674af0840e1f466"}
Jul 17 21:34:58.802912 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:58.802890    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"
Jul 17 21:34:58.914325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:58.914267    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0dabfb-6b9d-457f-8deb-a290a8debc1c-maas-api-service-ca\") pod \"8e0dabfb-6b9d-457f-8deb-a290a8debc1c\" (UID: \"8e0dabfb-6b9d-457f-8deb-a290a8debc1c\") "
Jul 17 21:34:58.914597 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:58.914576    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e0dabfb-6b9d-457f-8deb-a290a8debc1c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8e0dabfb-6b9d-457f-8deb-a290a8debc1c" (UID: "8e0dabfb-6b9d-457f-8deb-a290a8debc1c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:34:59.015414 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:59.015313    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e0dabfb-6b9d-457f-8deb-a290a8debc1c-maas-api-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:34:59.678036 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:59.678005    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"
Jul 17 21:34:59.678211 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:59.678032    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz" event={"ID":"8e0dabfb-6b9d-457f-8deb-a290a8debc1c","Type":"ContainerDied","Data":"3a55e6e1e747b82350c4cdd5723e5748646e7ffc2aebffb65d59fc92f3d0f325"}
Jul 17 21:34:59.678211 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:34:59.678078    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a55e6e1e747b82350c4cdd5723e5748646e7ffc2aebffb65d59fc92f3d0f325"
Jul 17 21:35:06.016997 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.016961    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"]
Jul 17 21:35:06.019748 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.017316    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k" podUID="56e2c6a4-a65f-4917-b5b6-845375f0290f" containerName="maas-api" containerID="cri-o://402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f" gracePeriod=30
Jul 17 21:35:06.077679 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.077647    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:06.265199 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.265178    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:35:06.373631 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.373542    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e2c6a4-a65f-4917-b5b6-845375f0290f-maas-api-tls\") pod \"56e2c6a4-a65f-4917-b5b6-845375f0290f\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") "
Jul 17 21:35:06.373631 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.373596    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmpx6\" (UniqueName: \"kubernetes.io/projected/56e2c6a4-a65f-4917-b5b6-845375f0290f-kube-api-access-mmpx6\") pod \"56e2c6a4-a65f-4917-b5b6-845375f0290f\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") "
Jul 17 21:35:06.373631 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.373626    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e2c6a4-a65f-4917-b5b6-845375f0290f-openshift-service-ca\") pod \"56e2c6a4-a65f-4917-b5b6-845375f0290f\" (UID: \"56e2c6a4-a65f-4917-b5b6-845375f0290f\") "
Jul 17 21:35:06.374062 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.374029    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56e2c6a4-a65f-4917-b5b6-845375f0290f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56e2c6a4-a65f-4917-b5b6-845375f0290f" (UID: "56e2c6a4-a65f-4917-b5b6-845375f0290f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:35:06.375732 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.375702    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56e2c6a4-a65f-4917-b5b6-845375f0290f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56e2c6a4-a65f-4917-b5b6-845375f0290f" (UID: "56e2c6a4-a65f-4917-b5b6-845375f0290f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:35:06.375842 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.375748    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56e2c6a4-a65f-4917-b5b6-845375f0290f-kube-api-access-mmpx6" (OuterVolumeSpecName: "kube-api-access-mmpx6") pod "56e2c6a4-a65f-4917-b5b6-845375f0290f" (UID: "56e2c6a4-a65f-4917-b5b6-845375f0290f"). InnerVolumeSpecName "kube-api-access-mmpx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:35:06.474390 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.474352    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56e2c6a4-a65f-4917-b5b6-845375f0290f-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:35:06.474390 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.474383    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmpx6\" (UniqueName: \"kubernetes.io/projected/56e2c6a4-a65f-4917-b5b6-845375f0290f-kube-api-access-mmpx6\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:35:06.474390 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.474393    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56e2c6a4-a65f-4917-b5b6-845375f0290f-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:35:06.720040 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.720002    2572 generic.go:356] "Generic (PLEG): container finished" podID="56e2c6a4-a65f-4917-b5b6-845375f0290f" containerID="402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f" exitCode=0
Jul 17 21:35:06.720243 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.720045    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"
Jul 17 21:35:06.720243 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.720085    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k" event={"ID":"56e2c6a4-a65f-4917-b5b6-845375f0290f","Type":"ContainerDied","Data":"402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f"}
Jul 17 21:35:06.720243 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.720143    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k" event={"ID":"56e2c6a4-a65f-4917-b5b6-845375f0290f","Type":"ContainerDied","Data":"83eb906374043ce2926f941a709bbdc37f81a0fa740b1c6e35f29432745315b8"}
Jul 17 21:35:06.720243 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.720157    2572 scope.go:117] "RemoveContainer" containerID="402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f"
Jul 17 21:35:06.730521 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.730502    2572 scope.go:117] "RemoveContainer" containerID="402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f"
Jul 17 21:35:06.730777 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:35:06.730756    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f\": container with ID starting with 402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f not found: ID does not exist" containerID="402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f"
Jul 17 21:35:06.730857 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.730789    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f"} err="failed to get container status \"402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f\": rpc error: code = NotFound desc = could not find container \"402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f\": container with ID starting with 402d551a4b98e008edea09d4e45ea85f76d074e97534a7f378ad63b9f6512f5f not found: ID does not exist"
Jul 17 21:35:06.741849 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.741824    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"]
Jul 17 21:35:06.745259 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:06.745239    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-4ad88838-dff9cb576-sxk7k"]
Jul 17 21:35:07.041546 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:07.041471    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56e2c6a4-a65f-4917-b5b6-845375f0290f" path="/var/lib/kubelet/pods/56e2c6a4-a65f-4917-b5b6-845375f0290f/volumes"
Jul 17 21:35:10.640840 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:10.640808    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:10.650116 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:10.650083    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"]
Jul 17 21:35:10.652314 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:10.652290    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-4ad88838-6gxfz"]
Jul 17 21:35:11.020899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:11.020868    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:11.040422 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:11.040393    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e0dabfb-6b9d-457f-8deb-a290a8debc1c" path="/var/lib/kubelet/pods/8e0dabfb-6b9d-457f-8deb-a290a8debc1c/volumes"
Jul 17 21:35:16.790327 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:16.790203    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:16.846657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:16.846624    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:17.052355 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:17.052232    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:17.281889 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:17.281860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:17.391781 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:17.391700    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:17.490417 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:17.490387    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:17.590007 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:17.589961    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:23.858105 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:23.858064    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:23.966124 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:23.966082    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:24.058770 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:24.058733    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:24.204764 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:24.204717    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:30.071163 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:30.071091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:30.172372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:30.172332    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:36.795286 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:36.795250    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:37.176289 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:37.176250    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:37.817949 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:37.817917    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:40.125130 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.125085    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:40.134958 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.134923    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"]
Jul 17 21:35:40.135490 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.135469    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e0dabfb-6b9d-457f-8deb-a290a8debc1c" containerName="revoke-keys"
Jul 17 21:35:40.135490 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.135490    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e0dabfb-6b9d-457f-8deb-a290a8debc1c" containerName="revoke-keys"
Jul 17 21:35:40.135661 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.135511    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56e2c6a4-a65f-4917-b5b6-845375f0290f" containerName="maas-api"
Jul 17 21:35:40.135661 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.135517    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="56e2c6a4-a65f-4917-b5b6-845375f0290f" containerName="maas-api"
Jul 17 21:35:40.135661 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.135595    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="56e2c6a4-a65f-4917-b5b6-845375f0290f" containerName="maas-api"
Jul 17 21:35:40.135661 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.135603    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e0dabfb-6b9d-457f-8deb-a290a8debc1c" containerName="revoke-keys"
Jul 17 21:35:40.138551 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.138536    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.141107 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.141088    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-1f606ba2-serving-cert\""
Jul 17 21:35:40.147976 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.147953    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"]
Jul 17 21:35:40.181541 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.181502    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c03da74-2828-4139-b769-bc9fab7680ac-maas-api-tls\") pod \"maas-api-e2e-mt-1f606ba2-69875667c8-djcvr\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.181739 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.181546    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k976d\" (UniqueName: \"kubernetes.io/projected/9c03da74-2828-4139-b769-bc9fab7680ac-kube-api-access-k976d\") pod \"maas-api-e2e-mt-1f606ba2-69875667c8-djcvr\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.181739 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.181584    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c03da74-2828-4139-b769-bc9fab7680ac-openshift-service-ca\") pod \"maas-api-e2e-mt-1f606ba2-69875667c8-djcvr\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.214324 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.214291    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:40.282300 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.282248    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c03da74-2828-4139-b769-bc9fab7680ac-maas-api-tls\") pod \"maas-api-e2e-mt-1f606ba2-69875667c8-djcvr\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.282468 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.282327    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k976d\" (UniqueName: \"kubernetes.io/projected/9c03da74-2828-4139-b769-bc9fab7680ac-kube-api-access-k976d\") pod \"maas-api-e2e-mt-1f606ba2-69875667c8-djcvr\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.282468 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.282380    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c03da74-2828-4139-b769-bc9fab7680ac-openshift-service-ca\") pod \"maas-api-e2e-mt-1f606ba2-69875667c8-djcvr\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.282468 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:35:40.282390    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-serving-cert: secret "maas-api-e2e-mt-1f606ba2-serving-cert" not found
Jul 17 21:35:40.282468 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:35:40.282458    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c03da74-2828-4139-b769-bc9fab7680ac-maas-api-tls podName:9c03da74-2828-4139-b769-bc9fab7680ac nodeName:}" failed. No retries permitted until 2026-07-17 21:35:40.782437573 +0000 UTC m=+1908.312346004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9c03da74-2828-4139-b769-bc9fab7680ac-maas-api-tls") pod "maas-api-e2e-mt-1f606ba2-69875667c8-djcvr" (UID: "9c03da74-2828-4139-b769-bc9fab7680ac") : secret "maas-api-e2e-mt-1f606ba2-serving-cert" not found
Jul 17 21:35:40.283110 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.283091    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c03da74-2828-4139-b769-bc9fab7680ac-openshift-service-ca\") pod \"maas-api-e2e-mt-1f606ba2-69875667c8-djcvr\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.291478 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.291459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k976d\" (UniqueName: \"kubernetes.io/projected/9c03da74-2828-4139-b769-bc9fab7680ac-kube-api-access-k976d\") pod \"maas-api-e2e-mt-1f606ba2-69875667c8-djcvr\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.381239 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.381157    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:40.786245 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.786207    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c03da74-2828-4139-b769-bc9fab7680ac-maas-api-tls\") pod \"maas-api-e2e-mt-1f606ba2-69875667c8-djcvr\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.788510 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.788479    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:40.788889 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.788872    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c03da74-2828-4139-b769-bc9fab7680ac-maas-api-tls\") pod \"maas-api-e2e-mt-1f606ba2-69875667c8-djcvr\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:40.891728 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:40.891692    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:41.050740 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:41.050657    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:41.188879 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:41.188858    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"]
Jul 17 21:35:41.191459 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:35:41.191431    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c03da74_2828_4139_b769_bc9fab7680ac.slice/crio-65ca17daf95715d7b9f90a70710b79d01f6b0c7fe220d7f5ac16fef86a1329e4 WatchSource:0}: Error finding container 65ca17daf95715d7b9f90a70710b79d01f6b0c7fe220d7f5ac16fef86a1329e4: Status 404 returned error can't find the container with id 65ca17daf95715d7b9f90a70710b79d01f6b0c7fe220d7f5ac16fef86a1329e4
Jul 17 21:35:41.193014 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:41.192991    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:35:41.899675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:41.899589    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr" event={"ID":"9c03da74-2828-4139-b769-bc9fab7680ac","Type":"ContainerStarted","Data":"d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518"}
Jul 17 21:35:41.899675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:41.899642    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr" event={"ID":"9c03da74-2828-4139-b769-bc9fab7680ac","Type":"ContainerStarted","Data":"65ca17daf95715d7b9f90a70710b79d01f6b0c7fe220d7f5ac16fef86a1329e4"}
Jul 17 21:35:41.899883 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:41.899785    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:41.917841 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:41.917801    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr" podStartSLOduration=1.562295969 podStartE2EDuration="1.917784401s" totalImagesPullingTime="355.488432ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:35:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:35:41.916404636 +0000 UTC m=+1909.446313108" watchObservedRunningTime="2026-07-17 21:35:41.917784401 +0000 UTC m=+1909.447692852"
Jul 17 21:35:44.519600 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:44.519561    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:47.910190 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:47.910162    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:35:54.181474 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.181441    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"]
Jul 17 21:35:54.185079 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.185059    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.188514 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.188491    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1f606ba2\"/\"kube-root-ca.crt\""
Jul 17 21:35:54.188514 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.188506    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1f606ba2\"/\"e2e-lifecycle-model-1f606ba2-kserve-self-signed-certs\""
Jul 17 21:35:54.188737 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.188498    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1f606ba2\"/\"default-dockercfg-4j52v\""
Jul 17 21:35:54.188737 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.188553    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1f606ba2\"/\"openshift-service-ca.crt\""
Jul 17 21:35:54.199015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.198986    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"]
Jul 17 21:35:54.215811 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.215772    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:35:54.302109 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.302070    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b234c66-051d-4228-b6a1-c032cf7768ee-tls-certs\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.302327 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.302122    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9bc6\" (UniqueName: \"kubernetes.io/projected/6b234c66-051d-4228-b6a1-c032cf7768ee-kube-api-access-p9bc6\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.302327 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.302207    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-model-cache\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.302327 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.302249    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-home\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.302497 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.302369    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-dshm\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.302497 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.302399    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-tmp-dir\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.403311 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.403246    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-dshm\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.403311 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.403317    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-tmp-dir\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.403579 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.403372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b234c66-051d-4228-b6a1-c032cf7768ee-tls-certs\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.403579 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.403407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9bc6\" (UniqueName: \"kubernetes.io/projected/6b234c66-051d-4228-b6a1-c032cf7768ee-kube-api-access-p9bc6\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.403579 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.403446    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-model-cache\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.403579 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.403481    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-home\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.403806 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.403757    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-tmp-dir\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.403870 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.403807    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-home\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.403870 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.403849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-model-cache\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.405522 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.405496    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-dshm\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.405760 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.405743    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b234c66-051d-4228-b6a1-c032cf7768ee-tls-certs\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.412244 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.412223    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9bc6\" (UniqueName: \"kubernetes.io/projected/6b234c66-051d-4228-b6a1-c032cf7768ee-kube-api-access-p9bc6\") pod \"e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") " pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.495845 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.495754    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:35:54.628573 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.628547    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"]
Jul 17 21:35:54.630487 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:35:54.630456    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b234c66_051d_4228_b6a1_c032cf7768ee.slice/crio-9f2d5a4d64a1bd1ecc3ddb2cfaa6e3141de88e8b9084d10991d682e00e4d6d24 WatchSource:0}: Error finding container 9f2d5a4d64a1bd1ecc3ddb2cfaa6e3141de88e8b9084d10991d682e00e4d6d24: Status 404 returned error can't find the container with id 9f2d5a4d64a1bd1ecc3ddb2cfaa6e3141de88e8b9084d10991d682e00e4d6d24
Jul 17 21:35:54.968356 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.968312    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd" event={"ID":"6b234c66-051d-4228-b6a1-c032cf7768ee","Type":"ContainerStarted","Data":"a5907b5de72069fd8d54dc8026f49badb40442a2ee35d0cafd81d6631ea9315d"}
Jul 17 21:35:54.968531 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.968367    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd" event={"ID":"6b234c66-051d-4228-b6a1-c032cf7768ee","Type":"ContainerStarted","Data":"9f2d5a4d64a1bd1ecc3ddb2cfaa6e3141de88e8b9084d10991d682e00e4d6d24"}
Jul 17 21:35:54.986466 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:35:54.986419    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd" podStartSLOduration=0.986404591 podStartE2EDuration="986.404591ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:35:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:35:54.985057926 +0000 UTC m=+1922.514966397" watchObservedRunningTime="2026-07-17 21:35:54.986404591 +0000 UTC m=+1922.516313041"
Jul 17 21:36:04.496572 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:04.496541    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:36:04.497117 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:04.496625    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:36:04.508772 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:04.508750    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:36:05.030863 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:05.030834    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:36:24.447150 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:24.447113    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:36:24.549461 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:24.549429    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:36:33.251198 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.251161    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"]
Jul 17 21:36:33.251688 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.251441    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr" podUID="9c03da74-2828-4139-b769-bc9fab7680ac" containerName="maas-api" containerID="cri-o://d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518" gracePeriod=30
Jul 17 21:36:33.284927 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.284897    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:36:33.499005 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.498980    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:36:33.550752 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.550650    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k976d\" (UniqueName: \"kubernetes.io/projected/9c03da74-2828-4139-b769-bc9fab7680ac-kube-api-access-k976d\") pod \"9c03da74-2828-4139-b769-bc9fab7680ac\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") "
Jul 17 21:36:33.550752 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.550701    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c03da74-2828-4139-b769-bc9fab7680ac-maas-api-tls\") pod \"9c03da74-2828-4139-b769-bc9fab7680ac\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") "
Jul 17 21:36:33.550752 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.550750    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c03da74-2828-4139-b769-bc9fab7680ac-openshift-service-ca\") pod \"9c03da74-2828-4139-b769-bc9fab7680ac\" (UID: \"9c03da74-2828-4139-b769-bc9fab7680ac\") "
Jul 17 21:36:33.551114 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.551092    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c03da74-2828-4139-b769-bc9fab7680ac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c03da74-2828-4139-b769-bc9fab7680ac" (UID: "9c03da74-2828-4139-b769-bc9fab7680ac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:36:33.552708 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.552676    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c03da74-2828-4139-b769-bc9fab7680ac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c03da74-2828-4139-b769-bc9fab7680ac" (UID: "9c03da74-2828-4139-b769-bc9fab7680ac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:36:33.552817 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.552711    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c03da74-2828-4139-b769-bc9fab7680ac-kube-api-access-k976d" (OuterVolumeSpecName: "kube-api-access-k976d") pod "9c03da74-2828-4139-b769-bc9fab7680ac" (UID: "9c03da74-2828-4139-b769-bc9fab7680ac"). InnerVolumeSpecName "kube-api-access-k976d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:36:33.651946 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.651910    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k976d\" (UniqueName: \"kubernetes.io/projected/9c03da74-2828-4139-b769-bc9fab7680ac-kube-api-access-k976d\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:36:33.651946 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.651939    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c03da74-2828-4139-b769-bc9fab7680ac-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:36:33.651946 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:33.651949    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c03da74-2828-4139-b769-bc9fab7680ac-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:36:34.150835 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:34.150797    2572 generic.go:356] "Generic (PLEG): container finished" podID="9c03da74-2828-4139-b769-bc9fab7680ac" containerID="d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518" exitCode=0
Jul 17 21:36:34.151006 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:34.150844    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"
Jul 17 21:36:34.151006 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:34.150887    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr" event={"ID":"9c03da74-2828-4139-b769-bc9fab7680ac","Type":"ContainerDied","Data":"d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518"}
Jul 17 21:36:34.151006 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:34.150936    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr" event={"ID":"9c03da74-2828-4139-b769-bc9fab7680ac","Type":"ContainerDied","Data":"65ca17daf95715d7b9f90a70710b79d01f6b0c7fe220d7f5ac16fef86a1329e4"}
Jul 17 21:36:34.151006 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:34.150960    2572 scope.go:117] "RemoveContainer" containerID="d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518"
Jul 17 21:36:34.160629 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:34.160615    2572 scope.go:117] "RemoveContainer" containerID="d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518"
Jul 17 21:36:34.160882 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:36:34.160867    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518\": container with ID starting with d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518 not found: ID does not exist" containerID="d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518"
Jul 17 21:36:34.160920 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:34.160890    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518"} err="failed to get container status \"d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518\": rpc error: code = NotFound desc = could not find container \"d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518\": container with ID starting with d5521915a5fd3cb8cdfef760c8a16516eaac6d40f4419126b9902c0695547518 not found: ID does not exist"
Jul 17 21:36:34.173771 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:34.173749    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"]
Jul 17 21:36:34.177106 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:34.177086    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-1f606ba2-69875667c8-djcvr"]
Jul 17 21:36:35.042914 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:35.042878    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c03da74-2828-4139-b769-bc9fab7680ac" path="/var/lib/kubelet/pods/9c03da74-2828-4139-b769-bc9fab7680ac/volumes"
Jul 17 21:36:37.879566 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:37.879533    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:36:40.037845 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:40.037811    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:36:45.022035 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:45.021942    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"]
Jul 17 21:36:45.117186 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:45.117153    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:36:55.107375 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:36:55.107342    2572 scope.go:117] "RemoveContainer" containerID="3e8f8b6922e3783aca51ace9118d7fb63439d8b2ee69b378bafc176d05f6f74e"
Jul 17 21:37:00.043708 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.043669    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd" podUID="6b234c66-051d-4228-b6a1-c032cf7768ee" containerName="main" containerID="cri-o://a5907b5de72069fd8d54dc8026f49badb40442a2ee35d0cafd81d6631ea9315d" gracePeriod=45
Jul 17 21:37:00.279134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.279100    2572 generic.go:356] "Generic (PLEG): container finished" podID="6b234c66-051d-4228-b6a1-c032cf7768ee" containerID="a5907b5de72069fd8d54dc8026f49badb40442a2ee35d0cafd81d6631ea9315d" exitCode=0
Jul 17 21:37:00.279298 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.279163    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd" event={"ID":"6b234c66-051d-4228-b6a1-c032cf7768ee","Type":"ContainerDied","Data":"a5907b5de72069fd8d54dc8026f49badb40442a2ee35d0cafd81d6631ea9315d"}
Jul 17 21:37:00.298036 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.297955    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:37:00.379144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.379116    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-dshm\") pod \"6b234c66-051d-4228-b6a1-c032cf7768ee\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") "
Jul 17 21:37:00.379349 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.379160    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-tmp-dir\") pod \"6b234c66-051d-4228-b6a1-c032cf7768ee\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") "
Jul 17 21:37:00.379349 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.379192    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-model-cache\") pod \"6b234c66-051d-4228-b6a1-c032cf7768ee\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") "
Jul 17 21:37:00.379349 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.379232    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b234c66-051d-4228-b6a1-c032cf7768ee-tls-certs\") pod \"6b234c66-051d-4228-b6a1-c032cf7768ee\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") "
Jul 17 21:37:00.379349 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.379270    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9bc6\" (UniqueName: \"kubernetes.io/projected/6b234c66-051d-4228-b6a1-c032cf7768ee-kube-api-access-p9bc6\") pod \"6b234c66-051d-4228-b6a1-c032cf7768ee\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") "
Jul 17 21:37:00.379349 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.379313    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-home\") pod \"6b234c66-051d-4228-b6a1-c032cf7768ee\" (UID: \"6b234c66-051d-4228-b6a1-c032cf7768ee\") "
Jul 17 21:37:00.379612 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.379524    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-model-cache" (OuterVolumeSpecName: "model-cache") pod "6b234c66-051d-4228-b6a1-c032cf7768ee" (UID: "6b234c66-051d-4228-b6a1-c032cf7768ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:37:00.379612 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.379536    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6b234c66-051d-4228-b6a1-c032cf7768ee" (UID: "6b234c66-051d-4228-b6a1-c032cf7768ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:37:00.379686 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.379615    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-home" (OuterVolumeSpecName: "home") pod "6b234c66-051d-4228-b6a1-c032cf7768ee" (UID: "6b234c66-051d-4228-b6a1-c032cf7768ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:37:00.381318 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.381268    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-dshm" (OuterVolumeSpecName: "dshm") pod "6b234c66-051d-4228-b6a1-c032cf7768ee" (UID: "6b234c66-051d-4228-b6a1-c032cf7768ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:37:00.381435 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.381318    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b234c66-051d-4228-b6a1-c032cf7768ee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6b234c66-051d-4228-b6a1-c032cf7768ee" (UID: "6b234c66-051d-4228-b6a1-c032cf7768ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:37:00.381435 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.381383    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b234c66-051d-4228-b6a1-c032cf7768ee-kube-api-access-p9bc6" (OuterVolumeSpecName: "kube-api-access-p9bc6") pod "6b234c66-051d-4228-b6a1-c032cf7768ee" (UID: "6b234c66-051d-4228-b6a1-c032cf7768ee"). InnerVolumeSpecName "kube-api-access-p9bc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:37:00.480452 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.480417    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:37:00.480452 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.480445    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:37:00.480452 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.480457    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:37:00.480696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.480468    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b234c66-051d-4228-b6a1-c032cf7768ee-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:37:00.480696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.480479    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9bc6\" (UniqueName: \"kubernetes.io/projected/6b234c66-051d-4228-b6a1-c032cf7768ee-kube-api-access-p9bc6\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:37:00.480696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:00.480489    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6b234c66-051d-4228-b6a1-c032cf7768ee-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:37:01.285350 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:01.285310    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd" event={"ID":"6b234c66-051d-4228-b6a1-c032cf7768ee","Type":"ContainerDied","Data":"9f2d5a4d64a1bd1ecc3ddb2cfaa6e3141de88e8b9084d10991d682e00e4d6d24"}
Jul 17 21:37:01.285777 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:01.285367    2572 scope.go:117] "RemoveContainer" containerID="a5907b5de72069fd8d54dc8026f49badb40442a2ee35d0cafd81d6631ea9315d"
Jul 17 21:37:01.285777 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:01.285331    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"
Jul 17 21:37:01.301524 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:01.301467    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"]
Jul 17 21:37:01.306644 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:01.306621    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-1f606ba2/e2e-lifecycle-model-1f606ba2-kserve-7f96d795d7-k49vd"]
Jul 17 21:37:03.041347 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:03.041316    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b234c66-051d-4228-b6a1-c032cf7768ee" path="/var/lib/kubelet/pods/6b234c66-051d-4228-b6a1-c032cf7768ee/volumes"
Jul 17 21:37:04.362012 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:04.361967    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:04.462891 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:04.462856    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:21.454191 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:21.454152    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:22.889714 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:22.889682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:28.050459 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:28.050421    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:28.631262 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:28.631225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:43.441006 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:43.440977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:43.497145 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:43.497109    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:43.731562 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:43.731479    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:43.975880 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:43.975847    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:45.005703 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:45.005666    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:45.096564 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:45.096516    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:45.196990 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:45.196938    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:45.900173 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:45.900139    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:46.010418 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:46.010373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:46.126441 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:46.126411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:47.487302 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:47.487244    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:50.772665 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:50.772613    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:53.628601 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:53.628567    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:53.729956 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:53.729920    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:54.301347 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:54.301309    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:37:55.129516 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:37:55.129483    2572 scope.go:117] "RemoveContainer" containerID="4928f6c1f4154adebb2be60f427152b240acfee71953ec4b3718b6918ee890eb"
Jul 17 21:38:01.269406 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:01.269373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:01.407433 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:01.407369    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:01.528123 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:01.528007    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:11.911090 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:11.911055    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:12.011234 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:12.011182    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:12.116732 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:12.116704    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:12.394109 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:12.394077    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:24.282719 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:24.282644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:33.331648 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:33.331612    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:39.696115 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:39.696057    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:39.790543 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:39.790507    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:40.049703 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:40.049596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:40.389101 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:40.389022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:40.745646 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:40.745613    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:43.073865 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.073796    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:43.169375 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.169326    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:43.173289 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.173245    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"]
Jul 17 21:38:43.173725 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.173703    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c03da74-2828-4139-b769-bc9fab7680ac" containerName="maas-api"
Jul 17 21:38:43.173725 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.173724    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c03da74-2828-4139-b769-bc9fab7680ac" containerName="maas-api"
Jul 17 21:38:43.173924 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.173742    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b234c66-051d-4228-b6a1-c032cf7768ee" containerName="main"
Jul 17 21:38:43.173924 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.173748    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b234c66-051d-4228-b6a1-c032cf7768ee" containerName="main"
Jul 17 21:38:43.173924 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.173817    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c03da74-2828-4139-b769-bc9fab7680ac" containerName="maas-api"
Jul 17 21:38:43.173924 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.173825    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b234c66-051d-4228-b6a1-c032cf7768ee" containerName="main"
Jul 17 21:38:43.176921 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.176903    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:43.179086 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.179064    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-b28fb0-serving-cert\""
Jul 17 21:38:43.188711 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.188683    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"]
Jul 17 21:38:43.227383 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.227344    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:43.262377 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.262343    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlt9b\" (UniqueName: \"kubernetes.io/projected/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-kube-api-access-wlt9b\") pod \"maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:43.262545 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.262392    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:43.262545 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.262443    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-maas-api-tls\") pod \"maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:43.363331 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.363214    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlt9b\" (UniqueName: \"kubernetes.io/projected/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-kube-api-access-wlt9b\") pod \"maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:43.363331 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.363263    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:43.363331 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.363327    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-maas-api-tls\") pod \"maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:43.363621 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:38:43.363429    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-serving-cert: secret "maas-api-e2e-inf-a-b28fb0-serving-cert" not found
Jul 17 21:38:43.363621 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:38:43.363489    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-maas-api-tls podName:9e370fe9-0cf5-4b13-a749-3c4b00c3ed33 nodeName:}" failed. No retries permitted until 2026-07-17 21:38:43.863469833 +0000 UTC m=+2091.393378282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-maas-api-tls") pod "maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt" (UID: "9e370fe9-0cf5-4b13-a749-3c4b00c3ed33") : secret "maas-api-e2e-inf-a-b28fb0-serving-cert" not found
Jul 17 21:38:43.363992 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.363972    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-openshift-service-ca\") pod \"maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:43.372450 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.372427    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlt9b\" (UniqueName: \"kubernetes.io/projected/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-kube-api-access-wlt9b\") pod \"maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:43.576587 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.576509    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:43.753893 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.753863    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:43.851379 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.851350    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:43.868600 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.868566    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-maas-api-tls\") pod \"maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:43.870957 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:43.870930    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-maas-api-tls\") pod \"maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:44.089121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:44.089024    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:44.236080 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:44.236054    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"]
Jul 17 21:38:44.238297 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:38:44.238247    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e370fe9_0cf5_4b13_a749_3c4b00c3ed33.slice/crio-39ec541fd205421a14286a41b8f532821004ab79dbc5ece53711eb743e9d8029 WatchSource:0}: Error finding container 39ec541fd205421a14286a41b8f532821004ab79dbc5ece53711eb743e9d8029: Status 404 returned error can't find the container with id 39ec541fd205421a14286a41b8f532821004ab79dbc5ece53711eb743e9d8029
Jul 17 21:38:44.795659 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:44.795627    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt" event={"ID":"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33","Type":"ContainerStarted","Data":"d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11"}
Jul 17 21:38:44.795809 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:44.795693    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:44.795809 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:44.795718    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt" event={"ID":"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33","Type":"ContainerStarted","Data":"39ec541fd205421a14286a41b8f532821004ab79dbc5ece53711eb743e9d8029"}
Jul 17 21:38:44.813325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:44.813251    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt" podStartSLOduration=1.346498953 podStartE2EDuration="1.813235409s" totalImagesPullingTime="466.736456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:38:44.812488686 +0000 UTC m=+2092.342397159" watchObservedRunningTime="2026-07-17 21:38:44.813235409 +0000 UTC m=+2092.343143860"
Jul 17 21:38:47.586754 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:47.586719    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:47.922052 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:47.922010    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:48.212241 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:48.212159    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:48.312233 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:48.312202    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:50.806805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:50.806776    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:38:51.115708 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.115628    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:51.194036 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.193990    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:51.202089 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.202058    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"]
Jul 17 21:38:51.207234 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.207205    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:51.210584 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.210383    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-c2706a-serving-cert\""
Jul 17 21:38:51.226327 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.226298    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"]
Jul 17 21:38:51.277131 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.277097    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:51.338319 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.338268    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:51.338319 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.338325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a9ebfb-3462-414f-be4a-9b2590906b51-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:51.338533 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.338446    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-788tl\" (UniqueName: \"kubernetes.io/projected/42a9ebfb-3462-414f-be4a-9b2590906b51-kube-api-access-788tl\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:51.439229 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.439194    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-788tl\" (UniqueName: \"kubernetes.io/projected/42a9ebfb-3462-414f-be4a-9b2590906b51-kube-api-access-788tl\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:51.439442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.439246    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:51.439442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.439299    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a9ebfb-3462-414f-be4a-9b2590906b51-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:51.439442 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:38:51.439426    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-serving-cert: secret "maas-api-e2e-inf-b-c2706a-serving-cert" not found
Jul 17 21:38:51.439571 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:38:51.439510    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls podName:42a9ebfb-3462-414f-be4a-9b2590906b51 nodeName:}" failed. No retries permitted until 2026-07-17 21:38:51.939490216 +0000 UTC m=+2099.469398649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls") pod "maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr" (UID: "42a9ebfb-3462-414f-be4a-9b2590906b51") : secret "maas-api-e2e-inf-b-c2706a-serving-cert" not found
Jul 17 21:38:51.439935 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.439917    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a9ebfb-3462-414f-be4a-9b2590906b51-openshift-service-ca\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:51.468190 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.468159    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-788tl\" (UniqueName: \"kubernetes.io/projected/42a9ebfb-3462-414f-be4a-9b2590906b51-kube-api-access-788tl\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:51.914903 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.914879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:51.945115 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:51.945070    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:51.945328 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:38:51.945241    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-serving-cert: secret "maas-api-e2e-inf-b-c2706a-serving-cert" not found
Jul 17 21:38:51.945411 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:38:51.945335    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls podName:42a9ebfb-3462-414f-be4a-9b2590906b51 nodeName:}" failed. No retries permitted until 2026-07-17 21:38:52.945313901 +0000 UTC m=+2100.475222354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls") pod "maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr" (UID: "42a9ebfb-3462-414f-be4a-9b2590906b51") : secret "maas-api-e2e-inf-b-c2706a-serving-cert" not found
Jul 17 21:38:52.013572 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:52.013539    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:52.117780 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:52.117745    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:52.955089 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:52.955057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:52.957416 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:52.957391    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls\") pod \"maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:53.022199 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:53.022169    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:53.162806 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:53.162784    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"]
Jul 17 21:38:53.164475 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:38:53.164443    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a9ebfb_3462_414f_be4a_9b2590906b51.slice/crio-f270aac287347a533a7644d4d57b410f920c356b893dc3f1602e6abfa6eb40dc WatchSource:0}: Error finding container f270aac287347a533a7644d4d57b410f920c356b893dc3f1602e6abfa6eb40dc: Status 404 returned error can't find the container with id f270aac287347a533a7644d4d57b410f920c356b893dc3f1602e6abfa6eb40dc
Jul 17 21:38:53.844785 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:53.844688    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr" event={"ID":"42a9ebfb-3462-414f-be4a-9b2590906b51","Type":"ContainerStarted","Data":"30bed1102f0bc81c9f9abab0c97fbf9680970bf1137078476b14e6f7bb6ada4c"}
Jul 17 21:38:53.844785 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:53.844742    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr" event={"ID":"42a9ebfb-3462-414f-be4a-9b2590906b51","Type":"ContainerStarted","Data":"f270aac287347a533a7644d4d57b410f920c356b893dc3f1602e6abfa6eb40dc"}
Jul 17 21:38:53.845016 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:53.844789    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:38:53.862658 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:53.862594    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr" podStartSLOduration=2.489602826 podStartE2EDuration="2.862572216s" totalImagesPullingTime="372.96939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:38:53.860636761 +0000 UTC m=+2101.390545228" watchObservedRunningTime="2026-07-17 21:38:53.862572216 +0000 UTC m=+2101.392480671"
Jul 17 21:38:55.159824 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:55.159796    2572 scope.go:117] "RemoveContainer" containerID="41de52b2af396d8c9e50420afd6d7ccbe5bda712cb99cdb78441003aaa57fc9b"
Jul 17 21:38:55.168193 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:55.168172    2572 scope.go:117] "RemoveContainer" containerID="84e68ecd44f01c7f4c23536c49e3f674c6a1664c7087d0137f9857762ef4e31c"
Jul 17 21:38:55.596727 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:55.596691    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:38:59.861124 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:38:59.861096    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:39:01.705349 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:01.705312    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:39:04.493967 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:04.493927    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:39:04.594760 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:04.594728    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:39:12.819846 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:12.819793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:39:12.920105 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:12.920070    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:39:26.284178 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.284147    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"]
Jul 17 21:39:26.287499 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.287483    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.290769 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.290744    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c2706a\"/\"openshift-service-ca.crt\""
Jul 17 21:39:26.290891 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.290747    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c2706a\"/\"test-model-c2706a-kserve-self-signed-certs\""
Jul 17 21:39:26.290891 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.290826    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c2706a\"/\"kube-root-ca.crt\""
Jul 17 21:39:26.290891 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.290863    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c2706a\"/\"default-dockercfg-rp49n\""
Jul 17 21:39:26.295684 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.295665    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"]
Jul 17 21:39:26.312695 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.312670    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:39:26.345851 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.345831    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b772fd-5da4-4b89-b658-88b256f17ac0-tls-certs\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.345976 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.345860    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-home\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.345976 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.345886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpsr6\" (UniqueName: \"kubernetes.io/projected/74b772fd-5da4-4b89-b658-88b256f17ac0-kube-api-access-mpsr6\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.345976 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.345907    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-tmp-dir\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.346093 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.345976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-model-cache\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.346093 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.346029    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-dshm\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.447349 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.447322    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b772fd-5da4-4b89-b658-88b256f17ac0-tls-certs\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.447516 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.447357    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-home\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.447516 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.447386    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpsr6\" (UniqueName: \"kubernetes.io/projected/74b772fd-5da4-4b89-b658-88b256f17ac0-kube-api-access-mpsr6\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.447516 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.447412    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-tmp-dir\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.447640 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.447577    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-model-cache\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.447640 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.447631    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-dshm\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.447795 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.447776    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-tmp-dir\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.447866 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.447804    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-home\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.447998 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.447979    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-model-cache\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.449661 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.449644    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-dshm\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.449962 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.449935    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b772fd-5da4-4b89-b658-88b256f17ac0-tls-certs\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.455536 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.455514    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpsr6\" (UniqueName: \"kubernetes.io/projected/74b772fd-5da4-4b89-b658-88b256f17ac0-kube-api-access-mpsr6\") pod \"test-model-c2706a-kserve-58c546567-kzjcz\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") " pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.598017 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.597919    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:26.727114 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:26.727090    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"]
Jul 17 21:39:26.729467 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:39:26.729438    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74b772fd_5da4_4b89_b658_88b256f17ac0.slice/crio-d7ab9d6bc8f3a8842765379a07b3128ef2713ecb6bcbf6d2df6a8d42e06c190e WatchSource:0}: Error finding container d7ab9d6bc8f3a8842765379a07b3128ef2713ecb6bcbf6d2df6a8d42e06c190e: Status 404 returned error can't find the container with id d7ab9d6bc8f3a8842765379a07b3128ef2713ecb6bcbf6d2df6a8d42e06c190e
Jul 17 21:39:27.014860 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:27.014822    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz" event={"ID":"74b772fd-5da4-4b89-b658-88b256f17ac0","Type":"ContainerStarted","Data":"89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9"}
Jul 17 21:39:27.015055 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:27.014869    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz" event={"ID":"74b772fd-5da4-4b89-b658-88b256f17ac0","Type":"ContainerStarted","Data":"d7ab9d6bc8f3a8842765379a07b3128ef2713ecb6bcbf6d2df6a8d42e06c190e"}
Jul 17 21:39:27.034659 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:27.034607    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz" podStartSLOduration=1.03459218 podStartE2EDuration="1.03459218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:39:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:39:27.033071474 +0000 UTC m=+2134.562979949" watchObservedRunningTime="2026-07-17 21:39:27.03459218 +0000 UTC m=+2134.564500630"
Jul 17 21:39:36.598058 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:36.598022    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:36.598563 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:36.598108    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:36.609700 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:36.609676    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:37.071687 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:37.071660    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:39:54.397470 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:54.397437    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:39:55.268600 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:55.268568    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"]
Jul 17 21:39:55.290251 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:55.290221    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:39:56.100874 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:56.100836    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:39:56.169037 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:39:56.169005    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:05.800785 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:05.800742    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"]
Jul 17 21:40:05.801373 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:05.801022    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt" podUID="9e370fe9-0cf5-4b13-a749-3c4b00c3ed33" containerName="maas-api" containerID="cri-o://d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11" gracePeriod=30
Jul 17 21:40:05.827673 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:05.827639    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:06.056874 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.056820    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:40:06.194880 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.194841    2572 generic.go:356] "Generic (PLEG): container finished" podID="9e370fe9-0cf5-4b13-a749-3c4b00c3ed33" containerID="d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11" exitCode=0
Jul 17 21:40:06.195076 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.194888    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"
Jul 17 21:40:06.195076 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.194927    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt" event={"ID":"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33","Type":"ContainerDied","Data":"d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11"}
Jul 17 21:40:06.195076 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.194991    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt" event={"ID":"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33","Type":"ContainerDied","Data":"39ec541fd205421a14286a41b8f532821004ab79dbc5ece53711eb743e9d8029"}
Jul 17 21:40:06.195076 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.195020    2572 scope.go:117] "RemoveContainer" containerID="d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11"
Jul 17 21:40:06.202850 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.202829    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlt9b\" (UniqueName: \"kubernetes.io/projected/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-kube-api-access-wlt9b\") pod \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") "
Jul 17 21:40:06.202971 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.202889    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-maas-api-tls\") pod \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") "
Jul 17 21:40:06.203035 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.202998    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-openshift-service-ca\") pod \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\" (UID: \"9e370fe9-0cf5-4b13-a749-3c4b00c3ed33\") "
Jul 17 21:40:06.203385 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.203351    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9e370fe9-0cf5-4b13-a749-3c4b00c3ed33" (UID: "9e370fe9-0cf5-4b13-a749-3c4b00c3ed33"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:40:06.203494 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.203431    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:06.203626 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.203532    2572 scope.go:117] "RemoveContainer" containerID="d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11"
Jul 17 21:40:06.203864 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:40:06.203840    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11\": container with ID starting with d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11 not found: ID does not exist" containerID="d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11"
Jul 17 21:40:06.203960 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.203872    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11"} err="failed to get container status \"d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11\": rpc error: code = NotFound desc = could not find container \"d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11\": container with ID starting with d4f4945bceefe9ac93b4026571481f1b89706043d6d4b8932f65a62ba4225c11 not found: ID does not exist"
Jul 17 21:40:06.204951 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.204925    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9e370fe9-0cf5-4b13-a749-3c4b00c3ed33" (UID: "9e370fe9-0cf5-4b13-a749-3c4b00c3ed33"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:40:06.205027 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.204971    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-kube-api-access-wlt9b" (OuterVolumeSpecName: "kube-api-access-wlt9b") pod "9e370fe9-0cf5-4b13-a749-3c4b00c3ed33" (UID: "9e370fe9-0cf5-4b13-a749-3c4b00c3ed33"). InnerVolumeSpecName "kube-api-access-wlt9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:40:06.304672 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.304641    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlt9b\" (UniqueName: \"kubernetes.io/projected/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-kube-api-access-wlt9b\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:06.304672 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.304668    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:06.517078 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.517047    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"]
Jul 17 21:40:06.523938 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:06.523908    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-b28fb0-57d956b976-tdmtt"]
Jul 17 21:40:07.049178 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:07.049148    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e370fe9-0cf5-4b13-a749-3c4b00c3ed33" path="/var/lib/kubelet/pods/9e370fe9-0cf5-4b13-a749-3c4b00c3ed33/volumes"
Jul 17 21:40:10.287828 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.287789    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz" podUID="74b772fd-5da4-4b89-b658-88b256f17ac0" containerName="main" containerID="cri-o://89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9" gracePeriod=45
Jul 17 21:40:10.501580 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.501542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:10.543118 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.543057    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:40:10.641680 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.641639    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpsr6\" (UniqueName: \"kubernetes.io/projected/74b772fd-5da4-4b89-b658-88b256f17ac0-kube-api-access-mpsr6\") pod \"74b772fd-5da4-4b89-b658-88b256f17ac0\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") "
Jul 17 21:40:10.641880 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.641694    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-home\") pod \"74b772fd-5da4-4b89-b658-88b256f17ac0\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") "
Jul 17 21:40:10.641880 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.641729    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b772fd-5da4-4b89-b658-88b256f17ac0-tls-certs\") pod \"74b772fd-5da4-4b89-b658-88b256f17ac0\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") "
Jul 17 21:40:10.641880 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.641753    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-tmp-dir\") pod \"74b772fd-5da4-4b89-b658-88b256f17ac0\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") "
Jul 17 21:40:10.641880 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.641795    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-model-cache\") pod \"74b772fd-5da4-4b89-b658-88b256f17ac0\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") "
Jul 17 21:40:10.641880 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.641839    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-dshm\") pod \"74b772fd-5da4-4b89-b658-88b256f17ac0\" (UID: \"74b772fd-5da4-4b89-b658-88b256f17ac0\") "
Jul 17 21:40:10.642120 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.641969    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-home" (OuterVolumeSpecName: "home") pod "74b772fd-5da4-4b89-b658-88b256f17ac0" (UID: "74b772fd-5da4-4b89-b658-88b256f17ac0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:40:10.642120 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.641979    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "74b772fd-5da4-4b89-b658-88b256f17ac0" (UID: "74b772fd-5da4-4b89-b658-88b256f17ac0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:40:10.642120 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.642095    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-model-cache" (OuterVolumeSpecName: "model-cache") pod "74b772fd-5da4-4b89-b658-88b256f17ac0" (UID: "74b772fd-5da4-4b89-b658-88b256f17ac0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:40:10.642290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.642121    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:10.642290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.642134    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:10.643963 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.643940    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-dshm" (OuterVolumeSpecName: "dshm") pod "74b772fd-5da4-4b89-b658-88b256f17ac0" (UID: "74b772fd-5da4-4b89-b658-88b256f17ac0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:40:10.644054 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.643970    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74b772fd-5da4-4b89-b658-88b256f17ac0-kube-api-access-mpsr6" (OuterVolumeSpecName: "kube-api-access-mpsr6") pod "74b772fd-5da4-4b89-b658-88b256f17ac0" (UID: "74b772fd-5da4-4b89-b658-88b256f17ac0"). InnerVolumeSpecName "kube-api-access-mpsr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:40:10.644054 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.644031    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74b772fd-5da4-4b89-b658-88b256f17ac0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "74b772fd-5da4-4b89-b658-88b256f17ac0" (UID: "74b772fd-5da4-4b89-b658-88b256f17ac0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:40:10.743248 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.743214    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74b772fd-5da4-4b89-b658-88b256f17ac0-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:10.743248 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.743243    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:10.743248 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.743253    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74b772fd-5da4-4b89-b658-88b256f17ac0-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:10.743530 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.743262    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpsr6\" (UniqueName: \"kubernetes.io/projected/74b772fd-5da4-4b89-b658-88b256f17ac0-kube-api-access-mpsr6\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:10.872294 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:10.872150    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:11.222417 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:11.222377    2572 generic.go:356] "Generic (PLEG): container finished" podID="74b772fd-5da4-4b89-b658-88b256f17ac0" containerID="89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9" exitCode=0
Jul 17 21:40:11.222417 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:11.222418    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"
Jul 17 21:40:11.222654 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:11.222453    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz" event={"ID":"74b772fd-5da4-4b89-b658-88b256f17ac0","Type":"ContainerDied","Data":"89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9"}
Jul 17 21:40:11.222654 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:11.222496    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz" event={"ID":"74b772fd-5da4-4b89-b658-88b256f17ac0","Type":"ContainerDied","Data":"d7ab9d6bc8f3a8842765379a07b3128ef2713ecb6bcbf6d2df6a8d42e06c190e"}
Jul 17 21:40:11.222654 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:11.222513    2572 scope.go:117] "RemoveContainer" containerID="89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9"
Jul 17 21:40:11.231137 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:11.231115    2572 scope.go:117] "RemoveContainer" containerID="89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9"
Jul 17 21:40:11.231428 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:40:11.231406    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9\": container with ID starting with 89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9 not found: ID does not exist" containerID="89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9"
Jul 17 21:40:11.231511 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:11.231439    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9"} err="failed to get container status \"89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9\": rpc error: code = NotFound desc = could not find container \"89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9\": container with ID starting with 89d42db48e9d22d60e18ba401ef26684df0f014c15dd60eae4344e06ce3386b9 not found: ID does not exist"
Jul 17 21:40:11.239918 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:11.239897    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"]
Jul 17 21:40:11.243113 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:11.243093    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c2706a/test-model-c2706a-kserve-58c546567-kzjcz"]
Jul 17 21:40:13.042184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:13.042151    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74b772fd-5da4-4b89-b658-88b256f17ac0" path="/var/lib/kubelet/pods/74b772fd-5da4-4b89-b658-88b256f17ac0/volumes"
Jul 17 21:40:17.098193 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.098155    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:17.197241 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.197213    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:17.399971 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.399890    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:17.612290 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.612248    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:17.732676 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.732641    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"]
Jul 17 21:40:17.733038 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.733024    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74b772fd-5da4-4b89-b658-88b256f17ac0" containerName="main"
Jul 17 21:40:17.733083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.733041    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="74b772fd-5da4-4b89-b658-88b256f17ac0" containerName="main"
Jul 17 21:40:17.733083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.733060    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e370fe9-0cf5-4b13-a749-3c4b00c3ed33" containerName="maas-api"
Jul 17 21:40:17.733083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.733066    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e370fe9-0cf5-4b13-a749-3c4b00c3ed33" containerName="maas-api"
Jul 17 21:40:17.733211 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.733132    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e370fe9-0cf5-4b13-a749-3c4b00c3ed33" containerName="maas-api"
Jul 17 21:40:17.733211 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.733144    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="74b772fd-5da4-4b89-b658-88b256f17ac0" containerName="main"
Jul 17 21:40:17.736520 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.736498    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"
Jul 17 21:40:17.739307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.739268    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:40:17.744604 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.744538    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"]
Jul 17 21:40:17.808834 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.808806    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7664fce1-5232-4bcc-a7e2-95fbfdda5d29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c2706a-llts8\" (UID: \"7664fce1-5232-4bcc-a7e2-95fbfdda5d29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"
Jul 17 21:40:17.909673 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.909644    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7664fce1-5232-4bcc-a7e2-95fbfdda5d29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c2706a-llts8\" (UID: \"7664fce1-5232-4bcc-a7e2-95fbfdda5d29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"
Jul 17 21:40:17.910230 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:17.910211    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7664fce1-5232-4bcc-a7e2-95fbfdda5d29-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-c2706a-llts8\" (UID: \"7664fce1-5232-4bcc-a7e2-95fbfdda5d29\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"
Jul 17 21:40:18.050093 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:18.050013    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"
Jul 17 21:40:18.182033 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:18.182005    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"]
Jul 17 21:40:18.183946 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:40:18.183921    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7664fce1_5232_4bcc_a7e2_95fbfdda5d29.slice/crio-90a187c1f0faa2d62d036553f114f25f84d54f8d53ac9ac0c01c30e35193b23b WatchSource:0}: Error finding container 90a187c1f0faa2d62d036553f114f25f84d54f8d53ac9ac0c01c30e35193b23b: Status 404 returned error can't find the container with id 90a187c1f0faa2d62d036553f114f25f84d54f8d53ac9ac0c01c30e35193b23b
Jul 17 21:40:18.259262 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:18.259220    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8" event={"ID":"7664fce1-5232-4bcc-a7e2-95fbfdda5d29","Type":"ContainerStarted","Data":"90a187c1f0faa2d62d036553f114f25f84d54f8d53ac9ac0c01c30e35193b23b"}
Jul 17 21:40:18.407866 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:18.407833    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:18.508026 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:18.507995    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:19.266156 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:19.266118    2572 generic.go:356] "Generic (PLEG): container finished" podID="7664fce1-5232-4bcc-a7e2-95fbfdda5d29" containerID="57ddc16de0f5a6b74a46fe10fe7115e8d9da4c8aaf185c63cf1de6c7c98b11db" exitCode=0
Jul 17 21:40:19.266574 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:19.266203    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8" event={"ID":"7664fce1-5232-4bcc-a7e2-95fbfdda5d29","Type":"ContainerDied","Data":"57ddc16de0f5a6b74a46fe10fe7115e8d9da4c8aaf185c63cf1de6c7c98b11db"}
Jul 17 21:40:20.422589 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:20.422556    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"
Jul 17 21:40:20.536440 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:20.536358    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7664fce1-5232-4bcc-a7e2-95fbfdda5d29-maas-api-service-ca\") pod \"7664fce1-5232-4bcc-a7e2-95fbfdda5d29\" (UID: \"7664fce1-5232-4bcc-a7e2-95fbfdda5d29\") "
Jul 17 21:40:20.536719 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:20.536695    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7664fce1-5232-4bcc-a7e2-95fbfdda5d29-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7664fce1-5232-4bcc-a7e2-95fbfdda5d29" (UID: "7664fce1-5232-4bcc-a7e2-95fbfdda5d29"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:40:20.637256 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:20.637222    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7664fce1-5232-4bcc-a7e2-95fbfdda5d29-maas-api-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:21.277070 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:21.277036    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"
Jul 17 21:40:21.277246 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:21.277073    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8" event={"ID":"7664fce1-5232-4bcc-a7e2-95fbfdda5d29","Type":"ContainerDied","Data":"90a187c1f0faa2d62d036553f114f25f84d54f8d53ac9ac0c01c30e35193b23b"}
Jul 17 21:40:21.277246 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:21.277126    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90a187c1f0faa2d62d036553f114f25f84d54f8d53ac9ac0c01c30e35193b23b"
Jul 17 21:40:28.114602 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.114561    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"]
Jul 17 21:40:28.115083 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.114791    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr" podUID="42a9ebfb-3462-414f-be4a-9b2590906b51" containerName="maas-api" containerID="cri-o://30bed1102f0bc81c9f9abab0c97fbf9680970bf1137078476b14e6f7bb6ada4c" gracePeriod=30
Jul 17 21:40:28.138977 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.138951    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:28.310714 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.310685    2572 generic.go:356] "Generic (PLEG): container finished" podID="42a9ebfb-3462-414f-be4a-9b2590906b51" containerID="30bed1102f0bc81c9f9abab0c97fbf9680970bf1137078476b14e6f7bb6ada4c" exitCode=0
Jul 17 21:40:28.310891 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.310771    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr" event={"ID":"42a9ebfb-3462-414f-be4a-9b2590906b51","Type":"ContainerDied","Data":"30bed1102f0bc81c9f9abab0c97fbf9680970bf1137078476b14e6f7bb6ada4c"}
Jul 17 21:40:28.363756 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.363733    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:40:28.403179 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.403091    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a9ebfb-3462-414f-be4a-9b2590906b51-openshift-service-ca\") pod \"42a9ebfb-3462-414f-be4a-9b2590906b51\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") "
Jul 17 21:40:28.403370 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.403322    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls\") pod \"42a9ebfb-3462-414f-be4a-9b2590906b51\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") "
Jul 17 21:40:28.403436 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.403368    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-788tl\" (UniqueName: \"kubernetes.io/projected/42a9ebfb-3462-414f-be4a-9b2590906b51-kube-api-access-788tl\") pod \"42a9ebfb-3462-414f-be4a-9b2590906b51\" (UID: \"42a9ebfb-3462-414f-be4a-9b2590906b51\") "
Jul 17 21:40:28.403483 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.403462    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a9ebfb-3462-414f-be4a-9b2590906b51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "42a9ebfb-3462-414f-be4a-9b2590906b51" (UID: "42a9ebfb-3462-414f-be4a-9b2590906b51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:40:28.403625 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.403611    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/42a9ebfb-3462-414f-be4a-9b2590906b51-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:28.405478 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.405437    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "42a9ebfb-3462-414f-be4a-9b2590906b51" (UID: "42a9ebfb-3462-414f-be4a-9b2590906b51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:40:28.405478 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.405468    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42a9ebfb-3462-414f-be4a-9b2590906b51-kube-api-access-788tl" (OuterVolumeSpecName: "kube-api-access-788tl") pod "42a9ebfb-3462-414f-be4a-9b2590906b51" (UID: "42a9ebfb-3462-414f-be4a-9b2590906b51"). InnerVolumeSpecName "kube-api-access-788tl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:40:28.504032 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.503993    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-788tl\" (UniqueName: \"kubernetes.io/projected/42a9ebfb-3462-414f-be4a-9b2590906b51-kube-api-access-788tl\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:28.504032 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:28.504026    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/42a9ebfb-3462-414f-be4a-9b2590906b51-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:40:29.316610 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:29.316518    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr" event={"ID":"42a9ebfb-3462-414f-be4a-9b2590906b51","Type":"ContainerDied","Data":"f270aac287347a533a7644d4d57b410f920c356b893dc3f1602e6abfa6eb40dc"}
Jul 17 21:40:29.316610 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:29.316540    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"
Jul 17 21:40:29.316610 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:29.316575    2572 scope.go:117] "RemoveContainer" containerID="30bed1102f0bc81c9f9abab0c97fbf9680970bf1137078476b14e6f7bb6ada4c"
Jul 17 21:40:29.335883 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:29.335860    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"]
Jul 17 21:40:29.340132 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:29.340112    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-c2706a-574c8d77bd-kg6tr"]
Jul 17 21:40:31.041514 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:31.041485    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42a9ebfb-3462-414f-be4a-9b2590906b51" path="/var/lib/kubelet/pods/42a9ebfb-3462-414f-be4a-9b2590906b51/volumes"
Jul 17 21:40:32.804337 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:32.804301    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"]
Jul 17 21:40:32.807199 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:32.807175    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-c2706a-llts8"]
Jul 17 21:40:32.807774 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:32.807753    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:33.041097 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:33.041059    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7664fce1-5232-4bcc-a7e2-95fbfdda5d29" path="/var/lib/kubelet/pods/7664fce1-5232-4bcc-a7e2-95fbfdda5d29/volumes"
Jul 17 21:40:33.200917 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:33.200888    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:39.536178 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:39.536143    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:39.593996 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:39.593963    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:39.815865 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:39.815772    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:40.033871 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:40.033842    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:40.381065 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:40.381036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:40.691200 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:40.691166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:41.165494 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:41.165469    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:43.796076 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:43.796037    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:43.896617 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:43.896577    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:44.011654 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.011621    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"]
Jul 17 21:40:44.011982 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.011970    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42a9ebfb-3462-414f-be4a-9b2590906b51" containerName="maas-api"
Jul 17 21:40:44.012044 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.011984    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="42a9ebfb-3462-414f-be4a-9b2590906b51" containerName="maas-api"
Jul 17 21:40:44.012044 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.011992    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7664fce1-5232-4bcc-a7e2-95fbfdda5d29" containerName="revoke-keys"
Jul 17 21:40:44.012044 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.011999    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7664fce1-5232-4bcc-a7e2-95fbfdda5d29" containerName="revoke-keys"
Jul 17 21:40:44.012191 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.012054    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="42a9ebfb-3462-414f-be4a-9b2590906b51" containerName="maas-api"
Jul 17 21:40:44.012191 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.012063    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7664fce1-5232-4bcc-a7e2-95fbfdda5d29" containerName="revoke-keys"
Jul 17 21:40:44.016688 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.016669    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.020623 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.020602    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-08c323-serving-cert\""
Jul 17 21:40:44.031005 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.030982    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"]
Jul 17 21:40:44.052372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.052256    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:44.114927 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.114880    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:44.145226 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.145192    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/299376bc-71d3-4edd-bc84-0ad449fea82c-openshift-service-ca\") pod \"maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.145410 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.145234    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdr9d\" (UniqueName: \"kubernetes.io/projected/299376bc-71d3-4edd-bc84-0ad449fea82c-kube-api-access-tdr9d\") pod \"maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.145410 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.145359    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/299376bc-71d3-4edd-bc84-0ad449fea82c-maas-api-tls\") pod \"maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.245983 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.245942    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/299376bc-71d3-4edd-bc84-0ad449fea82c-maas-api-tls\") pod \"maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.246162 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.245997    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/299376bc-71d3-4edd-bc84-0ad449fea82c-openshift-service-ca\") pod \"maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.246162 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.246024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdr9d\" (UniqueName: \"kubernetes.io/projected/299376bc-71d3-4edd-bc84-0ad449fea82c-kube-api-access-tdr9d\") pod \"maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.246713 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.246689    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/299376bc-71d3-4edd-bc84-0ad449fea82c-openshift-service-ca\") pod \"maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.248383 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.248361    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/299376bc-71d3-4edd-bc84-0ad449fea82c-maas-api-tls\") pod \"maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.254856 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.254836    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdr9d\" (UniqueName: \"kubernetes.io/projected/299376bc-71d3-4edd-bc84-0ad449fea82c-kube-api-access-tdr9d\") pod \"maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.329473 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.329396    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:44.467216 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.467193    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"]
Jul 17 21:40:44.469711 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:40:44.469682    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299376bc_71d3_4edd_bc84_0ad449fea82c.slice/crio-5dd5dfca7fae6f4429f924059184f569fea6f38f7cffabe65f095f75a0da70aa WatchSource:0}: Error finding container 5dd5dfca7fae6f4429f924059184f569fea6f38f7cffabe65f095f75a0da70aa: Status 404 returned error can't find the container with id 5dd5dfca7fae6f4429f924059184f569fea6f38f7cffabe65f095f75a0da70aa
Jul 17 21:40:44.471006 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.470988    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:40:44.528620 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.528584    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:44.628954 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:44.628846    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:45.400342 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:45.400231    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h" event={"ID":"299376bc-71d3-4edd-bc84-0ad449fea82c","Type":"ContainerStarted","Data":"431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019"}
Jul 17 21:40:45.400342 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:45.400305    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h" event={"ID":"299376bc-71d3-4edd-bc84-0ad449fea82c","Type":"ContainerStarted","Data":"5dd5dfca7fae6f4429f924059184f569fea6f38f7cffabe65f095f75a0da70aa"}
Jul 17 21:40:45.400767 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:45.400425    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:45.418865 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:45.418818    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h" podStartSLOduration=1.944942872 podStartE2EDuration="2.41880072s" totalImagesPullingTime="473.857848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:40:45.417183149 +0000 UTC m=+2212.947091629" watchObservedRunningTime="2026-07-17 21:40:45.41880072 +0000 UTC m=+2212.948709172"
Jul 17 21:40:48.301541 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:48.301508    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:48.783655 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:48.783621    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:49.091695 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:49.091592    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:49.333878 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:49.333848    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:51.410484 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:51.410455    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:40:51.996029 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:51.995985    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:52.080404 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.080370    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"]
Jul 17 21:40:52.084564 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.084541    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.085803 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.085771    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:52.086787 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.086757    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-5662f7-serving-cert\""
Jul 17 21:40:52.097434 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.097411    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"]
Jul 17 21:40:52.164673 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.164639    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:52.213767 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.213737    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78e3f875-94f1-4174-a11c-575533ed43d1-openshift-service-ca\") pod \"maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.213914 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.213793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78e3f875-94f1-4174-a11c-575533ed43d1-maas-api-tls\") pod \"maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.213914 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.213837    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwpbw\" (UniqueName: \"kubernetes.io/projected/78e3f875-94f1-4174-a11c-575533ed43d1-kube-api-access-gwpbw\") pod \"maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.264504 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.264418    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:52.315182 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.315151    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78e3f875-94f1-4174-a11c-575533ed43d1-openshift-service-ca\") pod \"maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.315377 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.315200    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78e3f875-94f1-4174-a11c-575533ed43d1-maas-api-tls\") pod \"maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.315377 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.315232    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwpbw\" (UniqueName: \"kubernetes.io/projected/78e3f875-94f1-4174-a11c-575533ed43d1-kube-api-access-gwpbw\") pod \"maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.315798 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.315780    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78e3f875-94f1-4174-a11c-575533ed43d1-openshift-service-ca\") pod \"maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.317906 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.317884    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78e3f875-94f1-4174-a11c-575533ed43d1-maas-api-tls\") pod \"maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.323669 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.323636    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwpbw\" (UniqueName: \"kubernetes.io/projected/78e3f875-94f1-4174-a11c-575533ed43d1-kube-api-access-gwpbw\") pod \"maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.396703 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.396671    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:52.551454 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.551307    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"]
Jul 17 21:40:52.556703 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:40:52.556674    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78e3f875_94f1_4174_a11c_575533ed43d1.slice/crio-2525a37a8e115b0f73bd35537e48481b7030979aebbb1e1c5ec26573ec3582b5 WatchSource:0}: Error finding container 2525a37a8e115b0f73bd35537e48481b7030979aebbb1e1c5ec26573ec3582b5: Status 404 returned error can't find the container with id 2525a37a8e115b0f73bd35537e48481b7030979aebbb1e1c5ec26573ec3582b5
Jul 17 21:40:52.822185 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.822095    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:52.924489 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:52.924456    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:53.445090 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:53.445056    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8" event={"ID":"78e3f875-94f1-4174-a11c-575533ed43d1","Type":"ContainerStarted","Data":"aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf"}
Jul 17 21:40:53.445247 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:53.445115    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:40:53.445247 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:53.445132    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8" event={"ID":"78e3f875-94f1-4174-a11c-575533ed43d1","Type":"ContainerStarted","Data":"2525a37a8e115b0f73bd35537e48481b7030979aebbb1e1c5ec26573ec3582b5"}
Jul 17 21:40:53.471265 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:53.471219    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8" podStartSLOduration=1.136494519 podStartE2EDuration="1.471204249s" totalImagesPullingTime="334.70973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:40:53.470377521 +0000 UTC m=+2221.000286001" watchObservedRunningTime="2026-07-17 21:40:53.471204249 +0000 UTC m=+2221.001112701"
Jul 17 21:40:56.382915 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:56.382879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:40:59.456676 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:40:59.456651    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:41:04.337845 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:04.337803    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"]
Jul 17 21:41:04.341439 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:04.341415    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"
Jul 17 21:41:04.344096 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:04.344074    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:41:04.350595 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:04.350575    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"]
Jul 17 21:41:04.419703 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:04.419670    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-08c323-tvn48\" (UID: \"6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"
Jul 17 21:41:04.520392 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:04.520359    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-08c323-tvn48\" (UID: \"6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"
Jul 17 21:41:04.520974 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:04.520953    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-08c323-tvn48\" (UID: \"6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"
Jul 17 21:41:04.653468 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:04.653388    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"
Jul 17 21:41:04.796800 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:04.796765    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"]
Jul 17 21:41:04.799721 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:41:04.799695    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dc0bb8a_6ba6_4ca8_8eda_dfba740c64cb.slice/crio-de722c2c3527d4de5318e736a05f63d5ca092b0fa32c418cda5e5aa6f82ae30b WatchSource:0}: Error finding container de722c2c3527d4de5318e736a05f63d5ca092b0fa32c418cda5e5aa6f82ae30b: Status 404 returned error can't find the container with id de722c2c3527d4de5318e736a05f63d5ca092b0fa32c418cda5e5aa6f82ae30b
Jul 17 21:41:04.979898 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:04.979863    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:05.080035 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:05.080005    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:05.506169 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:05.506136    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48" event={"ID":"6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb","Type":"ContainerStarted","Data":"59c2a1a5d5a8d21638604b74c3dfbbc1beb588ac724fbd4a82c140ccb174ad8b"}
Jul 17 21:41:05.506576 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:05.506193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48" event={"ID":"6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb","Type":"ContainerStarted","Data":"de722c2c3527d4de5318e736a05f63d5ca092b0fa32c418cda5e5aa6f82ae30b"}
Jul 17 21:41:05.525542 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:05.525481    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48" podStartSLOduration=1.52546067 podStartE2EDuration="1.52546067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:41:05.522834711 +0000 UTC m=+2233.052743163" watchObservedRunningTime="2026-07-17 21:41:05.52546067 +0000 UTC m=+2233.055369122"
Jul 17 21:41:06.513544 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:06.513513    2572 generic.go:356] "Generic (PLEG): container finished" podID="6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb" containerID="59c2a1a5d5a8d21638604b74c3dfbbc1beb588ac724fbd4a82c140ccb174ad8b" exitCode=0
Jul 17 21:41:06.513976 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:06.513606    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48" event={"ID":"6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb","Type":"ContainerDied","Data":"59c2a1a5d5a8d21638604b74c3dfbbc1beb588ac724fbd4a82c140ccb174ad8b"}
Jul 17 21:41:07.646418 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:07.646396    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"
Jul 17 21:41:07.750320 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:07.750270    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb-maas-api-service-ca\") pod \"6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb\" (UID: \"6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb\") "
Jul 17 21:41:07.750622 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:07.750597    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb" (UID: "6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:41:07.851137 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:07.851057    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb-maas-api-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:41:08.524844 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:08.524812    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"
Jul 17 21:41:08.525020 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:08.524856    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48" event={"ID":"6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb","Type":"ContainerDied","Data":"de722c2c3527d4de5318e736a05f63d5ca092b0fa32c418cda5e5aa6f82ae30b"}
Jul 17 21:41:08.525020 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:08.524907    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de722c2c3527d4de5318e736a05f63d5ca092b0fa32c418cda5e5aa6f82ae30b"
Jul 17 21:41:13.866846 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:13.866805    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:13.966693 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:13.966623    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:19.388993 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:19.388956    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:19.972359 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:19.972327    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"]
Jul 17 21:41:19.972583 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:19.972559    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h" podUID="299376bc-71d3-4edd-bc84-0ad449fea82c" containerName="maas-api" containerID="cri-o://431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019" gracePeriod=30
Jul 17 21:41:20.019106 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.019053    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:20.222496 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.222427    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:41:20.354985 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.354956    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdr9d\" (UniqueName: \"kubernetes.io/projected/299376bc-71d3-4edd-bc84-0ad449fea82c-kube-api-access-tdr9d\") pod \"299376bc-71d3-4edd-bc84-0ad449fea82c\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") "
Jul 17 21:41:20.354985 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.354990    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/299376bc-71d3-4edd-bc84-0ad449fea82c-openshift-service-ca\") pod \"299376bc-71d3-4edd-bc84-0ad449fea82c\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") "
Jul 17 21:41:20.355236 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.355035    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/299376bc-71d3-4edd-bc84-0ad449fea82c-maas-api-tls\") pod \"299376bc-71d3-4edd-bc84-0ad449fea82c\" (UID: \"299376bc-71d3-4edd-bc84-0ad449fea82c\") "
Jul 17 21:41:20.355430 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.355404    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/299376bc-71d3-4edd-bc84-0ad449fea82c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "299376bc-71d3-4edd-bc84-0ad449fea82c" (UID: "299376bc-71d3-4edd-bc84-0ad449fea82c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:41:20.357177 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.357154    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/299376bc-71d3-4edd-bc84-0ad449fea82c-kube-api-access-tdr9d" (OuterVolumeSpecName: "kube-api-access-tdr9d") pod "299376bc-71d3-4edd-bc84-0ad449fea82c" (UID: "299376bc-71d3-4edd-bc84-0ad449fea82c"). InnerVolumeSpecName "kube-api-access-tdr9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:41:20.357307 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.357209    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/299376bc-71d3-4edd-bc84-0ad449fea82c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "299376bc-71d3-4edd-bc84-0ad449fea82c" (UID: "299376bc-71d3-4edd-bc84-0ad449fea82c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:41:20.455628 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.455598    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/299376bc-71d3-4edd-bc84-0ad449fea82c-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:41:20.455628 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.455629    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/299376bc-71d3-4edd-bc84-0ad449fea82c-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:41:20.456048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.455643    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdr9d\" (UniqueName: \"kubernetes.io/projected/299376bc-71d3-4edd-bc84-0ad449fea82c-kube-api-access-tdr9d\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:41:20.584001 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.583914    2572 generic.go:356] "Generic (PLEG): container finished" podID="299376bc-71d3-4edd-bc84-0ad449fea82c" containerID="431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019" exitCode=0
Jul 17 21:41:20.584001 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.583953    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"
Jul 17 21:41:20.584186 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.583997    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h" event={"ID":"299376bc-71d3-4edd-bc84-0ad449fea82c","Type":"ContainerDied","Data":"431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019"}
Jul 17 21:41:20.584186 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.584055    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h" event={"ID":"299376bc-71d3-4edd-bc84-0ad449fea82c","Type":"ContainerDied","Data":"5dd5dfca7fae6f4429f924059184f569fea6f38f7cffabe65f095f75a0da70aa"}
Jul 17 21:41:20.584186 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.584077    2572 scope.go:117] "RemoveContainer" containerID="431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019"
Jul 17 21:41:20.593206 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.593188    2572 scope.go:117] "RemoveContainer" containerID="431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019"
Jul 17 21:41:20.593491 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:41:20.593473    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019\": container with ID starting with 431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019 not found: ID does not exist" containerID="431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019"
Jul 17 21:41:20.593544 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.593500    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019"} err="failed to get container status \"431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019\": rpc error: code = NotFound desc = could not find container \"431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019\": container with ID starting with 431f64e6ec5624e552d0cb5ae1f166115aa1f521f25a45583c3b52acb9476019 not found: ID does not exist"
Jul 17 21:41:20.607537 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.607514    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"]
Jul 17 21:41:20.615000 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:20.614978    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-08c323-7bcf8d7768-zpb7h"]
Jul 17 21:41:21.045216 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:21.045184    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="299376bc-71d3-4edd-bc84-0ad449fea82c" path="/var/lib/kubelet/pods/299376bc-71d3-4edd-bc84-0ad449fea82c/volumes"
Jul 17 21:41:24.439720 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:24.439690    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"]
Jul 17 21:41:24.441788 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:24.441762    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08c323-tvn48"]
Jul 17 21:41:24.443144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:24.443111    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:24.840966 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:24.840886    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:25.041079 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:25.041044    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb" path="/var/lib/kubelet/pods/6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb/volumes"
Jul 17 21:41:31.253029 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.252997    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:31.353801 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.353769    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:31.554334 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.554237    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:31.784608 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.784579    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:31.935270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.935235    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"]
Jul 17 21:41:31.935814 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.935795    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb" containerName="revoke-keys"
Jul 17 21:41:31.935862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.935818    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb" containerName="revoke-keys"
Jul 17 21:41:31.935862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.935832    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="299376bc-71d3-4edd-bc84-0ad449fea82c" containerName="maas-api"
Jul 17 21:41:31.935862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.935841    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="299376bc-71d3-4edd-bc84-0ad449fea82c" containerName="maas-api"
Jul 17 21:41:31.935955 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.935932    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="299376bc-71d3-4edd-bc84-0ad449fea82c" containerName="maas-api"
Jul 17 21:41:31.935955 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.935946    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dc0bb8a-6ba6-4ca8-8eda-dfba740c64cb" containerName="revoke-keys"
Jul 17 21:41:31.939560 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.939543    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"
Jul 17 21:41:31.942303 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.942260    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:41:31.948790 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:31.948767    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"]
Jul 17 21:41:32.060445 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:32.060415    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af2786d7-4eef-4c95-81be-d1e9728e3435-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5662f7-llqzt\" (UID: \"af2786d7-4eef-4c95-81be-d1e9728e3435\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"
Jul 17 21:41:32.161696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:32.161662    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af2786d7-4eef-4c95-81be-d1e9728e3435-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5662f7-llqzt\" (UID: \"af2786d7-4eef-4c95-81be-d1e9728e3435\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"
Jul 17 21:41:32.162404 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:32.162380    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af2786d7-4eef-4c95-81be-d1e9728e3435-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5662f7-llqzt\" (UID: \"af2786d7-4eef-4c95-81be-d1e9728e3435\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"
Jul 17 21:41:32.251407 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:32.251311    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"
Jul 17 21:41:32.395048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:32.395023    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"]
Jul 17 21:41:32.397339 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:41:32.397308    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf2786d7_4eef_4c95_81be_d1e9728e3435.slice/crio-57b0127cc48cb3b8d6325b0e6f291200b475e1d2b3d16da6106242cf714a341e WatchSource:0}: Error finding container 57b0127cc48cb3b8d6325b0e6f291200b475e1d2b3d16da6106242cf714a341e: Status 404 returned error can't find the container with id 57b0127cc48cb3b8d6325b0e6f291200b475e1d2b3d16da6106242cf714a341e
Jul 17 21:41:32.640809 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:32.640772    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt" event={"ID":"af2786d7-4eef-4c95-81be-d1e9728e3435","Type":"ContainerStarted","Data":"57b0127cc48cb3b8d6325b0e6f291200b475e1d2b3d16da6106242cf714a341e"}
Jul 17 21:41:33.646683 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:33.646647    2572 generic.go:356] "Generic (PLEG): container finished" podID="af2786d7-4eef-4c95-81be-d1e9728e3435" containerID="7312f0915bb69b7053be91b23b78b8cd4422c21941f9aa4da1cbd9d806ee96bf" exitCode=0
Jul 17 21:41:33.647060 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:33.646740    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt" event={"ID":"af2786d7-4eef-4c95-81be-d1e9728e3435","Type":"ContainerDied","Data":"7312f0915bb69b7053be91b23b78b8cd4422c21941f9aa4da1cbd9d806ee96bf"}
Jul 17 21:41:34.782113 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:34.782091    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"
Jul 17 21:41:34.887342 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:34.887310    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af2786d7-4eef-4c95-81be-d1e9728e3435-maas-api-service-ca\") pod \"af2786d7-4eef-4c95-81be-d1e9728e3435\" (UID: \"af2786d7-4eef-4c95-81be-d1e9728e3435\") "
Jul 17 21:41:34.887641 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:34.887620    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af2786d7-4eef-4c95-81be-d1e9728e3435-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "af2786d7-4eef-4c95-81be-d1e9728e3435" (UID: "af2786d7-4eef-4c95-81be-d1e9728e3435"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:41:34.988416 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:34.988383    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af2786d7-4eef-4c95-81be-d1e9728e3435-maas-api-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:41:35.657462 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:35.657436    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"
Jul 17 21:41:35.657657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:35.657473    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt" event={"ID":"af2786d7-4eef-4c95-81be-d1e9728e3435","Type":"ContainerDied","Data":"57b0127cc48cb3b8d6325b0e6f291200b475e1d2b3d16da6106242cf714a341e"}
Jul 17 21:41:35.657657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:35.657518    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57b0127cc48cb3b8d6325b0e6f291200b475e1d2b3d16da6106242cf714a341e"
Jul 17 21:41:47.611437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:47.611402    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"]
Jul 17 21:41:47.611934 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:47.611605    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8" podUID="78e3f875-94f1-4174-a11c-575533ed43d1" containerName="maas-api" containerID="cri-o://aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf" gracePeriod=30
Jul 17 21:41:47.660663 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:47.660634    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:47.860329 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:47.860302    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:41:48.003518 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.003479    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwpbw\" (UniqueName: \"kubernetes.io/projected/78e3f875-94f1-4174-a11c-575533ed43d1-kube-api-access-gwpbw\") pod \"78e3f875-94f1-4174-a11c-575533ed43d1\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") "
Jul 17 21:41:48.003725 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.003581    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78e3f875-94f1-4174-a11c-575533ed43d1-maas-api-tls\") pod \"78e3f875-94f1-4174-a11c-575533ed43d1\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") "
Jul 17 21:41:48.003725 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.003600    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78e3f875-94f1-4174-a11c-575533ed43d1-openshift-service-ca\") pod \"78e3f875-94f1-4174-a11c-575533ed43d1\" (UID: \"78e3f875-94f1-4174-a11c-575533ed43d1\") "
Jul 17 21:41:48.003991 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.003965    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78e3f875-94f1-4174-a11c-575533ed43d1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "78e3f875-94f1-4174-a11c-575533ed43d1" (UID: "78e3f875-94f1-4174-a11c-575533ed43d1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:41:48.005638 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.005610    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78e3f875-94f1-4174-a11c-575533ed43d1-kube-api-access-gwpbw" (OuterVolumeSpecName: "kube-api-access-gwpbw") pod "78e3f875-94f1-4174-a11c-575533ed43d1" (UID: "78e3f875-94f1-4174-a11c-575533ed43d1"). InnerVolumeSpecName "kube-api-access-gwpbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:41:48.005719 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.005697    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78e3f875-94f1-4174-a11c-575533ed43d1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "78e3f875-94f1-4174-a11c-575533ed43d1" (UID: "78e3f875-94f1-4174-a11c-575533ed43d1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:41:48.104341 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.104306    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwpbw\" (UniqueName: \"kubernetes.io/projected/78e3f875-94f1-4174-a11c-575533ed43d1-kube-api-access-gwpbw\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:41:48.104341 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.104338    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78e3f875-94f1-4174-a11c-575533ed43d1-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:41:48.104341 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.104347    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78e3f875-94f1-4174-a11c-575533ed43d1-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:41:48.721696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.721662    2572 generic.go:356] "Generic (PLEG): container finished" podID="78e3f875-94f1-4174-a11c-575533ed43d1" containerID="aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf" exitCode=0
Jul 17 21:41:48.721696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.721702    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"
Jul 17 21:41:48.722253 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.721748    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8" event={"ID":"78e3f875-94f1-4174-a11c-575533ed43d1","Type":"ContainerDied","Data":"aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf"}
Jul 17 21:41:48.722253 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.721796    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8" event={"ID":"78e3f875-94f1-4174-a11c-575533ed43d1","Type":"ContainerDied","Data":"2525a37a8e115b0f73bd35537e48481b7030979aebbb1e1c5ec26573ec3582b5"}
Jul 17 21:41:48.722253 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.721818    2572 scope.go:117] "RemoveContainer" containerID="aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf"
Jul 17 21:41:48.731210 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.731194    2572 scope.go:117] "RemoveContainer" containerID="aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf"
Jul 17 21:41:48.731467 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:41:48.731448    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf\": container with ID starting with aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf not found: ID does not exist" containerID="aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf"
Jul 17 21:41:48.731524 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.731475    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf"} err="failed to get container status \"aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf\": rpc error: code = NotFound desc = could not find container \"aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf\": container with ID starting with aa71ae8498fcf1b2004f5b5f990d4bcd6b82b456510943b66a092c0a2b8350cf not found: ID does not exist"
Jul 17 21:41:48.749123 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.749093    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"]
Jul 17 21:41:48.754414 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:48.754387    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-5662f7-5d85b6b8c8-js9q8"]
Jul 17 21:41:49.041172 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:49.041090    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78e3f875-94f1-4174-a11c-575533ed43d1" path="/var/lib/kubelet/pods/78e3f875-94f1-4174-a11c-575533ed43d1/volumes"
Jul 17 21:41:52.013461 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:52.013425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:52.013851 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:52.013516    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"]
Jul 17 21:41:52.016437 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:52.016413    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5662f7-llqzt"]
Jul 17 21:41:52.398465 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:52.398381    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:53.041515 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:53.041486    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af2786d7-4eef-4c95-81be-d1e9728e3435" path="/var/lib/kubelet/pods/af2786d7-4eef-4c95-81be-d1e9728e3435/volumes"
Jul 17 21:41:55.213805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:55.213773    2572 scope.go:117] "RemoveContainer" containerID="bf410df5a080e3b0b12744fad1110125bd3309ca2626fea2a674af0840e1f466"
Jul 17 21:41:58.511724 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:58.511692    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:58.568696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:58.568664    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:58.777185 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:58.777105    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:59.006410 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:59.006378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:59.368328 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:59.368297    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:41:59.683303 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:41:59.683256    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:00.015153 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:00.015073    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:02.339134 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.339101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:02.444420 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.444378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:02.493485 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.493450    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"]
Jul 17 21:42:02.493803 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.493792    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2786d7-4eef-4c95-81be-d1e9728e3435" containerName="revoke-keys"
Jul 17 21:42:02.493847 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.493805    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2786d7-4eef-4c95-81be-d1e9728e3435" containerName="revoke-keys"
Jul 17 21:42:02.493847 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.493828    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78e3f875-94f1-4174-a11c-575533ed43d1" containerName="maas-api"
Jul 17 21:42:02.493847 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.493833    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="78e3f875-94f1-4174-a11c-575533ed43d1" containerName="maas-api"
Jul 17 21:42:02.493945 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.493888    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2786d7-4eef-4c95-81be-d1e9728e3435" containerName="revoke-keys"
Jul 17 21:42:02.493945 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.493895    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="78e3f875-94f1-4174-a11c-575533ed43d1" containerName="maas-api"
Jul 17 21:42:02.496808 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.496788    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:02.499288 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.499260    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-f631c8-serving-cert\""
Jul 17 21:42:02.514762 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.514718    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"]
Jul 17 21:42:02.601572 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.601493    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:02.628237 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.628203    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-maas-api-tls\") pod \"maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:02.628237 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.628238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:02.628463 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.628261    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnhl4\" (UniqueName: \"kubernetes.io/projected/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-kube-api-access-lnhl4\") pod \"maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:02.729189 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.729148    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-maas-api-tls\") pod \"maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:02.729189 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.729187    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:02.729454 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.729208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnhl4\" (UniqueName: \"kubernetes.io/projected/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-kube-api-access-lnhl4\") pod \"maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:02.729454 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:42:02.729338    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-serving-cert: secret "maas-api-e2e-shared-a-f631c8-serving-cert" not found
Jul 17 21:42:02.729454 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:42:02.729417    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-maas-api-tls podName:0aa5ba55-f9f3-4be1-8ee5-65376abf4f17 nodeName:}" failed. No retries permitted until 2026-07-17 21:42:03.229395602 +0000 UTC m=+2290.759304037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-maas-api-tls") pod "maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4" (UID: "0aa5ba55-f9f3-4be1-8ee5-65376abf4f17") : secret "maas-api-e2e-shared-a-f631c8-serving-cert" not found
Jul 17 21:42:02.729843 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.729823    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:02.738023 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.738002    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnhl4\" (UniqueName: \"kubernetes.io/projected/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-kube-api-access-lnhl4\") pod \"maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:02.996799 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:02.996758    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:03.212821 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:03.212784    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:03.234796 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:03.234766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-maas-api-tls\") pod \"maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:03.237319 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:03.237289    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-maas-api-tls\") pod \"maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:03.307867 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:03.307787    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:03.406033 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:03.406003    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:03.543066 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:03.543039    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"]
Jul 17 21:42:03.546674 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:42:03.546646    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aa5ba55_f9f3_4be1_8ee5_65376abf4f17.slice/crio-366b104410e2d50380ae21369d32ba3a518f04d9437b6354068c1b4e3710ec2b WatchSource:0}: Error finding container 366b104410e2d50380ae21369d32ba3a518f04d9437b6354068c1b4e3710ec2b: Status 404 returned error can't find the container with id 366b104410e2d50380ae21369d32ba3a518f04d9437b6354068c1b4e3710ec2b
Jul 17 21:42:03.800094 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:03.800058    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4" event={"ID":"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17","Type":"ContainerStarted","Data":"366b104410e2d50380ae21369d32ba3a518f04d9437b6354068c1b4e3710ec2b"}
Jul 17 21:42:04.806344 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:04.806310    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4" event={"ID":"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17","Type":"ContainerStarted","Data":"6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad"}
Jul 17 21:42:04.806724 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:04.806377    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:04.825055 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:04.825008    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4" podStartSLOduration=2.3824884920000002 podStartE2EDuration="2.824993325s" totalImagesPullingTime="442.504833ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:42:04.824207165 +0000 UTC m=+2292.354115636" watchObservedRunningTime="2026-07-17 21:42:04.824993325 +0000 UTC m=+2292.354901775"
Jul 17 21:42:06.863767 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:06.863730    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:07.249617 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:07.249591    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:07.606004 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:07.605915    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:07.982963 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:07.982928    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:10.503389 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.503348    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:10.603121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.603085    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:10.692250 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.692217    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"]
Jul 17 21:42:10.697254 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.697236    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:10.699855 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.699831    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-d5e469-serving-cert\""
Jul 17 21:42:10.706209 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.706185    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"]
Jul 17 21:42:10.735824 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.735787    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:10.800212 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.800129    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a59d0fd3-e450-4e97-a684-dd7c3986f411-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:10.800212 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.800180    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a59d0fd3-e450-4e97-a684-dd7c3986f411-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:10.800420 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.800238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh6fs\" (UniqueName: \"kubernetes.io/projected/a59d0fd3-e450-4e97-a684-dd7c3986f411-kube-api-access-lh6fs\") pod \"maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:10.815805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.815780    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:42:10.895024 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.894993    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:10.901176 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.901155    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a59d0fd3-e450-4e97-a684-dd7c3986f411-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:10.901296 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.901198    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a59d0fd3-e450-4e97-a684-dd7c3986f411-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:10.901378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.901359    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh6fs\" (UniqueName: \"kubernetes.io/projected/a59d0fd3-e450-4e97-a684-dd7c3986f411-kube-api-access-lh6fs\") pod \"maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:10.901870 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.901851    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a59d0fd3-e450-4e97-a684-dd7c3986f411-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:10.903576 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.903558    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a59d0fd3-e450-4e97-a684-dd7c3986f411-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:10.911888 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:10.911866    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh6fs\" (UniqueName: \"kubernetes.io/projected/a59d0fd3-e450-4e97-a684-dd7c3986f411-kube-api-access-lh6fs\") pod \"maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:11.008804 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:11.008766    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:11.154710 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:11.154689    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"]
Jul 17 21:42:11.157257 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:42:11.157227    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59d0fd3_e450_4e97_a684_dd7c3986f411.slice/crio-a6b6c5ffcd8ee005a3eee4c9ec5fff11fa89ea7d416a26d2ef8b3193df801ab5 WatchSource:0}: Error finding container a6b6c5ffcd8ee005a3eee4c9ec5fff11fa89ea7d416a26d2ef8b3193df801ab5: Status 404 returned error can't find the container with id a6b6c5ffcd8ee005a3eee4c9ec5fff11fa89ea7d416a26d2ef8b3193df801ab5
Jul 17 21:42:11.496442 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:11.496400    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:11.597012 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:11.596985    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:11.844616 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:11.844523    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f" event={"ID":"a59d0fd3-e450-4e97-a684-dd7c3986f411","Type":"ContainerStarted","Data":"2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e"}
Jul 17 21:42:11.844616 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:11.844584    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f" event={"ID":"a59d0fd3-e450-4e97-a684-dd7c3986f411","Type":"ContainerStarted","Data":"a6b6c5ffcd8ee005a3eee4c9ec5fff11fa89ea7d416a26d2ef8b3193df801ab5"}
Jul 17 21:42:11.844833 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:11.844721    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:11.887244 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:11.887187    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f" podStartSLOduration=1.494876914 podStartE2EDuration="1.887168826s" totalImagesPullingTime="392.291912ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:42:11.887168778 +0000 UTC m=+2299.417077248" watchObservedRunningTime="2026-07-17 21:42:11.887168826 +0000 UTC m=+2299.417077279"
Jul 17 21:42:14.964920 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:14.964884    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:17.855475 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:17.855444    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:42:24.021542 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:24.021509    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:24.121196 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:24.121167    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:32.310440 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:32.310403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:32.410143 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:32.410110    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:34.188526 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.188493    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"]
Jul 17 21:42:34.192042 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.192023    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.194397 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.194376    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f631c8\"/\"openshift-service-ca.crt\""
Jul 17 21:42:34.195403 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.195361    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f631c8\"/\"default-dockercfg-tlkgv\""
Jul 17 21:42:34.195403 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.195371    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f631c8\"/\"auth-test-model-f631c8-kserve-self-signed-certs\""
Jul 17 21:42:34.195403 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.195365    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-f631c8\"/\"kube-root-ca.crt\""
Jul 17 21:42:34.201011 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.200987    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"]
Jul 17 21:42:34.269048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.269017    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:42:34.299203 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.299173    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-dshm\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.299400 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.299207    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c912e64d-6da0-455b-8d73-0ff80a451b9c-tls-certs\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.299400 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.299244    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-model-cache\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.299400 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.299302    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-tmp-dir\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.299400 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.299346    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-home\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.299561 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.299414    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfnzr\" (UniqueName: \"kubernetes.io/projected/c912e64d-6da0-455b-8d73-0ff80a451b9c-kube-api-access-bfnzr\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.400329 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.400299    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-home\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.400525 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.400355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfnzr\" (UniqueName: \"kubernetes.io/projected/c912e64d-6da0-455b-8d73-0ff80a451b9c-kube-api-access-bfnzr\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.400525 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.400389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-dshm\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.400525 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.400407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c912e64d-6da0-455b-8d73-0ff80a451b9c-tls-certs\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.400525 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.400432    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-model-cache\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.400525 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.400452    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-tmp-dir\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.400765 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.400690    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-home\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.400810 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.400787    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-model-cache\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.400871 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.400843    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-tmp-dir\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.402681 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.402658    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-dshm\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.402836 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.402819    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c912e64d-6da0-455b-8d73-0ff80a451b9c-tls-certs\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.408194 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.408172    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfnzr\" (UniqueName: \"kubernetes.io/projected/c912e64d-6da0-455b-8d73-0ff80a451b9c-kube-api-access-bfnzr\") pod \"auth-test-model-f631c8-kserve-5989bd8dbc-j88gw\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") " pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.502037 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.501945    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:34.632016 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.631989    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"]
Jul 17 21:42:34.633573 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:42:34.633548    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc912e64d_6da0_455b_8d73_0ff80a451b9c.slice/crio-21f10f072209c740e53c743fe89eefc98c25aca29ce4ca655709800925ae9089 WatchSource:0}: Error finding container 21f10f072209c740e53c743fe89eefc98c25aca29ce4ca655709800925ae9089: Status 404 returned error can't find the container with id 21f10f072209c740e53c743fe89eefc98c25aca29ce4ca655709800925ae9089
Jul 17 21:42:34.963800 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.963769    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw" event={"ID":"c912e64d-6da0-455b-8d73-0ff80a451b9c","Type":"ContainerStarted","Data":"af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798"}
Jul 17 21:42:34.963800 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.963805    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw" event={"ID":"c912e64d-6da0-455b-8d73-0ff80a451b9c","Type":"ContainerStarted","Data":"21f10f072209c740e53c743fe89eefc98c25aca29ce4ca655709800925ae9089"}
Jul 17 21:42:34.982378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:34.982333    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw" podStartSLOduration=0.982315635 podStartE2EDuration="982.315635ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:42:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:42:34.981338286 +0000 UTC m=+2322.511246757" watchObservedRunningTime="2026-07-17 21:42:34.982315635 +0000 UTC m=+2322.512224086"
Jul 17 21:42:44.502124 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:44.502039    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:44.502124 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:44.502093    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:44.513853 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:44.513831    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:45.022140 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:45.022106    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:42:54.931110 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:42:54.931056    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:43:12.776573 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:43:12.776541    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:43:12.878270 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:43:12.878232    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:43:23.111415 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:43:23.111348    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:44:39.288082 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:44:39.287999    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:44:50.682819 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:44:50.682782    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:44:50.742524 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:44:50.742495    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:44:51.835673 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:44:51.835640    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"]
Jul 17 21:44:51.852557 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:44:51.852531    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:44:52.700701 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:44:52.700670    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:45:00.143599 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:00.143571    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp"]
Jul 17 21:45:00.149510 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:00.149492    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp"
Jul 17 21:45:00.151675 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:00.151648    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:45:00.156055 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:00.155450    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp"]
Jul 17 21:45:00.161714 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:00.161698    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp"
Jul 17 21:45:00.301460 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:00.301437    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp"]
Jul 17 21:45:00.303750 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:45:00.303720    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f5613f_2214_4b21_a8f8_00784f8f08ea.slice/crio-70a64ee59ad728e355f9198fc3d88f8e131b0abefd656687cc8972bcc25c3c94 WatchSource:0}: Error finding container 70a64ee59ad728e355f9198fc3d88f8e131b0abefd656687cc8972bcc25c3c94: Status 404 returned error can't find the container with id 70a64ee59ad728e355f9198fc3d88f8e131b0abefd656687cc8972bcc25c3c94
Jul 17 21:45:00.673158 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:00.673123    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp" event={"ID":"e7f5613f-2214-4b21-a8f8-00784f8f08ea","Type":"ContainerStarted","Data":"88ddd5b2a4c2b4aee997ce1bee7b28b6e6dee68eb9c0cdc9f591d38651fdcf93"}
Jul 17 21:45:00.673355 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:00.673172    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp" event={"ID":"e7f5613f-2214-4b21-a8f8-00784f8f08ea","Type":"ContainerStarted","Data":"70a64ee59ad728e355f9198fc3d88f8e131b0abefd656687cc8972bcc25c3c94"}
Jul 17 21:45:00.689310 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:00.689242    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp" podStartSLOduration=0.689228762 podStartE2EDuration="689.228762ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:00.688595909 +0000 UTC m=+2468.218504351" watchObservedRunningTime="2026-07-17 21:45:00.689228762 +0000 UTC m=+2468.219137213"
Jul 17 21:45:01.678765 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:01.678732    2572 generic.go:356] "Generic (PLEG): container finished" podID="e7f5613f-2214-4b21-a8f8-00784f8f08ea" containerID="88ddd5b2a4c2b4aee997ce1bee7b28b6e6dee68eb9c0cdc9f591d38651fdcf93" exitCode=0
Jul 17 21:45:01.679116 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:01.678817    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp" event={"ID":"e7f5613f-2214-4b21-a8f8-00784f8f08ea","Type":"ContainerDied","Data":"88ddd5b2a4c2b4aee997ce1bee7b28b6e6dee68eb9c0cdc9f591d38651fdcf93"}
Jul 17 21:45:02.695862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:02.695831    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:45:02.797027 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:02.797001    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:45:02.814285 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:02.814260    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp"
Jul 17 21:45:03.688623 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:03.688598    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp"
Jul 17 21:45:03.688810 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:03.688634    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp" event={"ID":"e7f5613f-2214-4b21-a8f8-00784f8f08ea","Type":"ContainerDied","Data":"70a64ee59ad728e355f9198fc3d88f8e131b0abefd656687cc8972bcc25c3c94"}
Jul 17 21:45:03.688810 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:03.688689    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70a64ee59ad728e355f9198fc3d88f8e131b0abefd656687cc8972bcc25c3c94"
Jul 17 21:45:04.279053 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.279019    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"]
Jul 17 21:45:04.279479 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.279403    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f5613f-2214-4b21-a8f8-00784f8f08ea" containerName="cleanup"
Jul 17 21:45:04.279479 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.279414    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f5613f-2214-4b21-a8f8-00784f8f08ea" containerName="cleanup"
Jul 17 21:45:04.279479 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.279481    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f5613f-2214-4b21-a8f8-00784f8f08ea" containerName="cleanup"
Jul 17 21:45:04.281606 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.281591    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.283951 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.283930    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f631c8\"/\"sub-test-model-f631c8-kserve-self-signed-certs\""
Jul 17 21:45:04.290643 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.290617    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"]
Jul 17 21:45:04.398346 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.398303    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:45:04.437178 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.437144    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnsj9\" (UniqueName: \"kubernetes.io/projected/79d9f2ce-59fa-4b44-8875-320e280a6195-kube-api-access-jnsj9\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.437393 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.437185    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-home\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.437393 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.437213    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79d9f2ce-59fa-4b44-8875-320e280a6195-tls-certs\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.437393 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.437311    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-model-cache\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.437393 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.437364    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-dshm\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.437553 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.437444    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-tmp-dir\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.538943 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.538862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-dshm\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.538943 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.538901    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-tmp-dir\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.539175 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.538969    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnsj9\" (UniqueName: \"kubernetes.io/projected/79d9f2ce-59fa-4b44-8875-320e280a6195-kube-api-access-jnsj9\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.539175 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.538991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-home\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.539175 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.539009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79d9f2ce-59fa-4b44-8875-320e280a6195-tls-certs\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.539175 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.539049    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-model-cache\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.539431 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.539410    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-tmp-dir\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.539492 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.539468    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-home\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.539492 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.539482    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-model-cache\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.541144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.541123    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-dshm\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.541311 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.541294    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79d9f2ce-59fa-4b44-8875-320e280a6195-tls-certs\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.549487 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.549462    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnsj9\" (UniqueName: \"kubernetes.io/projected/79d9f2ce-59fa-4b44-8875-320e280a6195-kube-api-access-jnsj9\") pod \"sub-test-model-f631c8-kserve-5b76b7c77-c78c2\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") " pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.591094 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.591066    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:04.725956 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:04.725920    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"]
Jul 17 21:45:04.728020 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:45:04.727988    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79d9f2ce_59fa_4b44_8875_320e280a6195.slice/crio-26018f80d39ee4d7d61f46990c8c263a09831fad74a0a214f2ba100a7aba5de5 WatchSource:0}: Error finding container 26018f80d39ee4d7d61f46990c8c263a09831fad74a0a214f2ba100a7aba5de5: Status 404 returned error can't find the container with id 26018f80d39ee4d7d61f46990c8c263a09831fad74a0a214f2ba100a7aba5de5
Jul 17 21:45:05.706599 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:05.706559    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2" event={"ID":"79d9f2ce-59fa-4b44-8875-320e280a6195","Type":"ContainerStarted","Data":"fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3"}
Jul 17 21:45:05.706599 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:05.706605    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2" event={"ID":"79d9f2ce-59fa-4b44-8875-320e280a6195","Type":"ContainerStarted","Data":"26018f80d39ee4d7d61f46990c8c263a09831fad74a0a214f2ba100a7aba5de5"}
Jul 17 21:45:05.724232 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:05.724186    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2" podStartSLOduration=1.724172743 podStartE2EDuration="1.724172743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:45:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:45:05.723631756 +0000 UTC m=+2473.253540208" watchObservedRunningTime="2026-07-17 21:45:05.724172743 +0000 UTC m=+2473.254081194"
Jul 17 21:45:06.855335 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:06.855293    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw" podUID="c912e64d-6da0-455b-8d73-0ff80a451b9c" containerName="main" containerID="cri-o://af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798" gracePeriod=45
Jul 17 21:45:07.107151 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.107093    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:45:07.265263 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.265231    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-dshm\") pod \"c912e64d-6da0-455b-8d73-0ff80a451b9c\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") "
Jul 17 21:45:07.265263 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.265295    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-model-cache\") pod \"c912e64d-6da0-455b-8d73-0ff80a451b9c\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") "
Jul 17 21:45:07.265491 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.265336    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-home\") pod \"c912e64d-6da0-455b-8d73-0ff80a451b9c\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") "
Jul 17 21:45:07.265491 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.265406    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c912e64d-6da0-455b-8d73-0ff80a451b9c-tls-certs\") pod \"c912e64d-6da0-455b-8d73-0ff80a451b9c\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") "
Jul 17 21:45:07.265491 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.265425    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bfnzr\" (UniqueName: \"kubernetes.io/projected/c912e64d-6da0-455b-8d73-0ff80a451b9c-kube-api-access-bfnzr\") pod \"c912e64d-6da0-455b-8d73-0ff80a451b9c\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") "
Jul 17 21:45:07.265491 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.265462    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-tmp-dir\") pod \"c912e64d-6da0-455b-8d73-0ff80a451b9c\" (UID: \"c912e64d-6da0-455b-8d73-0ff80a451b9c\") "
Jul 17 21:45:07.265697 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.265558    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-model-cache" (OuterVolumeSpecName: "model-cache") pod "c912e64d-6da0-455b-8d73-0ff80a451b9c" (UID: "c912e64d-6da0-455b-8d73-0ff80a451b9c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:45:07.265761 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.265690    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-home" (OuterVolumeSpecName: "home") pod "c912e64d-6da0-455b-8d73-0ff80a451b9c" (UID: "c912e64d-6da0-455b-8d73-0ff80a451b9c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:45:07.265761 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.265706    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c912e64d-6da0-455b-8d73-0ff80a451b9c" (UID: "c912e64d-6da0-455b-8d73-0ff80a451b9c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:45:07.265761 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.265750    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:45:07.267483 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.267463    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-dshm" (OuterVolumeSpecName: "dshm") pod "c912e64d-6da0-455b-8d73-0ff80a451b9c" (UID: "c912e64d-6da0-455b-8d73-0ff80a451b9c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:45:07.267599 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.267540    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c912e64d-6da0-455b-8d73-0ff80a451b9c-kube-api-access-bfnzr" (OuterVolumeSpecName: "kube-api-access-bfnzr") pod "c912e64d-6da0-455b-8d73-0ff80a451b9c" (UID: "c912e64d-6da0-455b-8d73-0ff80a451b9c"). InnerVolumeSpecName "kube-api-access-bfnzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:45:07.267648 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.267636    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c912e64d-6da0-455b-8d73-0ff80a451b9c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c912e64d-6da0-455b-8d73-0ff80a451b9c" (UID: "c912e64d-6da0-455b-8d73-0ff80a451b9c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:45:07.367111 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.367032    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c912e64d-6da0-455b-8d73-0ff80a451b9c-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:45:07.367111 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.367061    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bfnzr\" (UniqueName: \"kubernetes.io/projected/c912e64d-6da0-455b-8d73-0ff80a451b9c-kube-api-access-bfnzr\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:45:07.367111 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.367073    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:45:07.367111 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.367081    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:45:07.367111 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.367088    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c912e64d-6da0-455b-8d73-0ff80a451b9c-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:45:07.718027 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.717998    2572 generic.go:356] "Generic (PLEG): container finished" podID="c912e64d-6da0-455b-8d73-0ff80a451b9c" containerID="af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798" exitCode=0
Jul 17 21:45:07.718200 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.718039    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"
Jul 17 21:45:07.718200 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.718073    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw" event={"ID":"c912e64d-6da0-455b-8d73-0ff80a451b9c","Type":"ContainerDied","Data":"af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798"}
Jul 17 21:45:07.718200 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.718104    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw" event={"ID":"c912e64d-6da0-455b-8d73-0ff80a451b9c","Type":"ContainerDied","Data":"21f10f072209c740e53c743fe89eefc98c25aca29ce4ca655709800925ae9089"}
Jul 17 21:45:07.718200 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.718120    2572 scope.go:117] "RemoveContainer" containerID="af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798"
Jul 17 21:45:07.728076 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.728057    2572 scope.go:117] "RemoveContainer" containerID="af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798"
Jul 17 21:45:07.728353 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:45:07.728327    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798\": container with ID starting with af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798 not found: ID does not exist" containerID="af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798"
Jul 17 21:45:07.728421 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.728363    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798"} err="failed to get container status \"af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798\": rpc error: code = NotFound desc = could not find container \"af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798\": container with ID starting with af86e3f39a7295b86e5a2d2032630e12765126c12169831d0e2dc859ba912798 not found: ID does not exist"
Jul 17 21:45:07.739631 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.739612    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"]
Jul 17 21:45:07.743452 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:07.743430    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/auth-test-model-f631c8-kserve-5989bd8dbc-j88gw"]
Jul 17 21:45:09.042422 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:09.042385    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c912e64d-6da0-455b-8d73-0ff80a451b9c" path="/var/lib/kubelet/pods/c912e64d-6da0-455b-8d73-0ff80a451b9c/volumes"
Jul 17 21:45:14.591479 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:14.591427    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:14.591993 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:14.591575    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:14.603732 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:14.603702    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:14.765595 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:14.765569    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:45:22.216002 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:22.215970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:45:50.735883 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:45:50.735807    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:46:02.511574 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:02.511534    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"]
Jul 17 21:46:02.520240 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:02.520210    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:46:03.616647 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:03.616614    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:46:14.476401 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.476369    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"]
Jul 17 21:46:14.476863 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.476840    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c912e64d-6da0-455b-8d73-0ff80a451b9c" containerName="main"
Jul 17 21:46:14.476916 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.476868    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c912e64d-6da0-455b-8d73-0ff80a451b9c" containerName="main"
Jul 17 21:46:14.476962 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.476953    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c912e64d-6da0-455b-8d73-0ff80a451b9c" containerName="main"
Jul 17 21:46:14.480244 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.480225    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.482528 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.482508    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-f631c8\"/\"rate-test-model-f631c8-kserve-self-signed-certs\""
Jul 17 21:46:14.490693 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.490673    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"]
Jul 17 21:46:14.574759 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.574728    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:46:14.574971 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.574954    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-home\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.575016 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.575000    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8177593-f66c-4a27-b3dd-d6df78b7406d-tls-certs\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.575123 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.575101    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-model-cache\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.575206 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.575152    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-tmp-dir\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.575243 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.575213    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k56f7\" (UniqueName: \"kubernetes.io/projected/b8177593-f66c-4a27-b3dd-d6df78b7406d-kube-api-access-k56f7\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.575303 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.575266    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-dshm\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.676468 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.676440    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8177593-f66c-4a27-b3dd-d6df78b7406d-tls-certs\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.676621 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.676486    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-model-cache\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.676621 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.676508    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-tmp-dir\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.676621 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.676571    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k56f7\" (UniqueName: \"kubernetes.io/projected/b8177593-f66c-4a27-b3dd-d6df78b7406d-kube-api-access-k56f7\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.676741 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.676639    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-dshm\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.676824 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.676801    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-home\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.676972 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.676946    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-model-cache\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.677091 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.676985    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-tmp-dir\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.677218 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.677193    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-home\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.678795 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.678770    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-dshm\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.678955 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.678934    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8177593-f66c-4a27-b3dd-d6df78b7406d-tls-certs\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.685378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.685358    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k56f7\" (UniqueName: \"kubernetes.io/projected/b8177593-f66c-4a27-b3dd-d6df78b7406d-kube-api-access-k56f7\") pod \"rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") " pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.789479 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.789400    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:14.922221 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:14.922192    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"]
Jul 17 21:46:14.924210 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:46:14.924178    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8177593_f66c_4a27_b3dd_d6df78b7406d.slice/crio-578fbfb5528e6a7db7ee7288c751a6447476a644e69192aa16edf5db0cc28a66 WatchSource:0}: Error finding container 578fbfb5528e6a7db7ee7288c751a6447476a644e69192aa16edf5db0cc28a66: Status 404 returned error can't find the container with id 578fbfb5528e6a7db7ee7288c751a6447476a644e69192aa16edf5db0cc28a66
Jul 17 21:46:15.058756 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:15.058673    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt" event={"ID":"b8177593-f66c-4a27-b3dd-d6df78b7406d","Type":"ContainerStarted","Data":"e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28"}
Jul 17 21:46:15.058756 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:15.058713    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt" event={"ID":"b8177593-f66c-4a27-b3dd-d6df78b7406d","Type":"ContainerStarted","Data":"578fbfb5528e6a7db7ee7288c751a6447476a644e69192aa16edf5db0cc28a66"}
Jul 17 21:46:15.075492 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:15.075448    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt" podStartSLOduration=1.075433096 podStartE2EDuration="1.075433096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:46:15.074120026 +0000 UTC m=+2542.604028489" watchObservedRunningTime="2026-07-17 21:46:15.075433096 +0000 UTC m=+2542.605341546"
Jul 17 21:46:17.531598 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.531551    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2" podUID="79d9f2ce-59fa-4b44-8875-320e280a6195" containerName="main" containerID="cri-o://fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3" gracePeriod=45
Jul 17 21:46:17.782568 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.782515    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:46:17.904385 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904352    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnsj9\" (UniqueName: \"kubernetes.io/projected/79d9f2ce-59fa-4b44-8875-320e280a6195-kube-api-access-jnsj9\") pod \"79d9f2ce-59fa-4b44-8875-320e280a6195\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") "
Jul 17 21:46:17.904385 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904387    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-home\") pod \"79d9f2ce-59fa-4b44-8875-320e280a6195\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") "
Jul 17 21:46:17.904581 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904406    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-model-cache\") pod \"79d9f2ce-59fa-4b44-8875-320e280a6195\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") "
Jul 17 21:46:17.904581 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904558    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79d9f2ce-59fa-4b44-8875-320e280a6195-tls-certs\") pod \"79d9f2ce-59fa-4b44-8875-320e280a6195\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") "
Jul 17 21:46:17.904668 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904604    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-tmp-dir\") pod \"79d9f2ce-59fa-4b44-8875-320e280a6195\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") "
Jul 17 21:46:17.904712 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904657    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-home" (OuterVolumeSpecName: "home") pod "79d9f2ce-59fa-4b44-8875-320e280a6195" (UID: "79d9f2ce-59fa-4b44-8875-320e280a6195"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:46:17.904712 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904666    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-model-cache" (OuterVolumeSpecName: "model-cache") pod "79d9f2ce-59fa-4b44-8875-320e280a6195" (UID: "79d9f2ce-59fa-4b44-8875-320e280a6195"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:46:17.904712 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904680    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-dshm\") pod \"79d9f2ce-59fa-4b44-8875-320e280a6195\" (UID: \"79d9f2ce-59fa-4b44-8875-320e280a6195\") "
Jul 17 21:46:17.904864 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904843    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "79d9f2ce-59fa-4b44-8875-320e280a6195" (UID: "79d9f2ce-59fa-4b44-8875-320e280a6195"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:46:17.904974 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904959    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:46:17.905029 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904976    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:46:17.905029 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.904985    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:46:17.906555 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.906523    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79d9f2ce-59fa-4b44-8875-320e280a6195-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "79d9f2ce-59fa-4b44-8875-320e280a6195" (UID: "79d9f2ce-59fa-4b44-8875-320e280a6195"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:46:17.906659 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.906564    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d9f2ce-59fa-4b44-8875-320e280a6195-kube-api-access-jnsj9" (OuterVolumeSpecName: "kube-api-access-jnsj9") pod "79d9f2ce-59fa-4b44-8875-320e280a6195" (UID: "79d9f2ce-59fa-4b44-8875-320e280a6195"). InnerVolumeSpecName "kube-api-access-jnsj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:46:17.906659 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:17.906563    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-dshm" (OuterVolumeSpecName: "dshm") pod "79d9f2ce-59fa-4b44-8875-320e280a6195" (UID: "79d9f2ce-59fa-4b44-8875-320e280a6195"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:46:18.006453 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.006421    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79d9f2ce-59fa-4b44-8875-320e280a6195-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:46:18.006453 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.006446    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79d9f2ce-59fa-4b44-8875-320e280a6195-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:46:18.006453 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.006456    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnsj9\" (UniqueName: \"kubernetes.io/projected/79d9f2ce-59fa-4b44-8875-320e280a6195-kube-api-access-jnsj9\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:46:18.073846 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.073764    2572 generic.go:356] "Generic (PLEG): container finished" podID="79d9f2ce-59fa-4b44-8875-320e280a6195" containerID="fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3" exitCode=0
Jul 17 21:46:18.073846 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.073802    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"
Jul 17 21:46:18.074052 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.073851    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2" event={"ID":"79d9f2ce-59fa-4b44-8875-320e280a6195","Type":"ContainerDied","Data":"fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3"}
Jul 17 21:46:18.074052 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.073894    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2" event={"ID":"79d9f2ce-59fa-4b44-8875-320e280a6195","Type":"ContainerDied","Data":"26018f80d39ee4d7d61f46990c8c263a09831fad74a0a214f2ba100a7aba5de5"}
Jul 17 21:46:18.074052 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.073913    2572 scope.go:117] "RemoveContainer" containerID="fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3"
Jul 17 21:46:18.083453 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.083436    2572 scope.go:117] "RemoveContainer" containerID="fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3"
Jul 17 21:46:18.083708 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:46:18.083689    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3\": container with ID starting with fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3 not found: ID does not exist" containerID="fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3"
Jul 17 21:46:18.083751 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.083719    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3"} err="failed to get container status \"fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3\": rpc error: code = NotFound desc = could not find container \"fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3\": container with ID starting with fd0e351b2bef381a3db39dc0a55f00ade07346e4f3d0db8eaaff77d3952db2c3 not found: ID does not exist"
Jul 17 21:46:18.094890 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.094872    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"]
Jul 17 21:46:18.098444 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:18.098426    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/sub-test-model-f631c8-kserve-5b76b7c77-c78c2"]
Jul 17 21:46:19.041471 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:19.041441    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79d9f2ce-59fa-4b44-8875-320e280a6195" path="/var/lib/kubelet/pods/79d9f2ce-59fa-4b44-8875-320e280a6195/volumes"
Jul 17 21:46:24.790255 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:24.790221    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:24.790255 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:24.790267    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:24.802368 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:24.802341    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:25.117372 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:25.117296    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:46:36.208565 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:36.208528    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:46:44.639736 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:44.639695    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:46:55.272865 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:46:55.272831    2572 scope.go:117] "RemoveContainer" containerID="57ddc16de0f5a6b74a46fe10fe7115e8d9da4c8aaf185c63cf1de6c7c98b11db"
Jul 17 21:47:15.657200 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:15.657123    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"]
Jul 17 21:47:15.682591 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:15.682559    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:16.519247 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:16.519212    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:17.478239 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.478205    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7694-140502483708848"]
Jul 17 21:47:17.478623 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.478591    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79d9f2ce-59fa-4b44-8875-320e280a6195" containerName="main"
Jul 17 21:47:17.478623 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.478602    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="79d9f2ce-59fa-4b44-8875-320e280a6195" containerName="main"
Jul 17 21:47:17.478714 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.478690    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="79d9f2ce-59fa-4b44-8875-320e280a6195" containerName="main"
Jul 17 21:47:17.481684 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.481662    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483708848"
Jul 17 21:47:17.484109 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.484092    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z2vnj\""
Jul 17 21:47:17.490420 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.490399    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483708848"]
Jul 17 21:47:17.629090 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.629057    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svcm\" (UniqueName: \"kubernetes.io/projected/bd5fc3a8-b3ef-4842-8514-e031991598ce-kube-api-access-2svcm\") pod \"test-curl-7694-140502483708848\" (UID: \"bd5fc3a8-b3ef-4842-8514-e031991598ce\") " pod="opendatahub/test-curl-7694-140502483708848"
Jul 17 21:47:17.730207 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.730122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svcm\" (UniqueName: \"kubernetes.io/projected/bd5fc3a8-b3ef-4842-8514-e031991598ce-kube-api-access-2svcm\") pod \"test-curl-7694-140502483708848\" (UID: \"bd5fc3a8-b3ef-4842-8514-e031991598ce\") " pod="opendatahub/test-curl-7694-140502483708848"
Jul 17 21:47:17.738662 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.738634    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svcm\" (UniqueName: \"kubernetes.io/projected/bd5fc3a8-b3ef-4842-8514-e031991598ce-kube-api-access-2svcm\") pod \"test-curl-7694-140502483708848\" (UID: \"bd5fc3a8-b3ef-4842-8514-e031991598ce\") " pod="opendatahub/test-curl-7694-140502483708848"
Jul 17 21:47:17.791670 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.791644    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483708848"
Jul 17 21:47:17.923263 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.923241    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483708848"]
Jul 17 21:47:17.925334 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:47:17.925304    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd5fc3a8_b3ef_4842_8514_e031991598ce.slice/crio-a7b01800c0f65af066199f19b2d43531179130fb47431934a998554c55a91a35 WatchSource:0}: Error finding container a7b01800c0f65af066199f19b2d43531179130fb47431934a998554c55a91a35: Status 404 returned error can't find the container with id a7b01800c0f65af066199f19b2d43531179130fb47431934a998554c55a91a35
Jul 17 21:47:17.927142 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:17.927114    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 21:47:18.371265 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:18.371229    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483708848" event={"ID":"bd5fc3a8-b3ef-4842-8514-e031991598ce","Type":"ContainerStarted","Data":"a7b01800c0f65af066199f19b2d43531179130fb47431934a998554c55a91a35"}
Jul 17 21:47:19.378426 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:19.378389    2572 generic.go:356] "Generic (PLEG): container finished" podID="bd5fc3a8-b3ef-4842-8514-e031991598ce" containerID="b51f681b1be2908b42ecea8b3e1ffdf28d347e462d661202e206f39535d853e6" exitCode=0
Jul 17 21:47:19.378803 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:19.378474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483708848" event={"ID":"bd5fc3a8-b3ef-4842-8514-e031991598ce","Type":"ContainerDied","Data":"b51f681b1be2908b42ecea8b3e1ffdf28d347e462d661202e206f39535d853e6"}
Jul 17 21:47:20.508642 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.508618    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483708848"
Jul 17 21:47:20.529072 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.529050    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7694-140502483708848_bd5fc3a8-b3ef-4842-8514-e031991598ce/test-curl-7694-140502483708848/0.log"
Jul 17 21:47:20.564144 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.564117    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7694-140502483708848"]
Jul 17 21:47:20.567753 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.567731    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7694-140502483708848"]
Jul 17 21:47:20.660160 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.660090    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2svcm\" (UniqueName: \"kubernetes.io/projected/bd5fc3a8-b3ef-4842-8514-e031991598ce-kube-api-access-2svcm\") pod \"bd5fc3a8-b3ef-4842-8514-e031991598ce\" (UID: \"bd5fc3a8-b3ef-4842-8514-e031991598ce\") "
Jul 17 21:47:20.662037 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.662011    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd5fc3a8-b3ef-4842-8514-e031991598ce-kube-api-access-2svcm" (OuterVolumeSpecName: "kube-api-access-2svcm") pod "bd5fc3a8-b3ef-4842-8514-e031991598ce" (UID: "bd5fc3a8-b3ef-4842-8514-e031991598ce"). InnerVolumeSpecName "kube-api-access-2svcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:47:20.688478 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.688455    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7694-140502483708720"]
Jul 17 21:47:20.688823 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.688811    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd5fc3a8-b3ef-4842-8514-e031991598ce" containerName="test-curl-7694-140502483708848"
Jul 17 21:47:20.688876 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.688826    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd5fc3a8-b3ef-4842-8514-e031991598ce" containerName="test-curl-7694-140502483708848"
Jul 17 21:47:20.688913 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.688890    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd5fc3a8-b3ef-4842-8514-e031991598ce" containerName="test-curl-7694-140502483708848"
Jul 17 21:47:20.691775 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.691762    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483708720"
Jul 17 21:47:20.698196 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.698169    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483708720"]
Jul 17 21:47:20.761697 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.761667    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqw2\" (UniqueName: \"kubernetes.io/projected/050478d1-54ec-49f4-876f-d24b32b1add3-kube-api-access-8kqw2\") pod \"test-curl-7694-140502483708720\" (UID: \"050478d1-54ec-49f4-876f-d24b32b1add3\") " pod="opendatahub/test-curl-7694-140502483708720"
Jul 17 21:47:20.761865 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.761714    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2svcm\" (UniqueName: \"kubernetes.io/projected/bd5fc3a8-b3ef-4842-8514-e031991598ce-kube-api-access-2svcm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:20.862328 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.862293    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqw2\" (UniqueName: \"kubernetes.io/projected/050478d1-54ec-49f4-876f-d24b32b1add3-kube-api-access-8kqw2\") pod \"test-curl-7694-140502483708720\" (UID: \"050478d1-54ec-49f4-876f-d24b32b1add3\") " pod="opendatahub/test-curl-7694-140502483708720"
Jul 17 21:47:20.871022 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:20.871003    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqw2\" (UniqueName: \"kubernetes.io/projected/050478d1-54ec-49f4-876f-d24b32b1add3-kube-api-access-8kqw2\") pod \"test-curl-7694-140502483708720\" (UID: \"050478d1-54ec-49f4-876f-d24b32b1add3\") " pod="opendatahub/test-curl-7694-140502483708720"
Jul 17 21:47:21.001603 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:21.001560    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483708720"
Jul 17 21:47:21.041885 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:21.041852    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd5fc3a8-b3ef-4842-8514-e031991598ce" path="/var/lib/kubelet/pods/bd5fc3a8-b3ef-4842-8514-e031991598ce/volumes"
Jul 17 21:47:21.132821 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:21.132796    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483708720"]
Jul 17 21:47:21.134766 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:47:21.134740    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod050478d1_54ec_49f4_876f_d24b32b1add3.slice/crio-daab6de81905aad7b7988d035a20ff33c769ffeca492da2e9cd655d4a6c55a43 WatchSource:0}: Error finding container daab6de81905aad7b7988d035a20ff33c769ffeca492da2e9cd655d4a6c55a43: Status 404 returned error can't find the container with id daab6de81905aad7b7988d035a20ff33c769ffeca492da2e9cd655d4a6c55a43
Jul 17 21:47:21.390040 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:21.389958    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483708848"
Jul 17 21:47:21.390040 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:21.389961    2572 scope.go:117] "RemoveContainer" containerID="b51f681b1be2908b42ecea8b3e1ffdf28d347e462d661202e206f39535d853e6"
Jul 17 21:47:21.391358 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:21.391315    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483708720" event={"ID":"050478d1-54ec-49f4-876f-d24b32b1add3","Type":"ContainerStarted","Data":"daab6de81905aad7b7988d035a20ff33c769ffeca492da2e9cd655d4a6c55a43"}
Jul 17 21:47:22.399082 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:22.399050    2572 generic.go:356] "Generic (PLEG): container finished" podID="050478d1-54ec-49f4-876f-d24b32b1add3" containerID="9fcd241d7bd0e1a7544d5e68c529edfa0013e3de444f5b4b1559958b7c4bc31c" exitCode=0
Jul 17 21:47:22.399480 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:22.399138    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483708720" event={"ID":"050478d1-54ec-49f4-876f-d24b32b1add3","Type":"ContainerDied","Data":"9fcd241d7bd0e1a7544d5e68c529edfa0013e3de444f5b4b1559958b7c4bc31c"}
Jul 17 21:47:23.545919 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.545886    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483708720"
Jul 17 21:47:23.564313 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.564263    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7694-140502483708720_050478d1-54ec-49f4-876f-d24b32b1add3/test-curl-7694-140502483708720/0.log"
Jul 17 21:47:23.586350 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.586319    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7694-140502483708720"]
Jul 17 21:47:23.589396 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.589370    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7694-140502483708720"]
Jul 17 21:47:23.687637 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.687613    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kqw2\" (UniqueName: \"kubernetes.io/projected/050478d1-54ec-49f4-876f-d24b32b1add3-kube-api-access-8kqw2\") pod \"050478d1-54ec-49f4-876f-d24b32b1add3\" (UID: \"050478d1-54ec-49f4-876f-d24b32b1add3\") "
Jul 17 21:47:23.689635 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.689609    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/050478d1-54ec-49f4-876f-d24b32b1add3-kube-api-access-8kqw2" (OuterVolumeSpecName: "kube-api-access-8kqw2") pod "050478d1-54ec-49f4-876f-d24b32b1add3" (UID: "050478d1-54ec-49f4-876f-d24b32b1add3"). InnerVolumeSpecName "kube-api-access-8kqw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:47:23.747182 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.747154    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7694-140502483702672"]
Jul 17 21:47:23.747556 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.747543    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="050478d1-54ec-49f4-876f-d24b32b1add3" containerName="test-curl-7694-140502483708720"
Jul 17 21:47:23.747613 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.747558    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="050478d1-54ec-49f4-876f-d24b32b1add3" containerName="test-curl-7694-140502483708720"
Jul 17 21:47:23.747649 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.747619    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="050478d1-54ec-49f4-876f-d24b32b1add3" containerName="test-curl-7694-140502483708720"
Jul 17 21:47:23.750588 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.750575    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:23.756698 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.756677    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483702672"]
Jul 17 21:47:23.788527 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.788498    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kqw2\" (UniqueName: \"kubernetes.io/projected/050478d1-54ec-49f4-876f-d24b32b1add3-kube-api-access-8kqw2\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:23.889921 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.889885    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrgh6\" (UniqueName: \"kubernetes.io/projected/fbd08ffa-82cc-4486-9166-b0f116369b48-kube-api-access-qrgh6\") pod \"test-curl-7694-140502483702672\" (UID: \"fbd08ffa-82cc-4486-9166-b0f116369b48\") " pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:23.991350 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.991251    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrgh6\" (UniqueName: \"kubernetes.io/projected/fbd08ffa-82cc-4486-9166-b0f116369b48-kube-api-access-qrgh6\") pod \"test-curl-7694-140502483702672\" (UID: \"fbd08ffa-82cc-4486-9166-b0f116369b48\") " pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:23.998862 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:23.998838    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrgh6\" (UniqueName: \"kubernetes.io/projected/fbd08ffa-82cc-4486-9166-b0f116369b48-kube-api-access-qrgh6\") pod \"test-curl-7694-140502483702672\" (UID: \"fbd08ffa-82cc-4486-9166-b0f116369b48\") " pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:24.060388 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:24.060357    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:24.189777 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:24.189750    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483702672"]
Jul 17 21:47:24.191980 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:47:24.191954    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfbd08ffa_82cc_4486_9166_b0f116369b48.slice/crio-eb2d85c2cb250706651e10ed56a068519757f8021f0bc32df86415b7effbbc7e WatchSource:0}: Error finding container eb2d85c2cb250706651e10ed56a068519757f8021f0bc32df86415b7effbbc7e: Status 404 returned error can't find the container with id eb2d85c2cb250706651e10ed56a068519757f8021f0bc32df86415b7effbbc7e
Jul 17 21:47:24.410775 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:24.410699    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483708720"
Jul 17 21:47:24.410912 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:24.410698    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daab6de81905aad7b7988d035a20ff33c769ffeca492da2e9cd655d4a6c55a43"
Jul 17 21:47:24.411867 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:24.411840    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483702672" event={"ID":"fbd08ffa-82cc-4486-9166-b0f116369b48","Type":"ContainerStarted","Data":"eb2d85c2cb250706651e10ed56a068519757f8021f0bc32df86415b7effbbc7e"}
Jul 17 21:47:24.420409 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:47:24.420382    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7694-140502483708720\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="050478d1-54ec-49f4-876f-d24b32b1add3" pod="opendatahub/test-curl-7694-140502483708720"
Jul 17 21:47:24.767341 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:24.767312    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:24.865655 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:24.865619    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:25.041405 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:25.041326    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="050478d1-54ec-49f4-876f-d24b32b1add3" path="/var/lib/kubelet/pods/050478d1-54ec-49f4-876f-d24b32b1add3/volumes"
Jul 17 21:47:25.419348 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:25.419315    2572 generic.go:356] "Generic (PLEG): container finished" podID="fbd08ffa-82cc-4486-9166-b0f116369b48" containerID="2b4950084ddef5e9ba5991c6e22193dbd73b38efdce9a7897ef3d05c0d72af84" exitCode=0
Jul 17 21:47:25.419560 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:25.419363    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483702672" event={"ID":"fbd08ffa-82cc-4486-9166-b0f116369b48","Type":"ContainerDied","Data":"2b4950084ddef5e9ba5991c6e22193dbd73b38efdce9a7897ef3d05c0d72af84"}
Jul 17 21:47:26.565114 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.565092    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:26.584117 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.584094    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7694-140502483702672_fbd08ffa-82cc-4486-9166-b0f116369b48/test-curl-7694-140502483702672/0.log"
Jul 17 21:47:26.605659 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.605630    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7694-140502483702672"]
Jul 17 21:47:26.610245 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.610216    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7694-140502483702672"]
Jul 17 21:47:26.715019 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.714946    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrgh6\" (UniqueName: \"kubernetes.io/projected/fbd08ffa-82cc-4486-9166-b0f116369b48-kube-api-access-qrgh6\") pod \"fbd08ffa-82cc-4486-9166-b0f116369b48\" (UID: \"fbd08ffa-82cc-4486-9166-b0f116369b48\") "
Jul 17 21:47:26.716883 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.716849    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbd08ffa-82cc-4486-9166-b0f116369b48-kube-api-access-qrgh6" (OuterVolumeSpecName: "kube-api-access-qrgh6") pod "fbd08ffa-82cc-4486-9166-b0f116369b48" (UID: "fbd08ffa-82cc-4486-9166-b0f116369b48"). InnerVolumeSpecName "kube-api-access-qrgh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:47:26.722679 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.722654    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7694-140502483702672"]
Jul 17 21:47:26.723109 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.723090    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbd08ffa-82cc-4486-9166-b0f116369b48" containerName="test-curl-7694-140502483702672"
Jul 17 21:47:26.723184 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.723112    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbd08ffa-82cc-4486-9166-b0f116369b48" containerName="test-curl-7694-140502483702672"
Jul 17 21:47:26.723249 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.723233    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbd08ffa-82cc-4486-9166-b0f116369b48" containerName="test-curl-7694-140502483702672"
Jul 17 21:47:26.726654 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.726636    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:26.733035 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.733005    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483702672"]
Jul 17 21:47:26.816038 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.816007    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5f2\" (UniqueName: \"kubernetes.io/projected/cb3d8891-e5bf-41a6-bf45-ccad7349eb3c-kube-api-access-vn5f2\") pod \"test-curl-7694-140502483702672\" (UID: \"cb3d8891-e5bf-41a6-bf45-ccad7349eb3c\") " pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:26.816177 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.816060    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrgh6\" (UniqueName: \"kubernetes.io/projected/fbd08ffa-82cc-4486-9166-b0f116369b48-kube-api-access-qrgh6\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:26.916486 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.916459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5f2\" (UniqueName: \"kubernetes.io/projected/cb3d8891-e5bf-41a6-bf45-ccad7349eb3c-kube-api-access-vn5f2\") pod \"test-curl-7694-140502483702672\" (UID: \"cb3d8891-e5bf-41a6-bf45-ccad7349eb3c\") " pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:26.924842 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:26.924814    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5f2\" (UniqueName: \"kubernetes.io/projected/cb3d8891-e5bf-41a6-bf45-ccad7349eb3c-kube-api-access-vn5f2\") pod \"test-curl-7694-140502483702672\" (UID: \"cb3d8891-e5bf-41a6-bf45-ccad7349eb3c\") " pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:27.036972 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:27.036878    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:27.041751 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:27.041707    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbd08ffa-82cc-4486-9166-b0f116369b48" path="/var/lib/kubelet/pods/fbd08ffa-82cc-4486-9166-b0f116369b48/volumes"
Jul 17 21:47:27.172704 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:27.172677    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483702672"]
Jul 17 21:47:27.174584 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:47:27.174556    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb3d8891_e5bf_41a6_bf45_ccad7349eb3c.slice/crio-09cef46ea91cadb7b6d9bd9b6349ad37265de006c9ad55bb5042b46af6a61254 WatchSource:0}: Error finding container 09cef46ea91cadb7b6d9bd9b6349ad37265de006c9ad55bb5042b46af6a61254: Status 404 returned error can't find the container with id 09cef46ea91cadb7b6d9bd9b6349ad37265de006c9ad55bb5042b46af6a61254
Jul 17 21:47:27.431546 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:27.431519    2572 scope.go:117] "RemoveContainer" containerID="2b4950084ddef5e9ba5991c6e22193dbd73b38efdce9a7897ef3d05c0d72af84"
Jul 17 21:47:27.431703 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:27.431523    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:27.432776 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:27.432751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483702672" event={"ID":"cb3d8891-e5bf-41a6-bf45-ccad7349eb3c","Type":"ContainerStarted","Data":"09cef46ea91cadb7b6d9bd9b6349ad37265de006c9ad55bb5042b46af6a61254"}
Jul 17 21:47:28.440162 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:28.440128    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb3d8891-e5bf-41a6-bf45-ccad7349eb3c" containerID="d9338ca07b2536e5dc77855c5af9b789eee78c67b303d8cb4780beb7f0cf378d" exitCode=0
Jul 17 21:47:28.440598 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:28.440223    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483702672" event={"ID":"cb3d8891-e5bf-41a6-bf45-ccad7349eb3c","Type":"ContainerDied","Data":"d9338ca07b2536e5dc77855c5af9b789eee78c67b303d8cb4780beb7f0cf378d"}
Jul 17 21:47:29.575969 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.575946    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:29.594431 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.594401    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7694-140502483702672_cb3d8891-e5bf-41a6-bf45-ccad7349eb3c/test-curl-7694-140502483702672/0.log"
Jul 17 21:47:29.614632 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.614591    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7694-140502483702672"]
Jul 17 21:47:29.616320 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.616300    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7694-140502483702672"]
Jul 17 21:47:29.731628 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.731546    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7694-140502483703680"]
Jul 17 21:47:29.731935 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.731922    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb3d8891-e5bf-41a6-bf45-ccad7349eb3c" containerName="test-curl-7694-140502483702672"
Jul 17 21:47:29.731935 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.731936    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb3d8891-e5bf-41a6-bf45-ccad7349eb3c" containerName="test-curl-7694-140502483702672"
Jul 17 21:47:29.732019 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.732000    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb3d8891-e5bf-41a6-bf45-ccad7349eb3c" containerName="test-curl-7694-140502483702672"
Jul 17 21:47:29.734949 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.734932    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483703680"
Jul 17 21:47:29.741802 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.741779    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483703680"]
Jul 17 21:47:29.742133 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.742113    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn5f2\" (UniqueName: \"kubernetes.io/projected/cb3d8891-e5bf-41a6-bf45-ccad7349eb3c-kube-api-access-vn5f2\") pod \"cb3d8891-e5bf-41a6-bf45-ccad7349eb3c\" (UID: \"cb3d8891-e5bf-41a6-bf45-ccad7349eb3c\") "
Jul 17 21:47:29.745156 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.745127    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb3d8891-e5bf-41a6-bf45-ccad7349eb3c-kube-api-access-vn5f2" (OuterVolumeSpecName: "kube-api-access-vn5f2") pod "cb3d8891-e5bf-41a6-bf45-ccad7349eb3c" (UID: "cb3d8891-e5bf-41a6-bf45-ccad7349eb3c"). InnerVolumeSpecName "kube-api-access-vn5f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:47:29.843819 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.843782    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqsgk\" (UniqueName: \"kubernetes.io/projected/b62a03f9-8aee-4a30-ba32-7a39276b5eff-kube-api-access-kqsgk\") pod \"test-curl-7694-140502483703680\" (UID: \"b62a03f9-8aee-4a30-ba32-7a39276b5eff\") " pod="opendatahub/test-curl-7694-140502483703680"
Jul 17 21:47:29.843992 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.843890    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn5f2\" (UniqueName: \"kubernetes.io/projected/cb3d8891-e5bf-41a6-bf45-ccad7349eb3c-kube-api-access-vn5f2\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:29.944695 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.944654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqsgk\" (UniqueName: \"kubernetes.io/projected/b62a03f9-8aee-4a30-ba32-7a39276b5eff-kube-api-access-kqsgk\") pod \"test-curl-7694-140502483703680\" (UID: \"b62a03f9-8aee-4a30-ba32-7a39276b5eff\") " pod="opendatahub/test-curl-7694-140502483703680"
Jul 17 21:47:29.952612 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:29.952589    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqsgk\" (UniqueName: \"kubernetes.io/projected/b62a03f9-8aee-4a30-ba32-7a39276b5eff-kube-api-access-kqsgk\") pod \"test-curl-7694-140502483703680\" (UID: \"b62a03f9-8aee-4a30-ba32-7a39276b5eff\") " pod="opendatahub/test-curl-7694-140502483703680"
Jul 17 21:47:30.046011 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:30.045924    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483703680"
Jul 17 21:47:30.178416 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:30.178390    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7694-140502483703680"]
Jul 17 21:47:30.179930 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:47:30.179904    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb62a03f9_8aee_4a30_ba32_7a39276b5eff.slice/crio-e8fe8de1d2edcdb79ed038809d23401c7b17ee2bb353371ed4154095b54f9e97 WatchSource:0}: Error finding container e8fe8de1d2edcdb79ed038809d23401c7b17ee2bb353371ed4154095b54f9e97: Status 404 returned error can't find the container with id e8fe8de1d2edcdb79ed038809d23401c7b17ee2bb353371ed4154095b54f9e97
Jul 17 21:47:30.452501 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:30.452475    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:30.452598 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:30.452483    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09cef46ea91cadb7b6d9bd9b6349ad37265de006c9ad55bb5042b46af6a61254"
Jul 17 21:47:30.453645 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:30.453625    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483703680" event={"ID":"b62a03f9-8aee-4a30-ba32-7a39276b5eff","Type":"ContainerStarted","Data":"e8fe8de1d2edcdb79ed038809d23401c7b17ee2bb353371ed4154095b54f9e97"}
Jul 17 21:47:30.463687 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:47:30.463666    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7694-140502483702672\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="cb3d8891-e5bf-41a6-bf45-ccad7349eb3c" pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:30.677123 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:30.677087    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt" podUID="b8177593-f66c-4a27-b3dd-d6df78b7406d" containerName="main" containerID="cri-o://e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28" gracePeriod=45
Jul 17 21:47:30.937429 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:30.937402    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:47:30.955430 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:47:30.955393    2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7694-140502483702672\" is forbidden: User \"system:node:ip-10-0-137-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-0.ec2.internal' and this object" podUID="cb3d8891-e5bf-41a6-bf45-ccad7349eb3c" pod="opendatahub/test-curl-7694-140502483702672"
Jul 17 21:47:31.041204 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.041165    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb3d8891-e5bf-41a6-bf45-ccad7349eb3c" path="/var/lib/kubelet/pods/cb3d8891-e5bf-41a6-bf45-ccad7349eb3c/volumes"
Jul 17 21:47:31.052920 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.052846    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8177593-f66c-4a27-b3dd-d6df78b7406d-tls-certs\") pod \"b8177593-f66c-4a27-b3dd-d6df78b7406d\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") "
Jul 17 21:47:31.052920 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.052886    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-tmp-dir\") pod \"b8177593-f66c-4a27-b3dd-d6df78b7406d\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") "
Jul 17 21:47:31.053123 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.052948    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k56f7\" (UniqueName: \"kubernetes.io/projected/b8177593-f66c-4a27-b3dd-d6df78b7406d-kube-api-access-k56f7\") pod \"b8177593-f66c-4a27-b3dd-d6df78b7406d\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") "
Jul 17 21:47:31.053123 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.052970    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-home\") pod \"b8177593-f66c-4a27-b3dd-d6df78b7406d\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") "
Jul 17 21:47:31.053123 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.053003    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-model-cache\") pod \"b8177593-f66c-4a27-b3dd-d6df78b7406d\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") "
Jul 17 21:47:31.053123 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.053025    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-dshm\") pod \"b8177593-f66c-4a27-b3dd-d6df78b7406d\" (UID: \"b8177593-f66c-4a27-b3dd-d6df78b7406d\") "
Jul 17 21:47:31.053352 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.053207    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b8177593-f66c-4a27-b3dd-d6df78b7406d" (UID: "b8177593-f66c-4a27-b3dd-d6df78b7406d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:47:31.053352 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.053243    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-home" (OuterVolumeSpecName: "home") pod "b8177593-f66c-4a27-b3dd-d6df78b7406d" (UID: "b8177593-f66c-4a27-b3dd-d6df78b7406d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:47:31.053352 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.053247    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-model-cache" (OuterVolumeSpecName: "model-cache") pod "b8177593-f66c-4a27-b3dd-d6df78b7406d" (UID: "b8177593-f66c-4a27-b3dd-d6df78b7406d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:47:31.055095 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.055073    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-dshm" (OuterVolumeSpecName: "dshm") pod "b8177593-f66c-4a27-b3dd-d6df78b7406d" (UID: "b8177593-f66c-4a27-b3dd-d6df78b7406d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 21:47:31.055170 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.055073    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8177593-f66c-4a27-b3dd-d6df78b7406d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b8177593-f66c-4a27-b3dd-d6df78b7406d" (UID: "b8177593-f66c-4a27-b3dd-d6df78b7406d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:47:31.055170 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.055133    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8177593-f66c-4a27-b3dd-d6df78b7406d-kube-api-access-k56f7" (OuterVolumeSpecName: "kube-api-access-k56f7") pod "b8177593-f66c-4a27-b3dd-d6df78b7406d" (UID: "b8177593-f66c-4a27-b3dd-d6df78b7406d"). InnerVolumeSpecName "kube-api-access-k56f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:47:31.154663 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.154631    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k56f7\" (UniqueName: \"kubernetes.io/projected/b8177593-f66c-4a27-b3dd-d6df78b7406d-kube-api-access-k56f7\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:31.154663 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.154659    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-home\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:31.154663 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.154669    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-model-cache\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:31.154893 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.154677    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-dshm\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:31.154893 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.154684    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8177593-f66c-4a27-b3dd-d6df78b7406d-tls-certs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:31.154893 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.154691    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8177593-f66c-4a27-b3dd-d6df78b7406d-tmp-dir\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:31.460319 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.460260    2572 generic.go:356] "Generic (PLEG): container finished" podID="b62a03f9-8aee-4a30-ba32-7a39276b5eff" containerID="59a688556e008e933ba01d91c80e2979fe2f4a16952e599af8136172d2a9e946" exitCode=0
Jul 17 21:47:31.460319 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.460307    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7694-140502483703680" event={"ID":"b62a03f9-8aee-4a30-ba32-7a39276b5eff","Type":"ContainerDied","Data":"59a688556e008e933ba01d91c80e2979fe2f4a16952e599af8136172d2a9e946"}
Jul 17 21:47:31.461523 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.461500    2572 generic.go:356] "Generic (PLEG): container finished" podID="b8177593-f66c-4a27-b3dd-d6df78b7406d" containerID="e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28" exitCode=0
Jul 17 21:47:31.461633 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.461551    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"
Jul 17 21:47:31.461633 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.461575    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt" event={"ID":"b8177593-f66c-4a27-b3dd-d6df78b7406d","Type":"ContainerDied","Data":"e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28"}
Jul 17 21:47:31.461633 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.461610    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt" event={"ID":"b8177593-f66c-4a27-b3dd-d6df78b7406d","Type":"ContainerDied","Data":"578fbfb5528e6a7db7ee7288c751a6447476a644e69192aa16edf5db0cc28a66"}
Jul 17 21:47:31.461633 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.461627    2572 scope.go:117] "RemoveContainer" containerID="e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28"
Jul 17 21:47:31.474135 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.474117    2572 scope.go:117] "RemoveContainer" containerID="e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28"
Jul 17 21:47:31.474409 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:47:31.474389    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28\": container with ID starting with e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28 not found: ID does not exist" containerID="e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28"
Jul 17 21:47:31.474471 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.474416    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28"} err="failed to get container status \"e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28\": rpc error: code = NotFound desc = could not find container \"e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28\": container with ID starting with e6cd6bf0ccc494fd44097b9cc21997603ab43c0932cfe4741ce002ce52773f28 not found: ID does not exist"
Jul 17 21:47:31.492167 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.492144    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"]
Jul 17 21:47:31.495712 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:31.495686    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-f631c8/rate-test-model-f631c8-kserve-7b9db4fcbc-tjdqt"]
Jul 17 21:47:32.601907 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:32.601878    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483703680"
Jul 17 21:47:32.625039 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:32.625017    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7694-140502483703680_b62a03f9-8aee-4a30-ba32-7a39276b5eff/test-curl-7694-140502483703680/0.log"
Jul 17 21:47:32.648955 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:32.648924    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7694-140502483703680"]
Jul 17 21:47:32.651004 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:32.650981    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7694-140502483703680"]
Jul 17 21:47:32.769630 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:32.769558    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqsgk\" (UniqueName: \"kubernetes.io/projected/b62a03f9-8aee-4a30-ba32-7a39276b5eff-kube-api-access-kqsgk\") pod \"b62a03f9-8aee-4a30-ba32-7a39276b5eff\" (UID: \"b62a03f9-8aee-4a30-ba32-7a39276b5eff\") "
Jul 17 21:47:32.771735 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:32.771707    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b62a03f9-8aee-4a30-ba32-7a39276b5eff-kube-api-access-kqsgk" (OuterVolumeSpecName: "kube-api-access-kqsgk") pod "b62a03f9-8aee-4a30-ba32-7a39276b5eff" (UID: "b62a03f9-8aee-4a30-ba32-7a39276b5eff"). InnerVolumeSpecName "kube-api-access-kqsgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:47:32.870871 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:32.870844    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqsgk\" (UniqueName: \"kubernetes.io/projected/b62a03f9-8aee-4a30-ba32-7a39276b5eff-kube-api-access-kqsgk\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:33.041142 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:33.041061    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b62a03f9-8aee-4a30-ba32-7a39276b5eff" path="/var/lib/kubelet/pods/b62a03f9-8aee-4a30-ba32-7a39276b5eff/volumes"
Jul 17 21:47:33.041457 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:33.041443    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8177593-f66c-4a27-b3dd-d6df78b7406d" path="/var/lib/kubelet/pods/b8177593-f66c-4a27-b3dd-d6df78b7406d/volumes"
Jul 17 21:47:33.222394 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:33.222361    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:33.323770 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:33.323683    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:33.472852 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:33.472828    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7694-140502483703680"
Jul 17 21:47:33.472852 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:33.472840    2572 scope.go:117] "RemoveContainer" containerID="59a688556e008e933ba01d91c80e2979fe2f4a16952e599af8136172d2a9e946"
Jul 17 21:47:35.973880 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:35.973841    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"]
Jul 17 21:47:35.974417 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:35.974397    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b62a03f9-8aee-4a30-ba32-7a39276b5eff" containerName="test-curl-7694-140502483703680"
Jul 17 21:47:35.974500 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:35.974420    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b62a03f9-8aee-4a30-ba32-7a39276b5eff" containerName="test-curl-7694-140502483703680"
Jul 17 21:47:35.974500 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:35.974462    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8177593-f66c-4a27-b3dd-d6df78b7406d" containerName="main"
Jul 17 21:47:35.974500 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:35.974472    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8177593-f66c-4a27-b3dd-d6df78b7406d" containerName="main"
Jul 17 21:47:35.974648 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:35.974572    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b62a03f9-8aee-4a30-ba32-7a39276b5eff" containerName="test-curl-7694-140502483703680"
Jul 17 21:47:35.974648 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:35.974590    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8177593-f66c-4a27-b3dd-d6df78b7406d" containerName="main"
Jul 17 21:47:35.978833 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:35.978813    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"
Jul 17 21:47:35.981438 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:35.981415    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:47:35.984584 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:35.984562    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"]
Jul 17 21:47:36.097084 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:36.097049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a466bf8b-7864-4d8f-b76a-c8fcdf15785a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw\" (UID: \"a466bf8b-7864-4d8f-b76a-c8fcdf15785a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"
Jul 17 21:47:36.197774 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:36.197740    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a466bf8b-7864-4d8f-b76a-c8fcdf15785a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw\" (UID: \"a466bf8b-7864-4d8f-b76a-c8fcdf15785a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"
Jul 17 21:47:36.198404 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:36.198387    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a466bf8b-7864-4d8f-b76a-c8fcdf15785a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw\" (UID: \"a466bf8b-7864-4d8f-b76a-c8fcdf15785a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"
Jul 17 21:47:36.290611 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:36.290530    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"
Jul 17 21:47:36.430186 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:36.430081    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"]
Jul 17 21:47:36.437543 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:47:36.437515    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda466bf8b_7864_4d8f_b76a_c8fcdf15785a.slice/crio-1450010e0df8e32548c820dc68e3d61507259f49d82f269e53068c7d9ab3ddcb WatchSource:0}: Error finding container 1450010e0df8e32548c820dc68e3d61507259f49d82f269e53068c7d9ab3ddcb: Status 404 returned error can't find the container with id 1450010e0df8e32548c820dc68e3d61507259f49d82f269e53068c7d9ab3ddcb
Jul 17 21:47:36.491376 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:36.491341    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw" event={"ID":"a466bf8b-7864-4d8f-b76a-c8fcdf15785a","Type":"ContainerStarted","Data":"1450010e0df8e32548c820dc68e3d61507259f49d82f269e53068c7d9ab3ddcb"}
Jul 17 21:47:36.498995 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:36.498967    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:36.601103 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:36.600997    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:37.497970 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:37.497938    2572 generic.go:356] "Generic (PLEG): container finished" podID="a466bf8b-7864-4d8f-b76a-c8fcdf15785a" containerID="0c3332c77e6de1ffd48ff5f17e8e4eaae05c0c0e701806c9f4c6d68a375e3e98" exitCode=0
Jul 17 21:47:37.498371 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:37.497998    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw" event={"ID":"a466bf8b-7864-4d8f-b76a-c8fcdf15785a","Type":"ContainerDied","Data":"0c3332c77e6de1ffd48ff5f17e8e4eaae05c0c0e701806c9f4c6d68a375e3e98"}
Jul 17 21:47:38.630549 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:38.630521    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"
Jul 17 21:47:38.718866 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:38.718838    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a466bf8b-7864-4d8f-b76a-c8fcdf15785a-maas-api-service-ca\") pod \"a466bf8b-7864-4d8f-b76a-c8fcdf15785a\" (UID: \"a466bf8b-7864-4d8f-b76a-c8fcdf15785a\") "
Jul 17 21:47:38.719158 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:38.719136    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a466bf8b-7864-4d8f-b76a-c8fcdf15785a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a466bf8b-7864-4d8f-b76a-c8fcdf15785a" (UID: "a466bf8b-7864-4d8f-b76a-c8fcdf15785a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:47:38.820327 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:38.820207    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a466bf8b-7864-4d8f-b76a-c8fcdf15785a-maas-api-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:39.509173 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:39.509144    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"
Jul 17 21:47:39.509377 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:39.509193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw" event={"ID":"a466bf8b-7864-4d8f-b76a-c8fcdf15785a","Type":"ContainerDied","Data":"1450010e0df8e32548c820dc68e3d61507259f49d82f269e53068c7d9ab3ddcb"}
Jul 17 21:47:39.509377 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:39.509240    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1450010e0df8e32548c820dc68e3d61507259f49d82f269e53068c7d9ab3ddcb"
Jul 17 21:47:46.473340 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.473304    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"]
Jul 17 21:47:46.473829 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.473536    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4" podUID="0aa5ba55-f9f3-4be1-8ee5-65376abf4f17" containerName="maas-api" containerID="cri-o://6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad" gracePeriod=30
Jul 17 21:47:46.498286 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.498243    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:46.713715 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.713694    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:47:46.792015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.791930    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-openshift-service-ca\") pod \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") "
Jul 17 21:47:46.792015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.791974    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-maas-api-tls\") pod \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") "
Jul 17 21:47:46.792015 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.792006    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnhl4\" (UniqueName: \"kubernetes.io/projected/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-kube-api-access-lnhl4\") pod \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\" (UID: \"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17\") "
Jul 17 21:47:46.792390 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.792363    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0aa5ba55-f9f3-4be1-8ee5-65376abf4f17" (UID: "0aa5ba55-f9f3-4be1-8ee5-65376abf4f17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:47:46.794098 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.794069    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-kube-api-access-lnhl4" (OuterVolumeSpecName: "kube-api-access-lnhl4") pod "0aa5ba55-f9f3-4be1-8ee5-65376abf4f17" (UID: "0aa5ba55-f9f3-4be1-8ee5-65376abf4f17"). InnerVolumeSpecName "kube-api-access-lnhl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:47:46.794098 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.794080    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0aa5ba55-f9f3-4be1-8ee5-65376abf4f17" (UID: "0aa5ba55-f9f3-4be1-8ee5-65376abf4f17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:47:46.892695 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.892657    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:46.892695 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.892690    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:46.892695 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:46.892701    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnhl4\" (UniqueName: \"kubernetes.io/projected/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17-kube-api-access-lnhl4\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:47:47.550263 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:47.550226    2572 generic.go:356] "Generic (PLEG): container finished" podID="0aa5ba55-f9f3-4be1-8ee5-65376abf4f17" containerID="6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad" exitCode=0
Jul 17 21:47:47.550658 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:47.550299    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"
Jul 17 21:47:47.550658 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:47.550296    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4" event={"ID":"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17","Type":"ContainerDied","Data":"6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad"}
Jul 17 21:47:47.550658 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:47.550420    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4" event={"ID":"0aa5ba55-f9f3-4be1-8ee5-65376abf4f17","Type":"ContainerDied","Data":"366b104410e2d50380ae21369d32ba3a518f04d9437b6354068c1b4e3710ec2b"}
Jul 17 21:47:47.550658 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:47.550448    2572 scope.go:117] "RemoveContainer" containerID="6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad"
Jul 17 21:47:47.558885 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:47.558867    2572 scope.go:117] "RemoveContainer" containerID="6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad"
Jul 17 21:47:47.559146 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:47:47.559117    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad\": container with ID starting with 6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad not found: ID does not exist" containerID="6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad"
Jul 17 21:47:47.559248 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:47.559150    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad"} err="failed to get container status \"6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad\": rpc error: code = NotFound desc = could not find container \"6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad\": container with ID starting with 6d569db493879d0db941664e2ec4720ed4fea6f004e773234189ac6d5e3b12ad not found: ID does not exist"
Jul 17 21:47:47.566887 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:47.566864    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"]
Jul 17 21:47:47.570453 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:47.570434    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f631c8-5b7bc4678f-vwwf4"]
Jul 17 21:47:49.041189 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:49.041157    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aa5ba55-f9f3-4be1-8ee5-65376abf4f17" path="/var/lib/kubelet/pods/0aa5ba55-f9f3-4be1-8ee5-65376abf4f17/volumes"
Jul 17 21:47:51.048993 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:51.048953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:51.060197 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:51.060171    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"]
Jul 17 21:47:51.062887 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:51.062858    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-f631c8-6dcbw"]
Jul 17 21:47:51.435845 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:51.435811    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:53.042047 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:53.042014    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a466bf8b-7864-4d8f-b76a-c8fcdf15785a" path="/var/lib/kubelet/pods/a466bf8b-7864-4d8f-b76a-c8fcdf15785a/volumes"
Jul 17 21:47:55.297817 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:55.297786    2572 scope.go:117] "RemoveContainer" containerID="59c2a1a5d5a8d21638604b74c3dfbbc1beb588ac724fbd4a82c140ccb174ad8b"
Jul 17 21:47:55.305736 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:55.305716    2572 scope.go:117] "RemoveContainer" containerID="7312f0915bb69b7053be91b23b78b8cd4422c21941f9aa4da1cbd9d806ee96bf"
Jul 17 21:47:57.751570 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:57.751509    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:57.812482 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:57.812454    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:58.013384 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.013297    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:58.240932 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.240903    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:58.344712 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.344620    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"]
Jul 17 21:47:58.345048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.345033    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aa5ba55-f9f3-4be1-8ee5-65376abf4f17" containerName="maas-api"
Jul 17 21:47:58.345048 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.345048    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aa5ba55-f9f3-4be1-8ee5-65376abf4f17" containerName="maas-api"
Jul 17 21:47:58.345161 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.345055    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a466bf8b-7864-4d8f-b76a-c8fcdf15785a" containerName="revoke-keys"
Jul 17 21:47:58.345161 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.345061    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a466bf8b-7864-4d8f-b76a-c8fcdf15785a" containerName="revoke-keys"
Jul 17 21:47:58.345161 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.345135    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aa5ba55-f9f3-4be1-8ee5-65376abf4f17" containerName="maas-api"
Jul 17 21:47:58.345161 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.345149    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a466bf8b-7864-4d8f-b76a-c8fcdf15785a" containerName="revoke-keys"
Jul 17 21:47:58.350614 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.350596    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"
Jul 17 21:47:58.353019 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.352999    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-km5xb\""
Jul 17 21:47:58.355170 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.355144    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"]
Jul 17 21:47:58.391378 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.391354    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3246b2d7-9597-4dd3-9cfe-b4da84a514e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt\" (UID: \"3246b2d7-9597-4dd3-9cfe-b4da84a514e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"
Jul 17 21:47:58.492208 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.492174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3246b2d7-9597-4dd3-9cfe-b4da84a514e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt\" (UID: \"3246b2d7-9597-4dd3-9cfe-b4da84a514e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"
Jul 17 21:47:58.492788 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.492767    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3246b2d7-9597-4dd3-9cfe-b4da84a514e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt\" (UID: \"3246b2d7-9597-4dd3-9cfe-b4da84a514e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"
Jul 17 21:47:58.663686 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.663602    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"
Jul 17 21:47:58.799450 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.799424    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"]
Jul 17 21:47:58.801263 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:47:58.801226    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3246b2d7_9597_4dd3_9cfe_b4da84a514e6.slice/crio-988ef42db5892f52c013929a514eb54ab7a4d96f99d3c3863d0e383597f87ba0 WatchSource:0}: Error finding container 988ef42db5892f52c013929a514eb54ab7a4d96f99d3c3863d0e383597f87ba0: Status 404 returned error can't find the container with id 988ef42db5892f52c013929a514eb54ab7a4d96f99d3c3863d0e383597f87ba0
Jul 17 21:47:58.899211 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.899160    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:58.999892 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:58.999860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:47:59.616615 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:59.616577    2572 generic.go:356] "Generic (PLEG): container finished" podID="3246b2d7-9597-4dd3-9cfe-b4da84a514e6" containerID="927ead1cd35df7424f26cd1bed3ab7cd5f4df2cdfbb236747ee40ea20a335005" exitCode=0
Jul 17 21:47:59.616792 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:59.616648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt" event={"ID":"3246b2d7-9597-4dd3-9cfe-b4da84a514e6","Type":"ContainerDied","Data":"927ead1cd35df7424f26cd1bed3ab7cd5f4df2cdfbb236747ee40ea20a335005"}
Jul 17 21:47:59.616792 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:47:59.616725    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt" event={"ID":"3246b2d7-9597-4dd3-9cfe-b4da84a514e6","Type":"ContainerStarted","Data":"988ef42db5892f52c013929a514eb54ab7a4d96f99d3c3863d0e383597f87ba0"}
Jul 17 21:48:00.752232 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:00.752211    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"
Jul 17 21:48:00.814100 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:00.814077    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3246b2d7-9597-4dd3-9cfe-b4da84a514e6-maas-api-service-ca\") pod \"3246b2d7-9597-4dd3-9cfe-b4da84a514e6\" (UID: \"3246b2d7-9597-4dd3-9cfe-b4da84a514e6\") "
Jul 17 21:48:00.814463 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:00.814444    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3246b2d7-9597-4dd3-9cfe-b4da84a514e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3246b2d7-9597-4dd3-9cfe-b4da84a514e6" (UID: "3246b2d7-9597-4dd3-9cfe-b4da84a514e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:48:00.915630 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:00.915602    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3246b2d7-9597-4dd3-9cfe-b4da84a514e6-maas-api-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:48:01.627412 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:01.627383    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"
Jul 17 21:48:01.627599 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:01.627418    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt" event={"ID":"3246b2d7-9597-4dd3-9cfe-b4da84a514e6","Type":"ContainerDied","Data":"988ef42db5892f52c013929a514eb54ab7a4d96f99d3c3863d0e383597f87ba0"}
Jul 17 21:48:01.627599 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:01.627471    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="988ef42db5892f52c013929a514eb54ab7a4d96f99d3c3863d0e383597f87ba0"
Jul 17 21:48:08.757722 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:08.757687    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"]
Jul 17 21:48:08.758112 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:08.757878    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f" podUID="a59d0fd3-e450-4e97-a684-dd7c3986f411" containerName="maas-api" containerID="cri-o://2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e" gracePeriod=30
Jul 17 21:48:08.767469 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:08.767444    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:08.775381 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:08.775358    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp"]
Jul 17 21:48:08.777580 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:08.777561    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5e469-29738745-b2xhp"]
Jul 17 21:48:09.000574 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.000550    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:48:09.042706 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.042639    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7f5613f-2214-4b21-a8f8-00784f8f08ea" path="/var/lib/kubelet/pods/e7f5613f-2214-4b21-a8f8-00784f8f08ea/volumes"
Jul 17 21:48:09.085618 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.085592    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh6fs\" (UniqueName: \"kubernetes.io/projected/a59d0fd3-e450-4e97-a684-dd7c3986f411-kube-api-access-lh6fs\") pod \"a59d0fd3-e450-4e97-a684-dd7c3986f411\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") "
Jul 17 21:48:09.085789 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.085656    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a59d0fd3-e450-4e97-a684-dd7c3986f411-openshift-service-ca\") pod \"a59d0fd3-e450-4e97-a684-dd7c3986f411\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") "
Jul 17 21:48:09.085789 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.085741    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a59d0fd3-e450-4e97-a684-dd7c3986f411-maas-api-tls\") pod \"a59d0fd3-e450-4e97-a684-dd7c3986f411\" (UID: \"a59d0fd3-e450-4e97-a684-dd7c3986f411\") "
Jul 17 21:48:09.086009 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.085987    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a59d0fd3-e450-4e97-a684-dd7c3986f411-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a59d0fd3-e450-4e97-a684-dd7c3986f411" (UID: "a59d0fd3-e450-4e97-a684-dd7c3986f411"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 21:48:09.087702 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.087680    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a59d0fd3-e450-4e97-a684-dd7c3986f411-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a59d0fd3-e450-4e97-a684-dd7c3986f411" (UID: "a59d0fd3-e450-4e97-a684-dd7c3986f411"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 21:48:09.087795 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.087771    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a59d0fd3-e450-4e97-a684-dd7c3986f411-kube-api-access-lh6fs" (OuterVolumeSpecName: "kube-api-access-lh6fs") pod "a59d0fd3-e450-4e97-a684-dd7c3986f411" (UID: "a59d0fd3-e450-4e97-a684-dd7c3986f411"). InnerVolumeSpecName "kube-api-access-lh6fs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 21:48:09.186953 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.186921    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh6fs\" (UniqueName: \"kubernetes.io/projected/a59d0fd3-e450-4e97-a684-dd7c3986f411-kube-api-access-lh6fs\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:48:09.186953 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.186947    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a59d0fd3-e450-4e97-a684-dd7c3986f411-openshift-service-ca\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:48:09.186953 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.186958    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a59d0fd3-e450-4e97-a684-dd7c3986f411-maas-api-tls\") on node \"ip-10-0-137-0.ec2.internal\" DevicePath \"\""
Jul 17 21:48:09.666360 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.666328    2572 generic.go:356] "Generic (PLEG): container finished" podID="a59d0fd3-e450-4e97-a684-dd7c3986f411" containerID="2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e" exitCode=0
Jul 17 21:48:09.666507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.666371    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"
Jul 17 21:48:09.666507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.666414    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f" event={"ID":"a59d0fd3-e450-4e97-a684-dd7c3986f411","Type":"ContainerDied","Data":"2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e"}
Jul 17 21:48:09.666507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.666465    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f" event={"ID":"a59d0fd3-e450-4e97-a684-dd7c3986f411","Type":"ContainerDied","Data":"a6b6c5ffcd8ee005a3eee4c9ec5fff11fa89ea7d416a26d2ef8b3193df801ab5"}
Jul 17 21:48:09.666507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.666488    2572 scope.go:117] "RemoveContainer" containerID="2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e"
Jul 17 21:48:09.675535 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.675521    2572 scope.go:117] "RemoveContainer" containerID="2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e"
Jul 17 21:48:09.675789 ip-10-0-137-0 kubenswrapper[2572]: E0717 21:48:09.675771    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e\": container with ID starting with 2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e not found: ID does not exist" containerID="2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e"
Jul 17 21:48:09.675834 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.675797    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e"} err="failed to get container status \"2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e\": rpc error: code = NotFound desc = could not find container \"2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e\": container with ID starting with 2c930952f52de20a61f0cc70b8066040bea65785cf86e1b997535ed2f6e1af1e not found: ID does not exist"
Jul 17 21:48:09.687628 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.687567    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"]
Jul 17 21:48:09.689231 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:09.689212    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5e469-7855bf65bb-zx94f"]
Jul 17 21:48:11.041433 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:11.041402    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a59d0fd3-e450-4e97-a684-dd7c3986f411" path="/var/lib/kubelet/pods/a59d0fd3-e450-4e97-a684-dd7c3986f411/volumes"
Jul 17 21:48:13.415218 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:13.415182    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"]
Jul 17 21:48:13.417343 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:13.417319    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-d5e469-xtglt"]
Jul 17 21:48:13.436604 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:13.436576    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:13.635121 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:13.635087    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:13.735916 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:13.735840    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:13.837453 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:13.837425    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:15.041443 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:15.041413    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3246b2d7-9597-4dd3-9cfe-b4da84a514e6" path="/var/lib/kubelet/pods/3246b2d7-9597-4dd3-9cfe-b4da84a514e6/volumes"
Jul 17 21:48:19.890563 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:19.890525    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:19.990997 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:19.990964    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:20.166579 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:20.166554    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:20.398982 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:20.398954    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:26.423384 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:26.423352    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hqs6r_b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795/manager/0.log"
Jul 17 21:48:26.545576 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:26.545540    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-x6l4k_8f80c1a6-430d-4629-a1d0-297973844e42/manager/0.log"
Jul 17 21:48:26.671856 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:26.671824    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fff89cdb-jp2hh_b763b34b-ddcd-44ec-96b9-3ddd38339327/manager/0.log"
Jul 17 21:48:26.789466 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:26.789393    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-96mgs_d6012ec7-6f6b-4fb4-b2cd-842721888c51/server/0.log"
Jul 17 21:48:26.904974 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:26.904945    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tbwnk_28d66e03-094c-419c-9229-4afb12be1f4f/manager/0.log"
Jul 17 21:48:27.297728 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:27.297704    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx_26c50181-c255-4d92-9477-19154a7ebc49/copy-manifests/0.log"
Jul 17 21:48:27.305353 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:27.305334    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx_26c50181-c255-4d92-9477-19154a7ebc49/manager/0.log"
Jul 17 21:48:27.671075 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:27.671046    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6d79756bc8-k7fcw_d0bb288e-236e-453e-a823-9df9323cea17/maas-api/0.log"
Jul 17 21:48:28.133417 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:28.133336    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-5xrkd_dff61145-beb0-467e-8287-bef2e511a2dd/postgres/0.log"
Jul 17 21:48:29.611449 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:29.611424    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9g2lj_31792ae5-ee4c-47fe-89a1-ce5b40032f12/manager/0.log"
Jul 17 21:48:29.728771 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:29.728735    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lmr86_f7bb043b-89e3-49e3-bf16-8b2dfc74694c/manager/0.log"
Jul 17 21:48:29.845710 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:29.845680    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lmhtx_dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077/kuadrant-console-plugin/0.log"
Jul 17 21:48:29.969799 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:29.969768    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9bxkv_0cc2e550-fbbc-48dd-bc54-0b8230894e6e/registry-server/0.log"
Jul 17 21:48:30.093244 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:30.093213    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ns7q4_124f99b5-53da-4dce-8c3e-7766e3c87e12/manager/0.log"
Jul 17 21:48:30.324973 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:30.324901    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bmzpz_6b4c8c2d-67a7-4590-83a3-07a8e4e82748/manager/0.log"
Jul 17 21:48:31.066976 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:31.066950    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-748bb598b7-z774l_8ba642ea-f938-4f9d-af29-11512af935f6/kube-auth-proxy/0.log"
Jul 17 21:48:31.326478 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:31.326397    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-5gczm_58556bff-d5df-461a-885f-f59b30a0c9a2/payload-pre-processing/0.log"
Jul 17 21:48:31.579789 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:31.579717    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd6b8fd68-w4fm4_8beac0d0-ad13-4ade-91d3-f69bdcf90233/router/0.log"
Jul 17 21:48:32.327628 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:32.327595    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbcwtv9_97acd03c-19ad-4cae-acd3-ca9736f9531c/main/0.log"
Jul 17 21:48:32.558995 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:32.558961    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-m222t_f1489b04-5279-4f64-999a-a0e4648dc660/main/0.log"
Jul 17 21:48:38.445129 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.445101    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jqx7f/must-gather-hng6k"]
Jul 17 21:48:38.445507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.445467    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3246b2d7-9597-4dd3-9cfe-b4da84a514e6" containerName="revoke-keys"
Jul 17 21:48:38.445507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.445479    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3246b2d7-9597-4dd3-9cfe-b4da84a514e6" containerName="revoke-keys"
Jul 17 21:48:38.445507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.445504    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a59d0fd3-e450-4e97-a684-dd7c3986f411" containerName="maas-api"
Jul 17 21:48:38.445507 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.445510    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a59d0fd3-e450-4e97-a684-dd7c3986f411" containerName="maas-api"
Jul 17 21:48:38.445639 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.445576    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a59d0fd3-e450-4e97-a684-dd7c3986f411" containerName="maas-api"
Jul 17 21:48:38.445639 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.445588    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3246b2d7-9597-4dd3-9cfe-b4da84a514e6" containerName="revoke-keys"
Jul 17 21:48:38.448683 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.448664    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jqx7f/must-gather-hng6k"
Jul 17 21:48:38.450935 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.450917    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jqx7f\"/\"kube-root-ca.crt\""
Jul 17 21:48:38.451805 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.451784    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jqx7f\"/\"openshift-service-ca.crt\""
Jul 17 21:48:38.451934 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.451791    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jqx7f\"/\"default-dockercfg-vtgzk\""
Jul 17 21:48:38.456690 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.456671    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jqx7f/must-gather-hng6k"]
Jul 17 21:48:38.463386 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.463368    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:38.549757 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.549726    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0114a25-4354-480d-b8a6-b9dded2b6acf-must-gather-output\") pod \"must-gather-hng6k\" (UID: \"d0114a25-4354-480d-b8a6-b9dded2b6acf\") " pod="openshift-must-gather-jqx7f/must-gather-hng6k"
Jul 17 21:48:38.549907 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.549767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnrs4\" (UniqueName: \"kubernetes.io/projected/d0114a25-4354-480d-b8a6-b9dded2b6acf-kube-api-access-hnrs4\") pod \"must-gather-hng6k\" (UID: \"d0114a25-4354-480d-b8a6-b9dded2b6acf\") " pod="openshift-must-gather-jqx7f/must-gather-hng6k"
Jul 17 21:48:38.562617 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.562590    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log" limit=1024
Jul 17 21:48:38.650700 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.650670    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0114a25-4354-480d-b8a6-b9dded2b6acf-must-gather-output\") pod \"must-gather-hng6k\" (UID: \"d0114a25-4354-480d-b8a6-b9dded2b6acf\") " pod="openshift-must-gather-jqx7f/must-gather-hng6k"
Jul 17 21:48:38.650835 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.650710    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnrs4\" (UniqueName: \"kubernetes.io/projected/d0114a25-4354-480d-b8a6-b9dded2b6acf-kube-api-access-hnrs4\") pod \"must-gather-hng6k\" (UID: \"d0114a25-4354-480d-b8a6-b9dded2b6acf\") " pod="openshift-must-gather-jqx7f/must-gather-hng6k"
Jul 17 21:48:38.651055 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.651035    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d0114a25-4354-480d-b8a6-b9dded2b6acf-must-gather-output\") pod \"must-gather-hng6k\" (UID: \"d0114a25-4354-480d-b8a6-b9dded2b6acf\") " pod="openshift-must-gather-jqx7f/must-gather-hng6k"
Jul 17 21:48:38.659371 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.659351    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnrs4\" (UniqueName: \"kubernetes.io/projected/d0114a25-4354-480d-b8a6-b9dded2b6acf-kube-api-access-hnrs4\") pod \"must-gather-hng6k\" (UID: \"d0114a25-4354-480d-b8a6-b9dded2b6acf\") " pod="openshift-must-gather-jqx7f/must-gather-hng6k"
Jul 17 21:48:38.758827 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.758756    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jqx7f/must-gather-hng6k"
Jul 17 21:48:38.903781 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:38.903757    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jqx7f/must-gather-hng6k"]
Jul 17 21:48:38.905828 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:48:38.905800    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0114a25_4354_480d_b8a6_b9dded2b6acf.slice/crio-8d5d9379e68042d26cffd3bdb4172abf3c2f09920ae5f7cae4d122a0b201f409 WatchSource:0}: Error finding container 8d5d9379e68042d26cffd3bdb4172abf3c2f09920ae5f7cae4d122a0b201f409: Status 404 returned error can't find the container with id 8d5d9379e68042d26cffd3bdb4172abf3c2f09920ae5f7cae4d122a0b201f409
Jul 17 21:48:39.815078 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:39.815053    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jqx7f/must-gather-hng6k" event={"ID":"d0114a25-4354-480d-b8a6-b9dded2b6acf","Type":"ContainerStarted","Data":"8d5d9379e68042d26cffd3bdb4172abf3c2f09920ae5f7cae4d122a0b201f409"}
Jul 17 21:48:40.825508 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:40.825473    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jqx7f/must-gather-hng6k" event={"ID":"d0114a25-4354-480d-b8a6-b9dded2b6acf","Type":"ContainerStarted","Data":"21a69a1889564b16c9871fa1ae5a212192b923eab5c6356d0cf53daf226651c8"}
Jul 17 21:48:40.826011 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:40.825520    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jqx7f/must-gather-hng6k" event={"ID":"d0114a25-4354-480d-b8a6-b9dded2b6acf","Type":"ContainerStarted","Data":"12b35cc926f392a8a80564f120efdef140b4d3adbbdd0d69296d02d608d7b8c1"}
Jul 17 21:48:40.845486 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:40.844713    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jqx7f/must-gather-hng6k" podStartSLOduration=2.013420187 podStartE2EDuration="2.844692824s" totalImagesPullingTime="831.272637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 21:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:48:40.842334215 +0000 UTC m=+2688.372242674" watchObservedRunningTime="2026-07-17 21:48:40.844692824 +0000 UTC m=+2688.374601275"
Jul 17 21:48:41.264473 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:41.264412    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4rb5w_b4049b73-3e48-4f93-96a2-bbc2d6da122e/global-pull-secret-syncer/0.log"
Jul 17 21:48:41.400407 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:41.400379    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cjk7f_13b0f970-2ea8-4bc0-9f13-3dfd00d78e8d/konnectivity-agent/0.log"
Jul 17 21:48:41.531394 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:41.531324    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-0.ec2.internal_30ae21aab87928588e13219334900650/haproxy/0.log"
Jul 17 21:48:46.853763 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:46.853702    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9g2lj_31792ae5-ee4c-47fe-89a1-ce5b40032f12/manager/0.log"
Jul 17 21:48:46.890863 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:46.890818    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-lmr86_f7bb043b-89e3-49e3-bf16-8b2dfc74694c/manager/0.log"
Jul 17 21:48:46.925876 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:46.925848    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lmhtx_dd0cb9b4-2ca1-4694-a704-8ecc1f2f9077/kuadrant-console-plugin/0.log"
Jul 17 21:48:46.978457 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:46.978420    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-9bxkv_0cc2e550-fbbc-48dd-bc54-0b8230894e6e/registry-server/0.log"
Jul 17 21:48:47.135098 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:47.135017    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-ns7q4_124f99b5-53da-4dce-8c3e-7766e3c87e12/manager/0.log"
Jul 17 21:48:47.247543 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:47.247445    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-bmzpz_6b4c8c2d-67a7-4590-83a3-07a8e4e82748/manager/0.log"
Jul 17 21:48:48.932860 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:48.932828    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-tn4g4_5df51c14-bc3f-46ec-9824-b52e048b48e9/cluster-monitoring-operator/0.log"
Jul 17 21:48:48.960499 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:48.960450    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-mg5m8_6d4cac9e-4f97-4e93-be27-b415bf262d06/kube-state-metrics/0.log"
Jul 17 21:48:48.982545 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:48.982511    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-mg5m8_6d4cac9e-4f97-4e93-be27-b415bf262d06/kube-rbac-proxy-main/0.log"
Jul 17 21:48:49.003701 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:49.003656    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-mg5m8_6d4cac9e-4f97-4e93-be27-b415bf262d06/kube-rbac-proxy-self/0.log"
Jul 17 21:48:49.229025 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:49.228927    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gldlk_1c2e292d-42cf-4b34-86a2-5ba64567329d/node-exporter/0.log"
Jul 17 21:48:49.248191 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:49.248157    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gldlk_1c2e292d-42cf-4b34-86a2-5ba64567329d/kube-rbac-proxy/0.log"
Jul 17 21:48:49.286732 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:49.286708    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gldlk_1c2e292d-42cf-4b34-86a2-5ba64567329d/init-textfile/0.log"
Jul 17 21:48:50.984219 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:50.984181    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"]
Jul 17 21:48:50.991899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:50.991874    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:50.996899 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:50.996862    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"]
Jul 17 21:48:51.085615 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.085562    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-sys\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.085809 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.085627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-lib-modules\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.085809 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.085657    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-podres\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.085809 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.085683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-proc\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.085809 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.085801    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-854vj\" (UniqueName: \"kubernetes.io/projected/7933b299-e0b0-4ead-99cd-d131077e41b2-kube-api-access-854vj\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.186657 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.186614    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-854vj\" (UniqueName: \"kubernetes.io/projected/7933b299-e0b0-4ead-99cd-d131077e41b2-kube-api-access-854vj\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.186843 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.186695    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-sys\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.186843 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.186718    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-lib-modules\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.186843 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.186741    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-podres\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.186843 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.186762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-proc\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.187058 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.186869    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-sys\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.187058 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.186881    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-proc\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.187058 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.186905    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-podres\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.187058 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.186908    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7933b299-e0b0-4ead-99cd-d131077e41b2-lib-modules\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.195431 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.195400    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-854vj\" (UniqueName: \"kubernetes.io/projected/7933b299-e0b0-4ead-99cd-d131077e41b2-kube-api-access-854vj\") pod \"perf-node-gather-daemonset-sbghc\" (UID: \"7933b299-e0b0-4ead-99cd-d131077e41b2\") " pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.308334 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.308223    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.489929 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.488150    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"]
Jul 17 21:48:51.493869 ip-10-0-137-0 kubenswrapper[2572]: W0717 21:48:51.493831    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7933b299_e0b0_4ead_99cd_d131077e41b2.slice/crio-2b57978b46be2104392c527afedb98d226fda61a34d9e7f39958fbd9866b2cfe WatchSource:0}: Error finding container 2b57978b46be2104392c527afedb98d226fda61a34d9e7f39958fbd9866b2cfe: Status 404 returned error can't find the container with id 2b57978b46be2104392c527afedb98d226fda61a34d9e7f39958fbd9866b2cfe
Jul 17 21:48:51.907185 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.907065    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc" event={"ID":"7933b299-e0b0-4ead-99cd-d131077e41b2","Type":"ContainerStarted","Data":"4dec4871bd84cde3212776ddc1fd85d37985b626658faa88dc38bf378aa7aa5f"}
Jul 17 21:48:51.907185 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.907175    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc" event={"ID":"7933b299-e0b0-4ead-99cd-d131077e41b2","Type":"ContainerStarted","Data":"2b57978b46be2104392c527afedb98d226fda61a34d9e7f39958fbd9866b2cfe"}
Jul 17 21:48:51.907438 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.907205    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:51.924465 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:51.924405    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc" podStartSLOduration=1.924383323 podStartE2EDuration="1.924383323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 21:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 21:48:51.922451227 +0000 UTC m=+2699.452359678" watchObservedRunningTime="2026-07-17 21:48:51.924383323 +0000 UTC m=+2699.454291776"
Jul 17 21:48:53.757251 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:53.757218    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5tpzl_99786898-d573-4ee0-a307-ef5c848a1a70/dns/0.log"
Jul 17 21:48:53.776959 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:53.776935    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5tpzl_99786898-d573-4ee0-a307-ef5c848a1a70/kube-rbac-proxy/0.log"
Jul 17 21:48:53.887021 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:53.886370    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2j9x5_9e163732-682d-4aa7-a99c-5d82c8cf0861/dns-node-resolver/0.log"
Jul 17 21:48:54.505027 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:54.504984    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tpzdz_8e03b4ca-563b-404d-9d47-1d53ad3d7428/node-ca/0.log"
Jul 17 21:48:55.597894 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:55.597855    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-748bb598b7-z774l_8ba642ea-f938-4f9d-af29-11512af935f6/kube-auth-proxy/0.log"
Jul 17 21:48:55.685734 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:55.685697    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-5gczm_58556bff-d5df-461a-885f-f59b30a0c9a2/payload-pre-processing/0.log"
Jul 17 21:48:55.741262 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:55.741237    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd6b8fd68-w4fm4_8beac0d0-ad13-4ade-91d3-f69bdcf90233/router/0.log"
Jul 17 21:48:56.440703 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:56.440674    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnzsx_87cd57bb-9e42-4eb1-98bd-37643cb82c86/serve-healthcheck-canary/0.log"
Jul 17 21:48:56.918940 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:56.918912    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9sj9_b93858dd-2569-41a3-a57a-36e97405d3c4/kube-rbac-proxy/0.log"
Jul 17 21:48:56.938430 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:56.938406    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9sj9_b93858dd-2569-41a3-a57a-36e97405d3c4/exporter/0.log"
Jul 17 21:48:56.958231 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:56.958203    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9sj9_b93858dd-2569-41a3-a57a-36e97405d3c4/extractor/0.log"
Jul 17 21:48:57.925542 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:57.925512    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jqx7f/perf-node-gather-daemonset-sbghc"
Jul 17 21:48:59.071324 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:59.071267    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-hqs6r_b6ebbfbb-fffa-4d3c-b5f1-fc7b63094795/manager/0.log"
Jul 17 21:48:59.327876 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:59.327795    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-x6l4k_8f80c1a6-430d-4629-a1d0-297973844e42/manager/0.log"
Jul 17 21:48:59.472325 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:59.472269    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fff89cdb-jp2hh_b763b34b-ddcd-44ec-96b9-3ddd38339327/manager/0.log"
Jul 17 21:48:59.495200 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:59.495170    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-96mgs_d6012ec7-6f6b-4fb4-b2cd-842721888c51/server/0.log"
Jul 17 21:48:59.581530 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:59.581445    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-tbwnk_28d66e03-094c-419c-9229-4afb12be1f4f/manager/0.log"
Jul 17 21:48:59.785028 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:59.784996    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx_26c50181-c255-4d92-9477-19154a7ebc49/manager/0.log"
Jul 17 21:48:59.808610 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:48:59.808584    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5dd64c6cb8-k6sjx_26c50181-c255-4d92-9477-19154a7ebc49/copy-manifests/0.log"
Jul 17 21:49:01.251664 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:01.251622    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-748bb598b7-z774l_8ba642ea-f938-4f9d-af29-11512af935f6/kube-auth-proxy/0.log"
Jul 17 21:49:01.320970 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:01.320888    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-5gczm_58556bff-d5df-461a-885f-f59b30a0c9a2/payload-pre-processing/0.log"
Jul 17 21:49:01.369245 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:01.369218    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd6b8fd68-w4fm4_8beac0d0-ad13-4ade-91d3-f69bdcf90233/router/0.log"
Jul 17 21:49:02.648616 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:02.648587    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-748bb598b7-z774l_8ba642ea-f938-4f9d-af29-11512af935f6/kube-auth-proxy/0.log"
Jul 17 21:49:02.720809 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:02.720777    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-5gczm_58556bff-d5df-461a-885f-f59b30a0c9a2/payload-pre-processing/0.log"
Jul 17 21:49:02.764332 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:02.764306    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5cd6b8fd68-w4fm4_8beac0d0-ad13-4ade-91d3-f69bdcf90233/router/0.log"
Jul 17 21:49:07.292642 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:07.292616    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp87_e834921f-1ae1-4d74-ad9a-622697f5ab2f/kube-multus-additional-cni-plugins/0.log"
Jul 17 21:49:07.312731 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:07.312704    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp87_e834921f-1ae1-4d74-ad9a-622697f5ab2f/egress-router-binary-copy/0.log"
Jul 17 21:49:07.332696 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:07.332675    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp87_e834921f-1ae1-4d74-ad9a-622697f5ab2f/cni-plugins/0.log"
Jul 17 21:49:07.351934 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:07.351908    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp87_e834921f-1ae1-4d74-ad9a-622697f5ab2f/bond-cni-plugin/0.log"
Jul 17 21:49:07.371041 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:07.371019    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp87_e834921f-1ae1-4d74-ad9a-622697f5ab2f/routeoverride-cni/0.log"
Jul 17 21:49:07.390407 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:07.390381    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp87_e834921f-1ae1-4d74-ad9a-622697f5ab2f/whereabouts-cni-bincopy/0.log"
Jul 17 21:49:07.412618 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:07.412592    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7cp87_e834921f-1ae1-4d74-ad9a-622697f5ab2f/whereabouts-cni/0.log"
Jul 17 21:49:07.758250 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:07.758226    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pcpmh_53de50e6-612c-42d2-b369-675257d073d7/kube-multus/0.log"
Jul 17 21:49:07.818411 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:07.818329    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-79c8q_10b57b9b-866e-49c3-a9d8-344a58e8cd6c/network-metrics-daemon/0.log"
Jul 17 21:49:07.836672 ip-10-0-137-0 kubenswrapper[2572]: I0717 21:49:07.836649    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-79c8q_10b57b9b-866e-49c3-a9d8-344a58e8cd6c/kube-rbac-proxy/0.log"