Jul 23 09:52:47.743369 ip-10-0-141-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 09:52:47.743384 ip-10-0-141-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 09:52:47.743394 ip-10-0-141-187 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 09:52:47.743751 ip-10-0-141-187 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 09:52:59.130260 ip-10-0-141-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 09:52:59.130279 ip-10-0-141-187 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d6fa0a12ff9f4571b72f29000f79fe90 --
Jul 23 09:54:39.968582 ip-10-0-141-187 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 09:54:40.374479 ip-10-0-141-187 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 09:54:40.374479 ip-10-0-141-187 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 09:54:40.374479 ip-10-0-141-187 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 09:54:40.374479 ip-10-0-141-187 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 09:54:40.374479 ip-10-0-141-187 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 09:54:40.377067 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.376945    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 09:54:40.383350 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383329    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:40.383350 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383350    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383354    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383358    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383361    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383364    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383367    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383376    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383379    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383383    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383386    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383388    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383390    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383393    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383396    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383399    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383401    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383404    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383407    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383409    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383412    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:40.383440 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383414    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383417    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383420    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383422    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383424    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383427    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383429    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383432    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383434    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383436    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383439    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383441    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383444    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383447    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383450    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383453    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383455    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383458    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383461    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383464    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:40.383899 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383466    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383468    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383471    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383473    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383475    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383478    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383480    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383482    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383485    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383488    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383490    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383494    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383498    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383500    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383504    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383507    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383510    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383512    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383515    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:40.384413 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383517    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383519    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383524    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383528    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383531    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383534    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383538    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383541    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383543    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383546    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383549    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383553    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383556    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383558    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383561    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383564    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383566    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383568    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383571    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383573    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:40.384887 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383575    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383578    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383580    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383582    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383585    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383587    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383590    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383593    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383596    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383599    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383601    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383604    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383606    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383608    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383611    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383613    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383615    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383618    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.383620    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:40.385382 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384374    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384382    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384386    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384389    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384392    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384395    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384398    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384401    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384404    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384406    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384409    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384412    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384414    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384417    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384420    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384422    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384425    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384427    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384430    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:40.385902 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384433    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384437    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384440    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384443    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384445    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384448    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384450    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384453    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384455    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384458    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384460    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384463    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384465    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384468    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384470    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384472    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384475    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384477    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384480    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384483    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:40.386385 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384485    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384488    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384491    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384493    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384496    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384498    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384501    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384503    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384505    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384508    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384511    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384513    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384516    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384519    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384522    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384524    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384527    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384529    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384532    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384534    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:40.386873 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384536    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384538    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384541    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384543    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384546    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384548    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384550    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384553    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384556    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384558    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384560    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384565    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384568    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384572    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384575    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384578    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384581    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384583    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384586    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384588    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:40.387379 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384591    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384593    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384595    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384598    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384600    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384603    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384606    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384608    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384611    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384613    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384616    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384618    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384621    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384623    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384626    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384628    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384630    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384633    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384635    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:40.387865 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.384638    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385065    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385072    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385076    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385079    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385083    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385086    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385089    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385092    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385095    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385098    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385100    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385103    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385106    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385109    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385111    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385114    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385116    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385119    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385122    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:40.388374 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385125    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385128    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385130    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385133    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385136    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385138    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385140    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385143    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385145    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385147    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385150    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385152    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385155    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385157    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385160    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385162    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385165    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385168    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385171    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385173    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:40.388869 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385177    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385180    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385183    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385186    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385191    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385196    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385200    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385204    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385206    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385209    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385212    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385215    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385217    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385220    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385223    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385225    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385227    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385230    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385232    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385235    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:40.389380 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385237    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385239    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385242    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385244    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385247    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385266    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385269    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385272    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385275    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385277    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385280    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385283    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385286    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385288    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385291    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385293    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385295    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385298    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385300    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385303    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:40.389868 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385305    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385308    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385313    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385316    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385319    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385322    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385325    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385328    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385331    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385333    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385336    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385338    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385340    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385343    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385345    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385348    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385350    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385353    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385356    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:40.390357 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.385358    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385433    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385440    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385446    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385450    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385455    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385458    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385463    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385468    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385471    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385474    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385477    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385481    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385484    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385487    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385491    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385494    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385498    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385500    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385505    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385508    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385511    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385514    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385520    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 09:54:40.390893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385523    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385526    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385529    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385532    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385535    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385538    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385540    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385544    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385546    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385550    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385553    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385556    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385559    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385562    2564 flags.go:64] FLAG: --enable-server="true"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385565    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385569    2564 flags.go:64] FLAG: --event-burst="100"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385572    2564 flags.go:64] FLAG: --event-qps="50"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385575    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385578    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385581    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385584    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385587    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385590    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385594    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385597    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 09:54:40.391492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385600    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385603    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385606    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385608    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385611    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385614    2564 flags.go:64] FLAG: --feature-gates=""
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385619    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385623    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385626    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385628    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385631    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385639    2564 flags.go:64] FLAG: --help="false"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385641    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385645    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385647    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385650    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385654    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385657    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385660    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385662    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385665    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385668    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385672    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385675    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 09:54:40.392128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385678    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385680    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385683    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385685    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385688    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385691    2564 flags.go:64] FLAG: --lock-file=""
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385695    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385698    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385701    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385706    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385709    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385712    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385714    2564 flags.go:64] FLAG: --logging-format="text"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385717    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385721    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385724    2564 flags.go:64] FLAG: --manifest-url=""
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385727    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385731    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385734    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385738    2564 flags.go:64] FLAG: --max-pods="110"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385741    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385743    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385746    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385749    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385752    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 09:54:40.392734 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385755    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385758    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385764    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385767    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385770    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385773    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385777    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385783    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385785    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385788    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385791    2564 flags.go:64] FLAG: --port="10250"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385794    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385797    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-056f1bbfe4de30098"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385800    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385804    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385806    2564 flags.go:64] FLAG: --register-node="true"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385809    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385812    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385815    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385818    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385820    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385826    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385829    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385832    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385835    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 09:54:40.393399 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385837    2564 flags.go:64] FLAG: --runonce="false"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385840    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385843    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385845    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385848    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385851    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385854    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385857    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385860    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385862    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385865    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385867    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385870    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385873    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385876    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385879    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385884    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385887    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385890    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385894    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385896    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385900    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385903    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385905    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385908    2564 flags.go:64] FLAG: --v="2"
Jul 23 09:54:40.394037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385912    2564 flags.go:64] FLAG: --version="false"
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385916    2564 flags.go:64] FLAG: --vmodule=""
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385920    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.385924    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386037    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386042    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386046    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386049    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386053    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386056    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386058    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386061    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386064    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386066    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386068    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386071    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386073    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386076    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386078    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386081    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:40.394742 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386083    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386085    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386088    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386091    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386094    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386096    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386098    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386101    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386105    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386107    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386110    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386114    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386117    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386120    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386122    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386126    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386129    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386131    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386134    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:40.395516 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386136    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386139    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386141    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386143    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386146    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386148    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386150    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386153    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386156    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386158    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386160    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386163    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386165    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386168    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386170    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386172    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386176    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386178    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386181    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386183    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:40.396090 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386186    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386190    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386192    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386195    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386197    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386200    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386202    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386205    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386208    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386211    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386213    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386216    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386218    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386220    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386223    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386225    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386228    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386230    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386233    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386236    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:40.396618 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386240    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386242    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386245    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386247    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386263    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386267    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386269    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386272    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386274    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386277    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386280    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386282    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386285    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386289    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386292    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386294    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386297    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386299    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386302    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386305    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:40.397107 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386309    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386312    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386314    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.386317    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.387033    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.395335    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.395358    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.395386    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.395395    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395579    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395594    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395599    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395604    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395609    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395613    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:40.397673 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395617    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395621    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395625    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395629    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395634    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395639    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395643    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395647    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395657    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395662    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395666    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395671    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395675    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395679    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395684    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395688    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395692    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395696    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395702    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:40.398053 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395709    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395721    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395725    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395729    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395826    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395854    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395861    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395865    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395870    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395894    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395898    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.395903    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396058    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396063    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396066    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396069    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396072    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396075    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396078    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396081    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:40.398543 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396083    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396086    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396089    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396091    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396094    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396097    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396102    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396107    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396110    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396113    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396116    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396118    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396121    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396123    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396126    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396129    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396131    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396134    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396137    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:40.399124 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396139    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396142    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396144    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396147    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396149    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396154    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396156    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396159    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396162    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396164    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396167    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396170    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396172    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396175    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396177    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396180    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396182    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396185    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396187    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396190    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:40.399595 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396192    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396195    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396197    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396200    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396203    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396205    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396208    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396210    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396212    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396215    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396218    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396220    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396223    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396225    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396228    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:40.400091 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.396234    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396382    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396387    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396390    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396394    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396396    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396399    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396403    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396407    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396411    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396414    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396417    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396420    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396422    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396425    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396429    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396431    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396434    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396436    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396439    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 09:54:40.400501 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396442    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396445    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396447    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396450    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396452    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396455    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396457    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396460    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396462    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396466    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396470    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396473    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396476    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396479    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396481    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396484    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396487    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396490    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396493    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396495    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 09:54:40.400998 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396497    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396500    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396502    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396505    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396507    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396510    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396515    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396517    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396520    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396522    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396525    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396527    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396530    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396533    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396535    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396538    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396540    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396543    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396545    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396547    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 09:54:40.401670 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396550    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396552    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396554    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396557    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396559    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396562    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396564    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396569    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396571    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396574    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396577    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396581    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396585    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396588    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396590    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396593    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396596    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396598    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396601    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 09:54:40.402160 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396604    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396607    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396609    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396612    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396614    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396617    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396620    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396623    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396625    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396628    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396631    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396633    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396636    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396638    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396641    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396643    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396646    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396648    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396651    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396653    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 09:54:40.402654 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:40.396657    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 09:54:40.403145 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.396662    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 09:54:40.403145 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.396799    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 09:54:40.403145 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.399861    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 09:54:40.403145 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.401485    2564 server.go:1019] "Starting client certificate rotation"
Jul 23 09:54:40.403145 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.401584    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 09:54:40.403145 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.401622    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 09:54:40.403868 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.403853    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 09:54:40.405204 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.405192    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 09:54:40.415751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.415726    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 23 09:54:40.418027 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.418008    2564 log.go:25] "Validated CRI v1 image API"
Jul 23 09:54:40.420481 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.420466    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 09:54:40.422880 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.422858    2564 fs.go:135] Filesystem UUIDs: map[4f7eac50-5aa0-4a87-b6f6-482806b3e467:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a0c6407b-cbbb-4458-a1b8-ca8728ceb103:/dev/nvme0n1p4]
Jul 23 09:54:40.422960 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.422879    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 09:54:40.427993 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.427855    2564 manager.go:216] Machine: {Timestamp:2026-07-23 09:54:40.426542863 +0000 UTC m=+0.330231140 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107958 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec222f3ad1c7721b87a41169878ed578 SystemUUID:ec222f3a-d1c7-721b-87a4-1169878ed578 BootID:d6fa0a12-ff9f-4571-b72f-29000f79fe90 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f3:8f:64:3a:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f3:8f:64:3a:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:a4:64:fd:69:b2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 09:54:40.427993 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.427980    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 09:54:40.428122 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.428078    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 09:54:40.429183 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.429160    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 09:54:40.430899 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.430871    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 09:54:40.431083 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.430913    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 09:54:40.431683 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.431671    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 09:54:40.431717 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.431685    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 09:54:40.431717 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.431693    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 09:54:40.432395 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.432384    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 09:54:40.433793 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.433781    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 09:54:40.436560 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.436547    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 09:54:40.436713 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.436702    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 09:54:40.436760 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.436734    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 09:54:40.436760 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.436750    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 09:54:40.436831 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.436761    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 09:54:40.436831 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.436769    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 23 09:54:40.436831 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.436778    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 09:54:40.437372 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.437352    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 09:54:40.437505 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.437384    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 09:54:40.441940 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.441917    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 09:54:40.443826 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.443812    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 09:54:40.443878 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.443843    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 09:54:40.444944 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.444932    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 09:54:40.444990 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.444949    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 09:54:40.444990 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.444955    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 09:54:40.444990 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.444961    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 09:54:40.444990 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.444970    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 09:54:40.444990 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.444976    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 09:54:40.444990 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.444985    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 09:54:40.444990 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.444991    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 09:54:40.445170 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.444998    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 09:54:40.445170 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.445003    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 09:54:40.445170 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.445012    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 09:54:40.445170 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.445017    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 09:54:40.445797 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.445788    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 09:54:40.445797 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.445797    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 09:54:40.446557 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.446535    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fn7qm"
Jul 23 09:54:40.448569 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.448551    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 09:54:40.449267 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.449228    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 09:54:40.449305 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.449226    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 09:54:40.449454 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.449442    2564 server.go:1268] "Started kubelet"
Jul 23 09:54:40.449561 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.449532    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 09:54:40.449661 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.449612    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 09:54:40.449720 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.449689    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 09:54:40.450447 ip-10-0-141-187 systemd[1]: Started Kubernetes Kubelet.
Jul 23 09:54:40.451596 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.451579    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 09:54:40.451800 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.451782    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 09:54:40.454965 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.454946    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fn7qm"
Jul 23 09:54:40.455123 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.455103    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 09:54:40.458893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.458875    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 09:54:40.459000 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.458894    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 09:54:40.459142 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.459120    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:40.459288 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.458162    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-187.ec2.internal.18c4e294a8224b2a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-187.ec2.internal,UID:ip-10-0-141-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-187.ec2.internal,},FirstTimestamp:2026-07-23 09:54:40.449415978 +0000 UTC m=+0.353104243,LastTimestamp:2026-07-23 09:54:40.449415978 +0000 UTC m=+0.353104243,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-187.ec2.internal,}"
Jul 23 09:54:40.459543 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.459512    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 09:54:40.459632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.459522    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 09:54:40.459632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.459607    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 09:54:40.459978 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.459775    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 09:54:40.459978 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.459800    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 09:54:40.460208 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.460186    2564 factory.go:55] Registering systemd factory
Jul 23 09:54:40.460328 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.460227    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 23 09:54:40.460574 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.460557    2564 factory.go:153] Registering CRI-O factory
Jul 23 09:54:40.460574 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.460574    2564 factory.go:223] Registration of the crio container factory successfully
Jul 23 09:54:40.460711 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.460621    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 09:54:40.460711 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.460645    2564 factory.go:103] Registering Raw factory
Jul 23 09:54:40.460711 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.460658    2564 manager.go:1196] Started watching for new ooms in manager
Jul 23 09:54:40.461477 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.461462    2564 manager.go:349] Starting recovery of all containers
Jul 23 09:54:40.474117 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.474089    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:40.474761 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.474744    2564 manager.go:354] Recovery completed
Jul 23 09:54:40.478321 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.478298    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-187.ec2.internal\" not found" node="ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.479227 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.479214    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:40.481240 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.481087    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:40.481389 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.481375    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:40.481427 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.481403    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:40.481944 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.481926    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 09:54:40.481944 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.481941    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 09:54:40.481944 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.481944    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:40.482127 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.481961    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 09:54:40.482723 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.482708    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:40.482772 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.482734    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:40.482772 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.482744    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:40.483041 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.483030    2564 policy_none.go:49] "None policy: Start"
Jul 23 09:54:40.483075 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.483045    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 09:54:40.483075 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.483056    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 09:54:40.484075 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.484064    2564 policy_none.go:47] "Start"
Jul 23 09:54:40.537050 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.537028    2564 manager.go:337] "Starting Device Plugin manager"
Jul 23 09:54:40.538568 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.537067    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 09:54:40.538568 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.537078    2564 server.go:87] "Starting device plugin registration server"
Jul 23 09:54:40.538568 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.537697    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 09:54:40.538568 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.537712    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 09:54:40.538568 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.537815    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 09:54:40.538568 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.537926    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 09:54:40.538568 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.537935    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 09:54:40.538806 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.538583    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 09:54:40.538806 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.538646    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:40.602266 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.602204    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 09:54:40.603666 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.603639    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 09:54:40.603793 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.603676    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 09:54:40.603793 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.603712    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 09:54:40.603793 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.603753    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 09:54:40.606491 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.606475    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:40.638746 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.638720    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:40.639682 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.639661    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:40.639771 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.639698    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:40.639771 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.639719    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:40.639771 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.639743    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.647993 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.647973    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.648052 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.648000    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-187.ec2.internal\": node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:40.664902 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.664875    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:40.704773 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.704715    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"]
Jul 23 09:54:40.704874 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.704819    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:40.706504 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.706484    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:40.706610 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.706519    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:40.706610 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.706532    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:40.707714 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.707702    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:40.707831 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.707818    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.707875 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.707860    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:40.708414 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.708402    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:40.708476 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.708426    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:40.708476 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.708452    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:40.708544 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.708485    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:40.708544 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.708509    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:40.708544 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.708526    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:40.709764 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.709747    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.709857 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.709774    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 09:54:40.710473 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.710459    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 09:54:40.710551 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.710478    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 09:54:40.710551 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.710490    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 23 09:54:40.734081 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.734052    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-187.ec2.internal\" not found" node="ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.738659 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.738631    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-187.ec2.internal\" not found" node="ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.761173 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.761138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d5f9f47f138113a7d5fd4a2b132e429-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"6d5f9f47f138113a7d5fd4a2b132e429\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.761325 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.761179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d5f9f47f138113a7d5fd4a2b132e429-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"6d5f9f47f138113a7d5fd4a2b132e429\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.761325 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.761202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8751f98f709c66f3539a477cf86c9438-config\") pod \"kube-apiserver-proxy-ip-10-0-141-187.ec2.internal\" (UID: \"8751f98f709c66f3539a477cf86c9438\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.765620 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.765600    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:40.861350 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.861313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d5f9f47f138113a7d5fd4a2b132e429-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"6d5f9f47f138113a7d5fd4a2b132e429\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.861350 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.861351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8751f98f709c66f3539a477cf86c9438-config\") pod \"kube-apiserver-proxy-ip-10-0-141-187.ec2.internal\" (UID: \"8751f98f709c66f3539a477cf86c9438\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.861564 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.861370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d5f9f47f138113a7d5fd4a2b132e429-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"6d5f9f47f138113a7d5fd4a2b132e429\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.861564 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.861398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6d5f9f47f138113a7d5fd4a2b132e429-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"6d5f9f47f138113a7d5fd4a2b132e429\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.861564 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.861426    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d5f9f47f138113a7d5fd4a2b132e429-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"6d5f9f47f138113a7d5fd4a2b132e429\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.861564 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:40.861428    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8751f98f709c66f3539a477cf86c9438-config\") pod \"kube-apiserver-proxy-ip-10-0-141-187.ec2.internal\" (UID: \"8751f98f709c66f3539a477cf86c9438\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:40.866417 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.866395    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:40.967239 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:40.967158    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:41.037398 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.037361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:41.041547 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.041332    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:41.067787 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.067751    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:41.168327 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.168294    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:41.268925 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.268855    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:41.369550 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.369509    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 23 09:54:41.400711 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.400673    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 09:54:41.401318 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.400871    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 09:54:41.401318 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.400871    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 09:54:41.426117 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.426093    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:41.438330 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.438300    2564 apiserver.go:52] "Watching apiserver"
Jul 23 09:54:41.448833 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.448808    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 09:54:41.449184 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.449160    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-x9fcp","kube-system/konnectivity-agent-d727z","openshift-image-registry/node-ca-lhx2q","openshift-multus/network-metrics-daemon-gpp2p","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb","openshift-cluster-node-tuning-operator/tuned-25tsp","openshift-dns/node-resolver-cc9zb","openshift-multus/multus-additional-cni-plugins-ltwkn","openshift-multus/multus-dgvmd","openshift-network-diagnostics/network-check-target-v67vm","openshift-network-operator/iptables-alerter-btmqv","openshift-ovn-kubernetes/ovnkube-node-g7c9b"]
Jul 23 09:54:41.450772 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.450749    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:41.450872 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.450830    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:54:41.452337 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.452319    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:54:41.453538 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.453522    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.455100 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.454972    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:41.455100 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.455060    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-2hpvn\""
Jul 23 09:54:41.455100 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.455069    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 09:54:41.455471 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.455359    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:54:41.456985 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.455672    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 09:54:41.456985 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.455844    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 09:54:41.456985 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.455920    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 09:54:41.456985 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.456381    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jcsmx\""
Jul 23 09:54:41.456985 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.456818    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 09:54:41.457344 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.457324    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.458834 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.458800    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 09:49:40 +0000 UTC" deadline="2028-01-06 21:15:45.42283428 +0000 UTC"
Jul 23 09:54:41.458834 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.458833    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12779h21m3.964003499s"
Jul 23 09:54:41.458957 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.458918    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.459064 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.459027    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 09:54:41.459140 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.459092    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:41.459501 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.459485    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 09:54:41.459809 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.459795    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 09:54:41.459984 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.459943    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gl2rf\""
Jul 23 09:54:41.460166 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.460154    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 09:54:41.460694 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.460680    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.461321 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.461294    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 09:54:41.461395 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.461363    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fgkx9\""
Jul 23 09:54:41.461516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.461504    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 09:54:41.462189 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.462174    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.463116 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.463095    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 09:54:41.463208 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.463095    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q7zm8\""
Jul 23 09:54:41.463208 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.463098    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 09:54:41.463963 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.463945    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.464465 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-modprobe-d\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.464548 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464477    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-var-lib-kubelet\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.464548 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-sys-fs\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.464548 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464510    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 09:54:41.464697 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464546    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ba9d1476-4001-4f45-8cf4-d99c58643653-hosts-file\") pod \"node-resolver-cc9zb\" (UID: \"ba9d1476-4001-4f45-8cf4-d99c58643653\") " pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.464697 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-kubernetes\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.464697 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464590    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-sys\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.464697 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.464697 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee687b05-645e-4ce7-bb53-b830df9c85c7-konnectivity-ca\") pod \"konnectivity-agent-d727z\" (UID: \"ee687b05-645e-4ce7-bb53-b830df9c85c7\") " pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:54:41.464697 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjk6j\" (UniqueName: \"kubernetes.io/projected/f816c379-732d-46bb-83cb-1b7230cf16df-kube-api-access-vjk6j\") pod \"node-ca-lhx2q\" (UID: \"f816c379-732d-46bb-83cb-1b7230cf16df\") " pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.464697 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-lib-modules\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5hnb\" (UniqueName: \"kubernetes.io/projected/6ea77770-0025-460e-8267-20e0507eac48-kube-api-access-b5hnb\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464751    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e8212ab-e7db-4401-a85e-692f2df349ee-kubelet-config\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464766    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464777    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-sysctl-d\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ea77770-0025-460e-8267-20e0507eac48-tmp\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-registration-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464865    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464876    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464905    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7pvrs\""
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464878    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-sysconfig\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.464977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-systemd\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465001    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-host\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465032    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e8212ab-e7db-4401-a85e-692f2df349ee-dbus\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:41.465068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465070    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465090    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqtqp\" (UniqueName: \"kubernetes.io/projected/0e4b7584-707c-4900-841c-5e86930a2695-kube-api-access-mqtqp\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465121    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465153    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-socket-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465171    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-sysctl-conf\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-run\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465281    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prnd2\" (UniqueName: \"kubernetes.io/projected/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-kube-api-access-prnd2\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f816c379-732d-46bb-83cb-1b7230cf16df-host\") pod \"node-ca-lhx2q\" (UID: \"f816c379-732d-46bb-83cb-1b7230cf16df\") " pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465327    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ea77770-0025-460e-8267-20e0507eac48-etc-tuned\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-device-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmgpx\" (UniqueName: \"kubernetes.io/projected/ba9d1476-4001-4f45-8cf4-d99c58643653-kube-api-access-lmgpx\") pod \"node-resolver-cc9zb\" (UID: \"ba9d1476-4001-4f45-8cf4-d99c58643653\") " pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9d1476-4001-4f45-8cf4-d99c58643653-tmp-dir\") pod \"node-resolver-cc9zb\" (UID: \"ba9d1476-4001-4f45-8cf4-d99c58643653\") " pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee687b05-645e-4ce7-bb53-b830df9c85c7-agent-certs\") pod \"konnectivity-agent-d727z\" (UID: \"ee687b05-645e-4ce7-bb53-b830df9c85c7\") " pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:54:41.465736 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.465479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f816c379-732d-46bb-83cb-1b7230cf16df-serviceca\") pod \"node-ca-lhx2q\" (UID: \"f816c379-732d-46bb-83cb-1b7230cf16df\") " pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.466485 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.466040    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:41.466485 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.466092    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:54:41.466485 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.466154    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t96tt\""
Jul 23 09:54:41.466650 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.466495    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 09:54:41.467911 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.467888    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 09:54:41.467989 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.467953    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 23 09:54:41.468124 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.468110    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.470501 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.470348    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 09:54:41.470501 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.470474    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"]
Jul 23 09:54:41.470761 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.470741    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r68nk\""
Jul 23 09:54:41.470855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.470744    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 09:54:41.470855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.470745    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 09:54:41.471031 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.471014    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.473243 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.473225    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 09:54:41.473523 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.473507    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 09:54:41.473662 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.473650    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 09:54:41.475055 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.475039    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rshdf\""
Jul 23 09:54:41.475646 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.475631    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 09:54:41.475723 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.475688    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 09:54:41.475723 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.475700    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 09:54:41.475834 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.475692    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 09:54:41.478215 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.478193    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 09:54:41.478322 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.478306    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"]
Jul 23 09:54:41.491032 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.491009    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ckvwz"
Jul 23 09:54:41.498799 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.498774    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ckvwz"
Jul 23 09:54:41.560762 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.560739    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 09:54:41.565944 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.565918    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-sysctl-d\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.566037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.565950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ea77770-0025-460e-8267-20e0507eac48-tmp\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.566037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.565973    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-log-socket\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.566037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566008    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrrg7\" (UniqueName: \"kubernetes.io/projected/a1580c5d-8c66-4cf8-8ead-874da37ffa96-kube-api-access-mrrg7\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.566037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-sysconfig\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-systemd\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566056    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqtqp\" (UniqueName: \"kubernetes.io/projected/0e4b7584-707c-4900-841c-5e86930a2695-kube-api-access-mqtqp\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566086    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-socket-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566119    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-sysctl-d\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566126    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-systemd\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566157    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-sysconfig\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-cnibin\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.566218    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566238    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-socket-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.566285 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzcbq\" (UniqueName: \"kubernetes.io/projected/74961b81-9ad0-4de2-b990-f363869d36b0-kube-api-access-wzcbq\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566290    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-multus-socket-dir-parent\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566298    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-sysctl-conf\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-run-netns\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.566416    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs podName:0e4b7584-707c-4900-841c-5e86930a2695 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:42.066373675 +0000 UTC m=+1.970061946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs") pod "network-metrics-daemon-gpp2p" (UID: "0e4b7584-707c-4900-841c-5e86930a2695") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-sysctl-conf\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-run-systemd\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566486    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-run-ovn\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566511    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-cni-netd\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f816c379-732d-46bb-83cb-1b7230cf16df-host\") pod \"node-ca-lhx2q\" (UID: \"f816c379-732d-46bb-83cb-1b7230cf16df\") " pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1580c5d-8c66-4cf8-8ead-874da37ffa96-env-overrides\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566590    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5f215cc-5178-4054-bfe5-969fcf774862-cni-binary-copy\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a72764a-6089-43de-a318-c94b88395203-host-slash\") pod \"iptables-alerter-btmqv\" (UID: \"0a72764a-6089-43de-a318-c94b88395203\") " pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.566632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566640    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f816c379-732d-46bb-83cb-1b7230cf16df-host\") pod \"node-ca-lhx2q\" (UID: \"f816c379-732d-46bb-83cb-1b7230cf16df\") " pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566641    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74961b81-9ad0-4de2-b990-f363869d36b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566679    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74961b81-9ad0-4de2-b990-f363869d36b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-run-netns\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566733    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5f215cc-5178-4054-bfe5-969fcf774862-multus-daemon-config\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566769    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9d1476-4001-4f45-8cf4-d99c58643653-tmp-dir\") pod \"node-resolver-cc9zb\" (UID: \"ba9d1476-4001-4f45-8cf4-d99c58643653\") " pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566798    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-var-lib-kubelet\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566822    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf545\" (UniqueName: \"kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545\") pod \"network-check-target-v67vm\" (UID: \"08b14c0d-270a-4624-932c-1d7fa6973e0a\") " pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-system-cni-dir\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-multus-cni-dir\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-var-lib-kubelet\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-os-release\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ba9d1476-4001-4f45-8cf4-d99c58643653-hosts-file\") pod \"node-resolver-cc9zb\" (UID: \"ba9d1476-4001-4f45-8cf4-d99c58643653\") " pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-sys\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566965    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-sys\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.566994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567001    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ba9d1476-4001-4f45-8cf4-d99c58643653-hosts-file\") pod \"node-resolver-cc9zb\" (UID: \"ba9d1476-4001-4f45-8cf4-d99c58643653\") " pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.567246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba9d1476-4001-4f45-8cf4-d99c58643653-tmp-dir\") pod \"node-resolver-cc9zb\" (UID: \"ba9d1476-4001-4f45-8cf4-d99c58643653\") " pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-etc-kubernetes\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee687b05-645e-4ce7-bb53-b830df9c85c7-konnectivity-ca\") pod \"konnectivity-agent-d727z\" (UID: \"ee687b05-645e-4ce7-bb53-b830df9c85c7\") " pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjk6j\" (UniqueName: \"kubernetes.io/projected/f816c379-732d-46bb-83cb-1b7230cf16df-kube-api-access-vjk6j\") pod \"node-ca-lhx2q\" (UID: \"f816c379-732d-46bb-83cb-1b7230cf16df\") " pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567087    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-lib-modules\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567099    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a72764a-6089-43de-a318-c94b88395203-iptables-alerter-script\") pod \"iptables-alerter-btmqv\" (UID: \"0a72764a-6089-43de-a318-c94b88395203\") " pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1580c5d-8c66-4cf8-8ead-874da37ffa96-ovn-node-metrics-cert\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-run-k8s-cni-cncf-io\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-registration-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-systemd-units\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567222    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-slash\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-lib-modules\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-var-lib-cni-bin\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-registration-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-host\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567303    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e8212ab-e7db-4401-a85e-692f2df349ee-dbus\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:41.568143 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567319    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567324    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-host\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567344    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prnd2\" (UniqueName: \"kubernetes.io/projected/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-kube-api-access-prnd2\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567362    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567412    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-run\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4e8212ab-e7db-4401-a85e-692f2df349ee-dbus\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567476    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-run\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-etc-openvswitch\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567555    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74961b81-9ad0-4de2-b990-f363869d36b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.567584    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567601    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-var-lib-cni-multus\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567623    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ea77770-0025-460e-8267-20e0507eac48-etc-tuned\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.568749 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.567655    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret podName:4e8212ab-e7db-4401-a85e-692f2df349ee nodeName:}" failed. No retries permitted until 2026-07-23 09:54:42.067638901 +0000 UTC m=+1.971327157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret") pod "global-pull-secret-syncer-x9fcp" (UID: "4e8212ab-e7db-4401-a85e-692f2df349ee") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-device-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567701    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ee687b05-645e-4ce7-bb53-b830df9c85c7-konnectivity-ca\") pod \"konnectivity-agent-d727z\" (UID: \"ee687b05-645e-4ce7-bb53-b830df9c85c7\") " pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-device-dir\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567707    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1580c5d-8c66-4cf8-8ead-874da37ffa96-ovnkube-config\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567780    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1580c5d-8c66-4cf8-8ead-874da37ffa96-ovnkube-script-lib\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567805    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-os-release\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567828    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-multus-conf-dir\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmgpx\" (UniqueName: \"kubernetes.io/projected/ba9d1476-4001-4f45-8cf4-d99c58643653-kube-api-access-lmgpx\") pod \"node-resolver-cc9zb\" (UID: \"ba9d1476-4001-4f45-8cf4-d99c58643653\") " pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567881    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-kubelet\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-system-cni-dir\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-cnibin\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee687b05-645e-4ce7-bb53-b830df9c85c7-agent-certs\") pod \"konnectivity-agent-d727z\" (UID: \"ee687b05-645e-4ce7-bb53-b830df9c85c7\") " pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.567980    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f816c379-732d-46bb-83cb-1b7230cf16df-serviceca\") pod \"node-ca-lhx2q\" (UID: \"f816c379-732d-46bb-83cb-1b7230cf16df\") " pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-modprobe-d\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-sys-fs\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9rq7\" (UniqueName: \"kubernetes.io/projected/0a72764a-6089-43de-a318-c94b88395203-kube-api-access-z9rq7\") pod \"iptables-alerter-btmqv\" (UID: \"0a72764a-6089-43de-a318-c94b88395203\") " pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.569200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-var-lib-openvswitch\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-run-openvswitch\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-cni-bin\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-sys-fs\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568159    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-kubernetes\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-modprobe-d\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568193    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-hostroot\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-run-multus-certs\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568240    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6ea77770-0025-460e-8267-20e0507eac48-etc-kubernetes\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568244    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blbh2\" (UniqueName: \"kubernetes.io/projected/f5f215cc-5178-4054-bfe5-969fcf774862-kube-api-access-blbh2\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5hnb\" (UniqueName: \"kubernetes.io/projected/6ea77770-0025-460e-8267-20e0507eac48-kube-api-access-b5hnb\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e8212ab-e7db-4401-a85e-692f2df349ee-kubelet-config\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-node-log\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-var-lib-kubelet\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568375    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4e8212ab-e7db-4401-a85e-692f2df349ee-kubelet-config\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.568475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f816c379-732d-46bb-83cb-1b7230cf16df-serviceca\") pod \"node-ca-lhx2q\" (UID: \"f816c379-732d-46bb-83cb-1b7230cf16df\") " pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.569621    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ea77770-0025-460e-8267-20e0507eac48-tmp\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.569718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.569706    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6ea77770-0025-460e-8267-20e0507eac48-etc-tuned\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.570386 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.570371    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ee687b05-645e-4ce7-bb53-b830df9c85c7-agent-certs\") pod \"konnectivity-agent-d727z\" (UID: \"ee687b05-645e-4ce7-bb53-b830df9c85c7\") " pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:54:41.576366 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.576343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqtqp\" (UniqueName: \"kubernetes.io/projected/0e4b7584-707c-4900-841c-5e86930a2695-kube-api-access-mqtqp\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:41.576551 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.576530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prnd2\" (UniqueName: \"kubernetes.io/projected/2cc54b5d-e44a-492f-9eb3-7be828dd31a1-kube-api-access-prnd2\") pod \"aws-ebs-csi-driver-node-6kgfb\" (UID: \"2cc54b5d-e44a-492f-9eb3-7be828dd31a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.576605 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.576547    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjk6j\" (UniqueName: \"kubernetes.io/projected/f816c379-732d-46bb-83cb-1b7230cf16df-kube-api-access-vjk6j\") pod \"node-ca-lhx2q\" (UID: \"f816c379-732d-46bb-83cb-1b7230cf16df\") " pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.579528 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.579504    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5hnb\" (UniqueName: \"kubernetes.io/projected/6ea77770-0025-460e-8267-20e0507eac48-kube-api-access-b5hnb\") pod \"tuned-25tsp\" (UID: \"6ea77770-0025-460e-8267-20e0507eac48\") " pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.580147 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.580080    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmgpx\" (UniqueName: \"kubernetes.io/projected/ba9d1476-4001-4f45-8cf4-d99c58643653-kube-api-access-lmgpx\") pod \"node-resolver-cc9zb\" (UID: \"ba9d1476-4001-4f45-8cf4-d99c58643653\") " pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.606393 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.606354    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d5f9f47f138113a7d5fd4a2b132e429.slice/crio-037cbfdd63699aba98c14fe88791062e0c63efcae3f9705954816ef8aa35a207 WatchSource:0}: Error finding container 037cbfdd63699aba98c14fe88791062e0c63efcae3f9705954816ef8aa35a207: Status 404 returned error can't find the container with id 037cbfdd63699aba98c14fe88791062e0c63efcae3f9705954816ef8aa35a207
Jul 23 09:54:41.606789 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.606767    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8751f98f709c66f3539a477cf86c9438.slice/crio-1cf993ead61d88a8d9f52b8a1afbbef49b9d64b66ec0eb03c134429f520548a3 WatchSource:0}: Error finding container 1cf993ead61d88a8d9f52b8a1afbbef49b9d64b66ec0eb03c134429f520548a3: Status 404 returned error can't find the container with id 1cf993ead61d88a8d9f52b8a1afbbef49b9d64b66ec0eb03c134429f520548a3
Jul 23 09:54:41.611502 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.611487    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 09:54:41.669161 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669121    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf545\" (UniqueName: \"kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545\") pod \"network-check-target-v67vm\" (UID: \"08b14c0d-270a-4624-932c-1d7fa6973e0a\") " pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:41.669161 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-system-cni-dir\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.669161 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669180    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-multus-cni-dir\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669196    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-os-release\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669221    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-etc-kubernetes\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669293    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-etc-kubernetes\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-system-cni-dir\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a72764a-6089-43de-a318-c94b88395203-iptables-alerter-script\") pod \"iptables-alerter-btmqv\" (UID: \"0a72764a-6089-43de-a318-c94b88395203\") " pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669329    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-os-release\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-multus-cni-dir\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1580c5d-8c66-4cf8-8ead-874da37ffa96-ovn-node-metrics-cert\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669375    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-run-k8s-cni-cncf-io\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-systemd-units\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-run-k8s-cni-cncf-io\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-slash\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.669489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669475    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-var-lib-cni-bin\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669506    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669513    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-var-lib-cni-bin\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669477    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-slash\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-systemd-units\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669553    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-etc-openvswitch\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-etc-openvswitch\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74961b81-9ad0-4de2-b990-f363869d36b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669652    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-var-lib-cni-multus\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1580c5d-8c66-4cf8-8ead-874da37ffa96-ovnkube-config\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1580c5d-8c66-4cf8-8ead-874da37ffa96-ovnkube-script-lib\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669708    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669726    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-var-lib-cni-multus\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.670082 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669728    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-os-release\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-multus-conf-dir\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-os-release\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669803    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-kubelet\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-system-cni-dir\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-cnibin\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-kubelet\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669824    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-multus-conf-dir\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9rq7\" (UniqueName: \"kubernetes.io/projected/0a72764a-6089-43de-a318-c94b88395203-kube-api-access-z9rq7\") pod \"iptables-alerter-btmqv\" (UID: \"0a72764a-6089-43de-a318-c94b88395203\") " pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669896    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-var-lib-openvswitch\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-cnibin\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669917    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-run-openvswitch\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-system-cni-dir\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-cni-bin\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669965    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-hostroot\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669969    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-var-lib-openvswitch\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a72764a-6089-43de-a318-c94b88395203-iptables-alerter-script\") pod \"iptables-alerter-btmqv\" (UID: \"0a72764a-6089-43de-a318-c94b88395203\") " pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.669991    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-run-multus-certs\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.670840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blbh2\" (UniqueName: \"kubernetes.io/projected/f5f215cc-5178-4054-bfe5-969fcf774862-kube-api-access-blbh2\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-run-openvswitch\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-cni-bin\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-node-log\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-var-lib-kubelet\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670078    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-hostroot\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-log-socket\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-var-lib-kubelet\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670134    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrrg7\" (UniqueName: \"kubernetes.io/projected/a1580c5d-8c66-4cf8-8ead-874da37ffa96-kube-api-access-mrrg7\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-node-log\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-run-multus-certs\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670195    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-cnibin\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670206    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-log-socket\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670210    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74961b81-9ad0-4de2-b990-f363869d36b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670223    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzcbq\" (UniqueName: \"kubernetes.io/projected/74961b81-9ad0-4de2-b990-f363869d36b0-kube-api-access-wzcbq\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74961b81-9ad0-4de2-b990-f363869d36b0-cnibin\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-multus-socket-dir-parent\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-run-netns\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.671516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670320    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-run-systemd\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670343    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-run-ovn\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670351    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-multus-socket-dir-parent\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-cni-netd\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-run-systemd\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1580c5d-8c66-4cf8-8ead-874da37ffa96-env-overrides\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670407    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-run-ovn\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-run-netns\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670424    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5f215cc-5178-4054-bfe5-969fcf774862-cni-binary-copy\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a1580c5d-8c66-4cf8-8ead-874da37ffa96-host-cni-netd\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670449    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a72764a-6089-43de-a318-c94b88395203-host-slash\") pod \"iptables-alerter-btmqv\" (UID: \"0a72764a-6089-43de-a318-c94b88395203\") " pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74961b81-9ad0-4de2-b990-f363869d36b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74961b81-9ad0-4de2-b990-f363869d36b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670488    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a1580c5d-8c66-4cf8-8ead-874da37ffa96-ovnkube-config\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670492    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a72764a-6089-43de-a318-c94b88395203-host-slash\") pod \"iptables-alerter-btmqv\" (UID: \"0a72764a-6089-43de-a318-c94b88395203\") " pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-run-netns\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5f215cc-5178-4054-bfe5-969fcf774862-multus-daemon-config\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.670555    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5f215cc-5178-4054-bfe5-969fcf774862-host-run-netns\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.672065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.671003    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a1580c5d-8c66-4cf8-8ead-874da37ffa96-env-overrides\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672604 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.671013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5f215cc-5178-4054-bfe5-969fcf774862-cni-binary-copy\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.672604 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.671039    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74961b81-9ad0-4de2-b990-f363869d36b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.672604 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.671095    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5f215cc-5178-4054-bfe5-969fcf774862-multus-daemon-config\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.672604 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.671166    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a1580c5d-8c66-4cf8-8ead-874da37ffa96-ovnkube-script-lib\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.672604 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.671554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74961b81-9ad0-4de2-b990-f363869d36b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.672604 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.672271    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a1580c5d-8c66-4cf8-8ead-874da37ffa96-ovn-node-metrics-cert\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.675460 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.675439    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:41.675554 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.675464    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:41.675554 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.675478    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sf545 for pod openshift-network-diagnostics/network-check-target-v67vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:41.675554 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:41.675540    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545 podName:08b14c0d-270a-4624-932c-1d7fa6973e0a nodeName:}" failed. No retries permitted until 2026-07-23 09:54:42.175522892 +0000 UTC m=+2.079211161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sf545" (UniqueName: "kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545") pod "network-check-target-v67vm" (UID: "08b14c0d-270a-4624-932c-1d7fa6973e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:41.677848 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.677821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9rq7\" (UniqueName: \"kubernetes.io/projected/0a72764a-6089-43de-a318-c94b88395203-kube-api-access-z9rq7\") pod \"iptables-alerter-btmqv\" (UID: \"0a72764a-6089-43de-a318-c94b88395203\") " pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.678056 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.678040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrrg7\" (UniqueName: \"kubernetes.io/projected/a1580c5d-8c66-4cf8-8ead-874da37ffa96-kube-api-access-mrrg7\") pod \"ovnkube-node-g7c9b\" (UID: \"a1580c5d-8c66-4cf8-8ead-874da37ffa96\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.678819 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.678794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzcbq\" (UniqueName: \"kubernetes.io/projected/74961b81-9ad0-4de2-b990-f363869d36b0-kube-api-access-wzcbq\") pod \"multus-additional-cni-plugins-ltwkn\" (UID: \"74961b81-9ad0-4de2-b990-f363869d36b0\") " pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.679059 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.679043    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blbh2\" (UniqueName: \"kubernetes.io/projected/f5f215cc-5178-4054-bfe5-969fcf774862-kube-api-access-blbh2\") pod \"multus-dgvmd\" (UID: \"f5f215cc-5178-4054-bfe5-969fcf774862\") " pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.780512 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.780479    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:54:41.788044 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.788018    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lhx2q"
Jul 23 09:54:41.791013 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.790987    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee687b05_645e_4ce7_bb53_b830df9c85c7.slice/crio-15f76d12c91828db62248a4169576d5d91f26b859bc709372459f5691542eddf WatchSource:0}: Error finding container 15f76d12c91828db62248a4169576d5d91f26b859bc709372459f5691542eddf: Status 404 returned error can't find the container with id 15f76d12c91828db62248a4169576d5d91f26b859bc709372459f5691542eddf
Jul 23 09:54:41.796204 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.796179    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf816c379_732d_46bb_83cb_1b7230cf16df.slice/crio-f22dcc9bf2bc00c52beb64604ef0b6300eec032c010eb36ae627b0948034fd79 WatchSource:0}: Error finding container f22dcc9bf2bc00c52beb64604ef0b6300eec032c010eb36ae627b0948034fd79: Status 404 returned error can't find the container with id f22dcc9bf2bc00c52beb64604ef0b6300eec032c010eb36ae627b0948034fd79
Jul 23 09:54:41.799864 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.799847    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb"
Jul 23 09:54:41.810586 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.810563    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cc54b5d_e44a_492f_9eb3_7be828dd31a1.slice/crio-d6e44a71bc07188819fe6c96bf1e5d6c3679506c3eb9948ceeb2d6e111dcd710 WatchSource:0}: Error finding container d6e44a71bc07188819fe6c96bf1e5d6c3679506c3eb9948ceeb2d6e111dcd710: Status 404 returned error can't find the container with id d6e44a71bc07188819fe6c96bf1e5d6c3679506c3eb9948ceeb2d6e111dcd710
Jul 23 09:54:41.813351 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.813338    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-25tsp"
Jul 23 09:54:41.819847 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.819833    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cc9zb"
Jul 23 09:54:41.821100 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.821079    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ea77770_0025_460e_8267_20e0507eac48.slice/crio-c1bbedf977739c15349a7e84e4632fad7c1812b90d6aaa142cea1e397a022c8f WatchSource:0}: Error finding container c1bbedf977739c15349a7e84e4632fad7c1812b90d6aaa142cea1e397a022c8f: Status 404 returned error can't find the container with id c1bbedf977739c15349a7e84e4632fad7c1812b90d6aaa142cea1e397a022c8f
Jul 23 09:54:41.828411 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.828380    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9d1476_4001_4f45_8cf4_d99c58643653.slice/crio-a6beb7ed0a37f398dfec00df823d67a54e89873b8be2c63eef6ab751c7869036 WatchSource:0}: Error finding container a6beb7ed0a37f398dfec00df823d67a54e89873b8be2c63eef6ab751c7869036: Status 404 returned error can't find the container with id a6beb7ed0a37f398dfec00df823d67a54e89873b8be2c63eef6ab751c7869036
Jul 23 09:54:41.844477 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.844452    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:41.855770 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.855744    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ltwkn"
Jul 23 09:54:41.864497 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.864472    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74961b81_9ad0_4de2_b990_f363869d36b0.slice/crio-5151b3c6b3722c3cc8de0f65bccccceea3d09d6670e1943b4dc492292804f064 WatchSource:0}: Error finding container 5151b3c6b3722c3cc8de0f65bccccceea3d09d6670e1943b4dc492292804f064: Status 404 returned error can't find the container with id 5151b3c6b3722c3cc8de0f65bccccceea3d09d6670e1943b4dc492292804f064
Jul 23 09:54:41.877208 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.877188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dgvmd"
Jul 23 09:54:41.885974 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.885946    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f215cc_5178_4054_bfe5_969fcf774862.slice/crio-809fcbe952c89c6c2e01f8f025a6e2e88e4656d790ff02a53002823890630ff4 WatchSource:0}: Error finding container 809fcbe952c89c6c2e01f8f025a6e2e88e4656d790ff02a53002823890630ff4: Status 404 returned error can't find the container with id 809fcbe952c89c6c2e01f8f025a6e2e88e4656d790ff02a53002823890630ff4
Jul 23 09:54:41.891713 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.891692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-btmqv"
Jul 23 09:54:41.896419 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:41.896398    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:54:41.903362 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.903326    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a72764a_6089_43de_a318_c94b88395203.slice/crio-32a959c57bb5f186a851704af272cc8a0a1bfd80803cda6b95189861e197d462 WatchSource:0}: Error finding container 32a959c57bb5f186a851704af272cc8a0a1bfd80803cda6b95189861e197d462: Status 404 returned error can't find the container with id 32a959c57bb5f186a851704af272cc8a0a1bfd80803cda6b95189861e197d462
Jul 23 09:54:41.906875 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:54:41.906854    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1580c5d_8c66_4cf8_8ead_874da37ffa96.slice/crio-b31baa551a2d51586e96cac3380b0c9779cd8d74bf0813d409e01686aa958039 WatchSource:0}: Error finding container b31baa551a2d51586e96cac3380b0c9779cd8d74bf0813d409e01686aa958039: Status 404 returned error can't find the container with id b31baa551a2d51586e96cac3380b0c9779cd8d74bf0813d409e01686aa958039
Jul 23 09:54:42.074619 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.074516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:42.074619 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.074603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:42.074937 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:42.074722    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:42.074937 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:42.074816    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret podName:4e8212ab-e7db-4401-a85e-692f2df349ee nodeName:}" failed. No retries permitted until 2026-07-23 09:54:43.074793387 +0000 UTC m=+2.978481640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret") pod "global-pull-secret-syncer-x9fcp" (UID: "4e8212ab-e7db-4401-a85e-692f2df349ee") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:42.074937 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:42.074729    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:42.074937 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:42.074907    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs podName:0e4b7584-707c-4900-841c-5e86930a2695 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:43.074892484 +0000 UTC m=+2.978580738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs") pod "network-metrics-daemon-gpp2p" (UID: "0e4b7584-707c-4900-841c-5e86930a2695") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:42.276405 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.276363    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf545\" (UniqueName: \"kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545\") pod \"network-check-target-v67vm\" (UID: \"08b14c0d-270a-4624-932c-1d7fa6973e0a\") " pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:42.276587 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:42.276548    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:42.276587 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:42.276571    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:42.276720 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:42.276597    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sf545 for pod openshift-network-diagnostics/network-check-target-v67vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:42.276720 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:42.276663    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545 podName:08b14c0d-270a-4624-932c-1d7fa6973e0a nodeName:}" failed. No retries permitted until 2026-07-23 09:54:43.276643402 +0000 UTC m=+3.180331659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf545" (UniqueName: "kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545") pod "network-check-target-v67vm" (UID: "08b14c0d-270a-4624-932c-1d7fa6973e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:42.394623 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.394025    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:42.502621 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.502488    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 09:49:41 +0000 UTC" deadline="2028-02-28 14:55:21.087592488 +0000 UTC"
Jul 23 09:54:42.502621 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.502557    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14045h0m38.585040495s"
Jul 23 09:54:42.621055 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.620992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d727z" event={"ID":"ee687b05-645e-4ce7-bb53-b830df9c85c7","Type":"ContainerStarted","Data":"15f76d12c91828db62248a4169576d5d91f26b859bc709372459f5691542eddf"}
Jul 23 09:54:42.623881 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.623847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" event={"ID":"6d5f9f47f138113a7d5fd4a2b132e429","Type":"ContainerStarted","Data":"037cbfdd63699aba98c14fe88791062e0c63efcae3f9705954816ef8aa35a207"}
Jul 23 09:54:42.629011 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.628902    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" event={"ID":"8751f98f709c66f3539a477cf86c9438","Type":"ContainerStarted","Data":"1cf993ead61d88a8d9f52b8a1afbbef49b9d64b66ec0eb03c134429f520548a3"}
Jul 23 09:54:42.639991 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.639952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" event={"ID":"a1580c5d-8c66-4cf8-8ead-874da37ffa96","Type":"ContainerStarted","Data":"b31baa551a2d51586e96cac3380b0c9779cd8d74bf0813d409e01686aa958039"}
Jul 23 09:54:42.655667 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.655581    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dgvmd" event={"ID":"f5f215cc-5178-4054-bfe5-969fcf774862","Type":"ContainerStarted","Data":"809fcbe952c89c6c2e01f8f025a6e2e88e4656d790ff02a53002823890630ff4"}
Jul 23 09:54:42.670781 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.670732    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltwkn" event={"ID":"74961b81-9ad0-4de2-b990-f363869d36b0","Type":"ContainerStarted","Data":"5151b3c6b3722c3cc8de0f65bccccceea3d09d6670e1943b4dc492292804f064"}
Jul 23 09:54:42.675639 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.675606    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb" event={"ID":"2cc54b5d-e44a-492f-9eb3-7be828dd31a1","Type":"ContainerStarted","Data":"d6e44a71bc07188819fe6c96bf1e5d6c3679506c3eb9948ceeb2d6e111dcd710"}
Jul 23 09:54:42.696822 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.696778    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lhx2q" event={"ID":"f816c379-732d-46bb-83cb-1b7230cf16df","Type":"ContainerStarted","Data":"f22dcc9bf2bc00c52beb64604ef0b6300eec032c010eb36ae627b0948034fd79"}
Jul 23 09:54:42.712897 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.712861    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btmqv" event={"ID":"0a72764a-6089-43de-a318-c94b88395203","Type":"ContainerStarted","Data":"32a959c57bb5f186a851704af272cc8a0a1bfd80803cda6b95189861e197d462"}
Jul 23 09:54:42.718356 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.718310    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cc9zb" event={"ID":"ba9d1476-4001-4f45-8cf4-d99c58643653","Type":"ContainerStarted","Data":"a6beb7ed0a37f398dfec00df823d67a54e89873b8be2c63eef6ab751c7869036"}
Jul 23 09:54:42.723659 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.723599    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-25tsp" event={"ID":"6ea77770-0025-460e-8267-20e0507eac48","Type":"ContainerStarted","Data":"c1bbedf977739c15349a7e84e4632fad7c1812b90d6aaa142cea1e397a022c8f"}
Jul 23 09:54:42.744860 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:42.744825    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 09:54:43.084155 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:43.084063    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:43.084155 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:43.084143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:43.084407 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.084327    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:43.084407 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.084398    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs podName:0e4b7584-707c-4900-841c-5e86930a2695 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:45.084376121 +0000 UTC m=+4.988064376 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs") pod "network-metrics-daemon-gpp2p" (UID: "0e4b7584-707c-4900-841c-5e86930a2695") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:43.084842 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.084821    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:43.084936 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.084879    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret podName:4e8212ab-e7db-4401-a85e-692f2df349ee nodeName:}" failed. No retries permitted until 2026-07-23 09:54:45.08486181 +0000 UTC m=+4.988550063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret") pod "global-pull-secret-syncer-x9fcp" (UID: "4e8212ab-e7db-4401-a85e-692f2df349ee") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:43.285681 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:43.285643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf545\" (UniqueName: \"kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545\") pod \"network-check-target-v67vm\" (UID: \"08b14c0d-270a-4624-932c-1d7fa6973e0a\") " pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:43.285921 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.285902    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:43.285998 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.285932    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:43.285998 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.285947    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sf545 for pod openshift-network-diagnostics/network-check-target-v67vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:43.286101 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.286013    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545 podName:08b14c0d-270a-4624-932c-1d7fa6973e0a nodeName:}" failed. No retries permitted until 2026-07-23 09:54:45.28599142 +0000 UTC m=+5.189679680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf545" (UniqueName: "kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545") pod "network-check-target-v67vm" (UID: "08b14c0d-270a-4624-932c-1d7fa6973e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:43.503563 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:43.503482    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 09:49:41 +0000 UTC" deadline="2028-02-16 22:37:15.129243499 +0000 UTC"
Jul 23 09:54:43.503563 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:43.503525    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13764h42m31.62572381s"
Jul 23 09:54:43.604486 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:43.604399    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:43.604486 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:43.604451    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:43.604714 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.604540    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:54:43.604714 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:43.604622    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:43.604826 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.604734    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:54:43.604881 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:43.604824    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:54:45.101339 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:45.101301    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:45.101811 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:45.101397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:45.101811 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.101575    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:45.101811 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.101639    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret podName:4e8212ab-e7db-4401-a85e-692f2df349ee nodeName:}" failed. No retries permitted until 2026-07-23 09:54:49.101621191 +0000 UTC m=+9.005309456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret") pod "global-pull-secret-syncer-x9fcp" (UID: "4e8212ab-e7db-4401-a85e-692f2df349ee") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:45.102063 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.102045    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:45.102126 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.102102    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs podName:0e4b7584-707c-4900-841c-5e86930a2695 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:49.102086213 +0000 UTC m=+9.005774470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs") pod "network-metrics-daemon-gpp2p" (UID: "0e4b7584-707c-4900-841c-5e86930a2695") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:45.303144 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:45.303108    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf545\" (UniqueName: \"kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545\") pod \"network-check-target-v67vm\" (UID: \"08b14c0d-270a-4624-932c-1d7fa6973e0a\") " pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:45.303367 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.303345    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:45.303431 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.303375    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:45.303431 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.303388    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sf545 for pod openshift-network-diagnostics/network-check-target-v67vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:45.303521 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.303461    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545 podName:08b14c0d-270a-4624-932c-1d7fa6973e0a nodeName:}" failed. No retries permitted until 2026-07-23 09:54:49.303441171 +0000 UTC m=+9.207129442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf545" (UniqueName: "kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545") pod "network-check-target-v67vm" (UID: "08b14c0d-270a-4624-932c-1d7fa6973e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:45.604831 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:45.604293    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:45.604831 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:45.604309    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:45.604831 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:45.604456    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:45.604831 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.604443    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:54:45.604831 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.604581    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:54:45.604831 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:45.604683    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:54:47.604482 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:47.604108    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:47.604482 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:47.604119    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:47.604482 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:47.604240    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:54:47.604482 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:47.604320    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:47.604482 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:47.604424    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:54:47.605091 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:47.604502    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:54:49.136667 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:49.136616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:49.137098 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:49.136726    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:49.137098 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.136820    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:49.137098 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.136865    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:49.137098 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.136900    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs podName:0e4b7584-707c-4900-841c-5e86930a2695 nodeName:}" failed. No retries permitted until 2026-07-23 09:54:57.136878703 +0000 UTC m=+17.040566958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs") pod "network-metrics-daemon-gpp2p" (UID: "0e4b7584-707c-4900-841c-5e86930a2695") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:49.137098 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.136921    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret podName:4e8212ab-e7db-4401-a85e-692f2df349ee nodeName:}" failed. No retries permitted until 2026-07-23 09:54:57.136911852 +0000 UTC m=+17.040600108 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret") pod "global-pull-secret-syncer-x9fcp" (UID: "4e8212ab-e7db-4401-a85e-692f2df349ee") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:49.339063 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:49.339020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf545\" (UniqueName: \"kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545\") pod \"network-check-target-v67vm\" (UID: \"08b14c0d-270a-4624-932c-1d7fa6973e0a\") " pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:49.339248 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.339232    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:49.339308 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.339275    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:49.339308 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.339290    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sf545 for pod openshift-network-diagnostics/network-check-target-v67vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:49.339428 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.339349    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545 podName:08b14c0d-270a-4624-932c-1d7fa6973e0a nodeName:}" failed. No retries permitted until 2026-07-23 09:54:57.339330476 +0000 UTC m=+17.243018733 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf545" (UniqueName: "kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545") pod "network-check-target-v67vm" (UID: "08b14c0d-270a-4624-932c-1d7fa6973e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:49.604513 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:49.604436    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:49.604677 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:49.604554    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:49.604677 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:49.604578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:49.604677 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.604568    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:54:49.604677 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.604660    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:54:49.604825 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:49.604735    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:54:51.604193 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:51.604149    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:51.604193 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:51.604178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:51.604718 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:51.604154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:51.604718 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:51.604321    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:54:51.604718 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:51.604458    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:54:51.604718 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:51.604524    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:54:53.604645 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:53.604556    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:53.604645 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:53.604592    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:53.604645 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:53.604602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:53.605130 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:53.604691    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:54:53.605130 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:53.604777    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:54:53.605130 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:53.604866    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:54:55.604198 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:55.603925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:55.604632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:55.603926    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:55.604632 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:55.604302    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:54:55.604632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:55.603964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:55.604632 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:55.604385    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:54:55.604632 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:55.604461    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:54:57.201007 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:57.200972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:57.201462 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:57.201036    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:57.201462 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.201140    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:57.201462 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.201141    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:57.201462 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.201205    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret podName:4e8212ab-e7db-4401-a85e-692f2df349ee nodeName:}" failed. No retries permitted until 2026-07-23 09:55:13.201190396 +0000 UTC m=+33.104878648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret") pod "global-pull-secret-syncer-x9fcp" (UID: "4e8212ab-e7db-4401-a85e-692f2df349ee") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:54:57.201462 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.201219    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs podName:0e4b7584-707c-4900-841c-5e86930a2695 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:13.201212771 +0000 UTC m=+33.104901023 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs") pod "network-metrics-daemon-gpp2p" (UID: "0e4b7584-707c-4900-841c-5e86930a2695") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:54:57.402635 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:57.402591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf545\" (UniqueName: \"kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545\") pod \"network-check-target-v67vm\" (UID: \"08b14c0d-270a-4624-932c-1d7fa6973e0a\") " pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:57.402790 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.402766    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:54:57.402790 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.402784    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:54:57.402913 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.402794    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sf545 for pod openshift-network-diagnostics/network-check-target-v67vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:57.402913 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.402849    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545 podName:08b14c0d-270a-4624-932c-1d7fa6973e0a nodeName:}" failed. No retries permitted until 2026-07-23 09:55:13.402833959 +0000 UTC m=+33.306522211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf545" (UniqueName: "kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545") pod "network-check-target-v67vm" (UID: "08b14c0d-270a-4624-932c-1d7fa6973e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:54:57.604148 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:57.604054    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:57.604148 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:57.604091    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:57.604148 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:57.604093    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:57.604442 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.604184    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:54:57.604442 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.604270    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:54:57.604442 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:57.604347    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:54:59.604539 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:59.604490    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:54:59.605038 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:59.604490    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:54:59.605038 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:59.604618    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:54:59.605038 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:54:59.604490    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:54:59.605038 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:59.604713    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:54:59.605038 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:54:59.604775    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:55:01.604295 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:01.604266    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:01.604733 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:01.604248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:01.604733 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:01.604389    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:55:01.604733 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:01.604459    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:55:01.604733 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:01.604248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:01.604733 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:01.604541    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:55:02.775209 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:02.775169    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-25tsp" event={"ID":"6ea77770-0025-460e-8267-20e0507eac48","Type":"ContainerStarted","Data":"65941c6b77208847edd054f909be5df00db2ff3fa52ee81ed122a2c60748b7d1"}
Jul 23 09:55:02.776480 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:02.776458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" event={"ID":"8751f98f709c66f3539a477cf86c9438","Type":"ContainerStarted","Data":"d5dff332b0097479e9bcdf0dc4967187f4fc7e6b70e32958fc5f200b46f6461a"}
Jul 23 09:55:02.795884 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:02.795827    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-25tsp" podStartSLOduration=2.044286346 podStartE2EDuration="22.795807153s" totalImagesPullingTime="20.751520807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:02.795018652 +0000 UTC m=+22.698706925" watchObservedRunningTime="2026-07-23 09:55:02.795807153 +0000 UTC m=+22.699495427"
Jul 23 09:55:02.810042 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:02.810000    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" podStartSLOduration=21.809985754 podStartE2EDuration="21.809985754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:02.809449868 +0000 UTC m=+22.713138141" watchObservedRunningTime="2026-07-23 09:55:02.809985754 +0000 UTC m=+22.713674027"
Jul 23 09:55:03.604500 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.604343    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:03.604624 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.604353    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:03.604624 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:03.604585    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:55:03.604699 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.604390    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:03.604699 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:03.604653    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:55:03.604773 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:03.604708    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:55:03.783059 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.782888    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 09:55:03.783768 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.783419    2564 generic.go:356] "Generic (PLEG): container finished" podID="a1580c5d-8c66-4cf8-8ead-874da37ffa96" containerID="b1cb4b9992bfd4c7d7f96483b976c56100f2bfcb7cd71947997a0a610cbe1588" exitCode=1
Jul 23 09:55:03.783768 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.783484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" event={"ID":"a1580c5d-8c66-4cf8-8ead-874da37ffa96","Type":"ContainerStarted","Data":"9c0dd0431421539bdab7852b0e439ff87a198934cb97a83233d2e68af2b1a408"}
Jul 23 09:55:03.783768 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.783560    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" event={"ID":"a1580c5d-8c66-4cf8-8ead-874da37ffa96","Type":"ContainerStarted","Data":"3f824ac8a3ec31adf441584c874aaccd209d2200333f9fb7acd589a8bdfaa3c4"}
Jul 23 09:55:03.783768 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.783607    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" event={"ID":"a1580c5d-8c66-4cf8-8ead-874da37ffa96","Type":"ContainerDied","Data":"b1cb4b9992bfd4c7d7f96483b976c56100f2bfcb7cd71947997a0a610cbe1588"}
Jul 23 09:55:03.783768 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.783652    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" event={"ID":"a1580c5d-8c66-4cf8-8ead-874da37ffa96","Type":"ContainerStarted","Data":"ef095955eca0645f92a3a6dc268368495876bf91cce2c016ec5268f4dbf363ae"}
Jul 23 09:55:03.787999 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.787966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dgvmd" event={"ID":"f5f215cc-5178-4054-bfe5-969fcf774862","Type":"ContainerStarted","Data":"3c93ac02cff61bba4405c262889ea44f0164ab6b0dd25e41a2ec37845acb3406"}
Jul 23 09:55:03.789601 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.789577    2564 generic.go:356] "Generic (PLEG): container finished" podID="74961b81-9ad0-4de2-b990-f363869d36b0" containerID="79bd78ed0bd912c21e7cd7ed92f850560e7d2ba89379b5968ec12dcaa8d53c6a" exitCode=0
Jul 23 09:55:03.789686 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.789651    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltwkn" event={"ID":"74961b81-9ad0-4de2-b990-f363869d36b0","Type":"ContainerDied","Data":"79bd78ed0bd912c21e7cd7ed92f850560e7d2ba89379b5968ec12dcaa8d53c6a"}
Jul 23 09:55:03.791726 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.791698    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb" event={"ID":"2cc54b5d-e44a-492f-9eb3-7be828dd31a1","Type":"ContainerStarted","Data":"199cf45db78b04202d2ee13e04ed03a4883acb3880ba6ef439b655d95cf7af52"}
Jul 23 09:55:03.793460 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.793433    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lhx2q" event={"ID":"f816c379-732d-46bb-83cb-1b7230cf16df","Type":"ContainerStarted","Data":"88bb540d1ff1f63fd9bfa8f9fdc3743549d6a87e5944abd0299ea83f4513fb18"}
Jul 23 09:55:03.794879 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.794843    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cc9zb" event={"ID":"ba9d1476-4001-4f45-8cf4-d99c58643653","Type":"ContainerStarted","Data":"1d6dfb1f4944bea5f1333e1c92bef4bf8b8767c84291a22837aeac7924c42c80"}
Jul 23 09:55:03.796335 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.796311    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d727z" event={"ID":"ee687b05-645e-4ce7-bb53-b830df9c85c7","Type":"ContainerStarted","Data":"d4f6350d035396adc8f7b7ca3a20f2a545bcad8b94d21f159a405adc9f4b577b"}
Jul 23 09:55:03.797836 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.797817    2564 generic.go:356] "Generic (PLEG): container finished" podID="6d5f9f47f138113a7d5fd4a2b132e429" containerID="e1f6f54db7ddcc273422d7308cdb5fa07b554a1094ff4e362ea2472bfe1418eb" exitCode=0
Jul 23 09:55:03.797908 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.797864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" event={"ID":"6d5f9f47f138113a7d5fd4a2b132e429","Type":"ContainerDied","Data":"e1f6f54db7ddcc273422d7308cdb5fa07b554a1094ff4e362ea2472bfe1418eb"}
Jul 23 09:55:03.806057 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.806016    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dgvmd" podStartSLOduration=3.106300348 podStartE2EDuration="23.806004135s" totalImagesPullingTime="20.699703787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:03.805873312 +0000 UTC m=+23.709561591" watchObservedRunningTime="2026-07-23 09:55:03.806004135 +0000 UTC m=+23.709692410"
Jul 23 09:55:03.825689 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.825648    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d727z" podStartSLOduration=3.090355112 podStartE2EDuration="23.825632257s" totalImagesPullingTime="20.735277145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:03.824989096 +0000 UTC m=+23.728677371" watchObservedRunningTime="2026-07-23 09:55:03.825632257 +0000 UTC m=+23.729320584"
Jul 23 09:55:03.838809 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.838770    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cc9zb" podStartSLOduration=3.093910197 podStartE2EDuration="23.838754725s" totalImagesPullingTime="20.744844528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:03.838585211 +0000 UTC m=+23.742273484" watchObservedRunningTime="2026-07-23 09:55:03.838754725 +0000 UTC m=+23.742442999"
Jul 23 09:55:03.852849 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:03.852808    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lhx2q" podStartSLOduration=3.075994395 podStartE2EDuration="23.852789524s" totalImagesPullingTime="20.776795129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:03.852539992 +0000 UTC m=+23.756228266" watchObservedRunningTime="2026-07-23 09:55:03.852789524 +0000 UTC m=+23.756477995"
Jul 23 09:55:04.804373 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:04.804341    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 09:55:04.804879 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:04.804852    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" event={"ID":"a1580c5d-8c66-4cf8-8ead-874da37ffa96","Type":"ContainerStarted","Data":"2ed54b11bc9f065194febb1fece867645b43bed37c0794a268546181f70d0021"}
Jul 23 09:55:04.804960 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:04.804943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" event={"ID":"a1580c5d-8c66-4cf8-8ead-874da37ffa96","Type":"ContainerStarted","Data":"f76b5aed8fb384057900265dc3a3eb3f4ca688a4596844079e123d4462427933"}
Jul 23 09:55:04.808681 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:04.808641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-btmqv" event={"ID":"0a72764a-6089-43de-a318-c94b88395203","Type":"ContainerStarted","Data":"6da80566e96a2987c93fc656d0d757c592f447cbf6f05aab396d5d35d58aae15"}
Jul 23 09:55:04.809388 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:04.809239    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 09:55:04.825787 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:04.825733    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-btmqv" podStartSLOduration=4.202470719 podStartE2EDuration="24.825679055s" totalImagesPullingTime="20.623208336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:04.825014275 +0000 UTC m=+24.728702549" watchObservedRunningTime="2026-07-23 09:55:04.825679055 +0000 UTC m=+24.729367331"
Jul 23 09:55:05.552977 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:05.552286    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T09:55:04.809277232Z","UUID":"b3b575b1-7a8c-4b50-a4ef-35622394ebb3","Handler":null,"Name":"","Endpoint":""}
Jul 23 09:55:05.553968 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:05.553943    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 09:55:05.554105 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:05.553991    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 09:55:05.604374 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:05.604337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:05.604540 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:05.604385    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:05.604540 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:05.604340    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:05.604540 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:05.604486    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:55:05.604719 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:05.604563    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:55:05.604719 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:05.604628    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:55:05.814068 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:05.813985    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" event={"ID":"6d5f9f47f138113a7d5fd4a2b132e429","Type":"ContainerStarted","Data":"2cf76cca589b6056bf3f735af8f81cc2c36c6572d223e197356afd52ce817671"}
Jul 23 09:55:05.817239 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:05.817209    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb" event={"ID":"2cc54b5d-e44a-492f-9eb3-7be828dd31a1","Type":"ContainerStarted","Data":"31c530edf86c836f732d3fdfe65deb0f4488ef89677c636be2f9d16040e92675"}
Jul 23 09:55:05.830274 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:05.830204    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" podStartSLOduration=24.830180186 podStartE2EDuration="24.830180186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:05.829348613 +0000 UTC m=+25.733036889" watchObservedRunningTime="2026-07-23 09:55:05.830180186 +0000 UTC m=+25.733868463"
Jul 23 09:55:06.823103 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:06.823070    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 09:55:06.823571 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:06.823541    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" event={"ID":"a1580c5d-8c66-4cf8-8ead-874da37ffa96","Type":"ContainerStarted","Data":"6fa5835098dedc39ebdd7e0f33c43f32d55457aa22133d83d8ce4add66f48919"}
Jul 23 09:55:06.825775 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:06.825745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb" event={"ID":"2cc54b5d-e44a-492f-9eb3-7be828dd31a1","Type":"ContainerStarted","Data":"e0ca11c77e23367261226f8b26e2afffc4764f8a1df82670529e6b16d04d3617"}
Jul 23 09:55:07.605111 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:07.604894    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:07.605323 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:07.604940    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:07.605323 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:07.605214    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:55:07.605323 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:07.605290    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:55:07.605323 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:07.604959    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:07.605524 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:07.605374    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:55:08.546272 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.546213    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:55:08.547124 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.547106    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:55:08.561804 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.561764    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6kgfb" podStartSLOduration=9.974724764 podStartE2EDuration="28.561748677s" totalImagesPullingTime="18.587023913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:06.844813516 +0000 UTC m=+26.748501790" watchObservedRunningTime="2026-07-23 09:55:08.561748677 +0000 UTC m=+28.465436951"
Jul 23 09:55:08.834277 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.834226    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 09:55:08.834652 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.834627    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" event={"ID":"a1580c5d-8c66-4cf8-8ead-874da37ffa96","Type":"ContainerStarted","Data":"666022ec5a70603430190feb156c89685e4c90ed4fa2b774c87601c0a8fb3f94"}
Jul 23 09:55:08.834902 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.834879    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:55:08.835109 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.835085    2564 scope.go:117] "RemoveContainer" containerID="b1cb4b9992bfd4c7d7f96483b976c56100f2bfcb7cd71947997a0a610cbe1588"
Jul 23 09:55:08.836577 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.836551    2564 generic.go:356] "Generic (PLEG): container finished" podID="74961b81-9ad0-4de2-b990-f363869d36b0" containerID="f408e912dee3b650bafd185d92b6b2951ecd8e7faf6a98cd53515d4b4e6e420a" exitCode=0
Jul 23 09:55:08.836676 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.836637    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltwkn" event={"ID":"74961b81-9ad0-4de2-b990-f363869d36b0","Type":"ContainerDied","Data":"f408e912dee3b650bafd185d92b6b2951ecd8e7faf6a98cd53515d4b4e6e420a"}
Jul 23 09:55:08.836962 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.836941    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:55:08.837377 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.837353    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d727z"
Jul 23 09:55:08.851488 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:08.851461    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:55:09.605513 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:09.604804    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:09.605513 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:09.605034    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:09.605513 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:09.605115    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:55:09.605513 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:09.605193    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:55:09.605513 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:09.604849    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:09.605513 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:09.605320    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:55:09.843766 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:09.843736    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 09:55:09.844167 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:09.844140    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" event={"ID":"a1580c5d-8c66-4cf8-8ead-874da37ffa96","Type":"ContainerStarted","Data":"04b288b6dc11e6ca4d87c16761db691ceb5bd450b07c1c37e51abaaf80fcaa45"}
Jul 23 09:55:09.844302 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:09.844282    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 09:55:09.844582 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:09.844562    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:55:09.862167 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:09.862093    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:55:09.875329 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:09.875280    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b" podStartSLOduration=8.616563963 podStartE2EDuration="29.87524286s" totalImagesPullingTime="21.258678897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:09.873572578 +0000 UTC m=+29.777260851" watchObservedRunningTime="2026-07-23 09:55:09.87524286 +0000 UTC m=+29.778931135"
Jul 23 09:55:10.797480 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:10.797450    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9fcp"]
Jul 23 09:55:10.797914 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:10.797578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:10.797914 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:10.797683    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:55:10.800235 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:10.800211    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v67vm"]
Jul 23 09:55:10.800381 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:10.800339    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:10.800455 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:10.800434    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:55:10.809395 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:10.809335    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gpp2p"]
Jul 23 09:55:10.809512 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:10.809439    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:10.809580 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:10.809521    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:55:10.848536 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:10.848499    2564 generic.go:356] "Generic (PLEG): container finished" podID="74961b81-9ad0-4de2-b990-f363869d36b0" containerID="db14f790c7ca4b7b2aede9e76e52ad653303fd4e6dfc13ddccc2ebae1f6edbc1" exitCode=0
Jul 23 09:55:10.848696 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:10.848571    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltwkn" event={"ID":"74961b81-9ad0-4de2-b990-f363869d36b0","Type":"ContainerDied","Data":"db14f790c7ca4b7b2aede9e76e52ad653303fd4e6dfc13ddccc2ebae1f6edbc1"}
Jul 23 09:55:10.848696 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:10.848670    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 09:55:11.419920 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:11.419863    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:55:12.604873 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:12.604624    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:12.605279 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:12.604649    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:12.605279 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:12.605004    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:55:12.605279 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:12.604681    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:12.605279 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:12.605047    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:55:12.605279 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:12.605105    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:55:12.855913 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:12.855881    2564 generic.go:356] "Generic (PLEG): container finished" podID="74961b81-9ad0-4de2-b990-f363869d36b0" containerID="6b56cd3e20ca34d20e693497fb3294bdb9ec7ffae6ea07f96fe6faa5cb8fe4e5" exitCode=0
Jul 23 09:55:12.856064 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:12.855960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltwkn" event={"ID":"74961b81-9ad0-4de2-b990-f363869d36b0","Type":"ContainerDied","Data":"6b56cd3e20ca34d20e693497fb3294bdb9ec7ffae6ea07f96fe6faa5cb8fe4e5"}
Jul 23 09:55:13.223945 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:13.223906    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:13.224117 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:13.223966    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:13.224117 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:13.224055    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 09:55:13.224117 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:13.224053    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:55:13.224117 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:13.224114    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret podName:4e8212ab-e7db-4401-a85e-692f2df349ee nodeName:}" failed. No retries permitted until 2026-07-23 09:55:45.224098347 +0000 UTC m=+65.127786599 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret") pod "global-pull-secret-syncer-x9fcp" (UID: "4e8212ab-e7db-4401-a85e-692f2df349ee") : object "kube-system"/"original-pull-secret" not registered
Jul 23 09:55:13.224334 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:13.224128    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs podName:0e4b7584-707c-4900-841c-5e86930a2695 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:45.224121608 +0000 UTC m=+65.127809860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs") pod "network-metrics-daemon-gpp2p" (UID: "0e4b7584-707c-4900-841c-5e86930a2695") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 09:55:13.425689 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:13.425644    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf545\" (UniqueName: \"kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545\") pod \"network-check-target-v67vm\" (UID: \"08b14c0d-270a-4624-932c-1d7fa6973e0a\") " pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:13.425883 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:13.425813    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 09:55:13.425883 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:13.425835    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 09:55:13.425883 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:13.425845    2564 projected.go:196] Error preparing data for projected volume kube-api-access-sf545 for pod openshift-network-diagnostics/network-check-target-v67vm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:55:13.425981 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:13.425897    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545 podName:08b14c0d-270a-4624-932c-1d7fa6973e0a nodeName:}" failed. No retries permitted until 2026-07-23 09:55:45.425883008 +0000 UTC m=+65.329571260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sf545" (UniqueName: "kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545") pod "network-check-target-v67vm" (UID: "08b14c0d-270a-4624-932c-1d7fa6973e0a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 09:55:14.604772 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:14.604676    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:14.604772 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:14.604676    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:14.605368 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:14.604804    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v67vm" podUID="08b14c0d-270a-4624-932c-1d7fa6973e0a"
Jul 23 09:55:14.605368 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:14.604811    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:14.605368 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:14.604915    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9fcp" podUID="4e8212ab-e7db-4401-a85e-692f2df349ee"
Jul 23 09:55:14.605368 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:14.605015    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gpp2p" podUID="0e4b7584-707c-4900-841c-5e86930a2695"
Jul 23 09:55:15.652417 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.652384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:15.735518 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.735443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:15.930296 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.930245    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeReady"
Jul 23 09:55:15.930483 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.930437    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 09:55:15.977909 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.977864    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qblh8"]
Jul 23 09:55:15.980756 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.980732    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tq2cs"]
Jul 23 09:55:15.980887 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.980864    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:15.982581 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.982562    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tq2cs"
Jul 23 09:55:15.984097 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.984070    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 09:55:15.984212 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.984158    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 09:55:15.984408 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.984393    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rdkgf\""
Jul 23 09:55:15.985060 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.985041    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 09:55:15.985173 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.985143    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 09:55:15.985233 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.985176    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 09:55:15.985233 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.985179    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-96vpq\""
Jul 23 09:55:15.994678 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.994652    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tq2cs"]
Jul 23 09:55:15.995386 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:15.995368    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qblh8"]
Jul 23 09:55:16.045471 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.045435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.045654 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.045512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2381f20-e972-4eee-ae02-b63b13d6435f-config-volume\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.045654 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.045552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2381f20-e972-4eee-ae02-b63b13d6435f-tmp-dir\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.045654 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.045610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abdfa6ba-271e-498e-a870-94fa550f3487-cert\") pod \"ingress-canary-tq2cs\" (UID: \"abdfa6ba-271e-498e-a870-94fa550f3487\") " pod="openshift-ingress-canary/ingress-canary-tq2cs"
Jul 23 09:55:16.045654 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.045640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqhzg\" (UniqueName: \"kubernetes.io/projected/abdfa6ba-271e-498e-a870-94fa550f3487-kube-api-access-lqhzg\") pod \"ingress-canary-tq2cs\" (UID: \"abdfa6ba-271e-498e-a870-94fa550f3487\") " pod="openshift-ingress-canary/ingress-canary-tq2cs"
Jul 23 09:55:16.045799 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.045684    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf2xj\" (UniqueName: \"kubernetes.io/projected/e2381f20-e972-4eee-ae02-b63b13d6435f-kube-api-access-rf2xj\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.146528 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.146493    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2381f20-e972-4eee-ae02-b63b13d6435f-config-volume\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.146710 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.146552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2381f20-e972-4eee-ae02-b63b13d6435f-tmp-dir\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.146710 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.146581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abdfa6ba-271e-498e-a870-94fa550f3487-cert\") pod \"ingress-canary-tq2cs\" (UID: \"abdfa6ba-271e-498e-a870-94fa550f3487\") " pod="openshift-ingress-canary/ingress-canary-tq2cs"
Jul 23 09:55:16.146710 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.146607    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqhzg\" (UniqueName: \"kubernetes.io/projected/abdfa6ba-271e-498e-a870-94fa550f3487-kube-api-access-lqhzg\") pod \"ingress-canary-tq2cs\" (UID: \"abdfa6ba-271e-498e-a870-94fa550f3487\") " pod="openshift-ingress-canary/ingress-canary-tq2cs"
Jul 23 09:55:16.146710 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.146640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf2xj\" (UniqueName: \"kubernetes.io/projected/e2381f20-e972-4eee-ae02-b63b13d6435f-kube-api-access-rf2xj\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.146710 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.146666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.146951 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:16.146764    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:16.146951 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:16.146825    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls podName:e2381f20-e972-4eee-ae02-b63b13d6435f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:16.646804184 +0000 UTC m=+36.550492439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls") pod "dns-default-qblh8" (UID: "e2381f20-e972-4eee-ae02-b63b13d6435f") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:16.147045 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.146950    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2381f20-e972-4eee-ae02-b63b13d6435f-tmp-dir\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.147139 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.147115    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2381f20-e972-4eee-ae02-b63b13d6435f-config-volume\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.151576 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.151554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abdfa6ba-271e-498e-a870-94fa550f3487-cert\") pod \"ingress-canary-tq2cs\" (UID: \"abdfa6ba-271e-498e-a870-94fa550f3487\") " pod="openshift-ingress-canary/ingress-canary-tq2cs"
Jul 23 09:55:16.163785 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.163755    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf2xj\" (UniqueName: \"kubernetes.io/projected/e2381f20-e972-4eee-ae02-b63b13d6435f-kube-api-access-rf2xj\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.165402 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.165377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqhzg\" (UniqueName: \"kubernetes.io/projected/abdfa6ba-271e-498e-a870-94fa550f3487-kube-api-access-lqhzg\") pod \"ingress-canary-tq2cs\" (UID: \"abdfa6ba-271e-498e-a870-94fa550f3487\") " pod="openshift-ingress-canary/ingress-canary-tq2cs"
Jul 23 09:55:16.301201 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.301119    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tq2cs"
Jul 23 09:55:16.605011 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.604926    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:16.605181 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.604923    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:16.605395 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.604932    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:16.608965 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.608935    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 09:55:16.609090 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.608941    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 09:55:16.610698 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.610673    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5t7cr\""
Jul 23 09:55:16.610828 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.610812    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 09:55:16.611249 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.611009    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ztznw\""
Jul 23 09:55:16.611249 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.611112    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 09:55:16.650880 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:16.650841    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:16.651035 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:16.651023    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:16.651113 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:16.651102    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls podName:e2381f20-e972-4eee-ae02-b63b13d6435f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:17.651080654 +0000 UTC m=+37.554768921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls") pod "dns-default-qblh8" (UID: "e2381f20-e972-4eee-ae02-b63b13d6435f") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:17.118622 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:17.118444    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tq2cs"]
Jul 23 09:55:17.122111 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:55:17.122083    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabdfa6ba_271e_498e_a870_94fa550f3487.slice/crio-87f291002b6a016b945a91948e78539c71da050c4f83984427229d28aa29b936 WatchSource:0}: Error finding container 87f291002b6a016b945a91948e78539c71da050c4f83984427229d28aa29b936: Status 404 returned error can't find the container with id 87f291002b6a016b945a91948e78539c71da050c4f83984427229d28aa29b936
Jul 23 09:55:17.280170 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:17.280055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:17.661063 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:17.661018    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:17.661284 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:17.661201    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:17.661355 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:17.661295    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls podName:e2381f20-e972-4eee-ae02-b63b13d6435f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:19.661277666 +0000 UTC m=+39.564965921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls") pod "dns-default-qblh8" (UID: "e2381f20-e972-4eee-ae02-b63b13d6435f") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:17.870031 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:17.869993    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tq2cs" event={"ID":"abdfa6ba-271e-498e-a870-94fa550f3487","Type":"ContainerStarted","Data":"87f291002b6a016b945a91948e78539c71da050c4f83984427229d28aa29b936"}
Jul 23 09:55:17.873024 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:17.872994    2564 generic.go:356] "Generic (PLEG): container finished" podID="74961b81-9ad0-4de2-b990-f363869d36b0" containerID="aea065dc4201e28cbf4cfd915190fd204f79b1f9d794d4c6c6e23866ad79f831" exitCode=0
Jul 23 09:55:17.873174 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:17.873045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltwkn" event={"ID":"74961b81-9ad0-4de2-b990-f363869d36b0","Type":"ContainerDied","Data":"aea065dc4201e28cbf4cfd915190fd204f79b1f9d794d4c6c6e23866ad79f831"}
Jul 23 09:55:18.381350 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:18.381316    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:18.431121 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:18.431083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:18.674950 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:18.674857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:18.775998 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:18.775944    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:18.879213 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:18.879182    2564 generic.go:356] "Generic (PLEG): container finished" podID="74961b81-9ad0-4de2-b990-f363869d36b0" containerID="346a475e9af038b6ccb03a43d7388da58981b4bd2d254b3623ece361ced172a7" exitCode=0
Jul 23 09:55:18.879441 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:18.879245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltwkn" event={"ID":"74961b81-9ad0-4de2-b990-f363869d36b0","Type":"ContainerDied","Data":"346a475e9af038b6ccb03a43d7388da58981b4bd2d254b3623ece361ced172a7"}
Jul 23 09:55:19.473934 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:19.473909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:19.575724 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:19.575347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:19.680447 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:19.680407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:19.680643 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:19.680550    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:19.680643 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:19.680620    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls podName:e2381f20-e972-4eee-ae02-b63b13d6435f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:23.680600728 +0000 UTC m=+43.584289000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls") pod "dns-default-qblh8" (UID: "e2381f20-e972-4eee-ae02-b63b13d6435f") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:19.886211 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:19.886178    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tq2cs" event={"ID":"abdfa6ba-271e-498e-a870-94fa550f3487","Type":"ContainerStarted","Data":"3f142400834b5de34cd685155a45829812bc8080726542eebb3d5e948aac54d5"}
Jul 23 09:55:19.889590 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:19.889563    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ltwkn" event={"ID":"74961b81-9ad0-4de2-b990-f363869d36b0","Type":"ContainerStarted","Data":"f56c7a584cd64d2d7d0789cbc61ef784ae561a122e3e1054ae97ddb3251f335a"}
Jul 23 09:55:19.904545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:19.904495    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tq2cs" podStartSLOduration=2.60855017 podStartE2EDuration="4.904480235s" totalImagesPullingTime="2.295930065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:19.90304742 +0000 UTC m=+39.806735694" watchObservedRunningTime="2026-07-23 09:55:19.904480235 +0000 UTC m=+39.808168576"
Jul 23 09:55:19.927133 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:19.927075    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ltwkn" podStartSLOduration=8.234587368 podStartE2EDuration="39.927056412s" totalImagesPullingTime="31.692469044s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:19.925364493 +0000 UTC m=+39.829052766" watchObservedRunningTime="2026-07-23 09:55:19.927056412 +0000 UTC m=+39.830744687"
Jul 23 09:55:20.049852 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:20.049819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:20.103686 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:20.103656    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:21.115197 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:21.115165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:21.215801 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:21.215770    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:21.413936 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:21.413907    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:21.469293 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:21.469243    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:21.609612 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:21.609585    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:21.695790 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:21.695696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:22.574545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.574511    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9t725"]
Jul 23 09:55:22.602521 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.602490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:22.610783 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.610760    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.613638 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.613608    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 09:55:22.613849 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.613759    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-96kbl\""
Jul 23 09:55:22.614977 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.614953    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 09:55:22.615301 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.615276    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 09:55:22.615422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.615362    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 09:55:22.616428 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.616411    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9t725"]
Jul 23 09:55:22.704137 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.704098    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-crio-socket\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.704137 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.704141    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmbkp\" (UniqueName: \"kubernetes.io/projected/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-api-access-kmbkp\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.704411 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.704227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-data-volume\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.704411 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.704348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.704411 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.704401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.801516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.801474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:22.805377 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.805341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.805511 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.805400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.805511 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.805461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-crio-socket\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.805511 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:22.805467    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 09:55:22.805511 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.805484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmbkp\" (UniqueName: \"kubernetes.io/projected/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-api-access-kmbkp\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.805685 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.805534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-data-volume\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.805685 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:22.805551    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm podName:e1ac7c12-efe3-46ad-9e15-1f88780f2a40 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:23.305529162 +0000 UTC m=+43.209217414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9t725" (UID: "e1ac7c12-efe3-46ad-9e15-1f88780f2a40") : configmap "kube-rbac-proxy" not found
Jul 23 09:55:22.805685 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:22.805587    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:22.805685 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:22.805649    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls podName:e1ac7c12-efe3-46ad-9e15-1f88780f2a40 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:23.305630862 +0000 UTC m=+43.209319115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9t725" (UID: "e1ac7c12-efe3-46ad-9e15-1f88780f2a40") : secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:22.805685 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.805664    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-crio-socket\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.805880 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.805861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-data-volume\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.806190 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.806173    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s"]
Jul 23 09:55:22.827556 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.827488    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmbkp\" (UniqueName: \"kubernetes.io/projected/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-api-access-kmbkp\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:22.828855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.828836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s"]
Jul 23 09:55:22.828944 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.828934    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s"
Jul 23 09:55:22.831799 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.831774    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fhmfd\""
Jul 23 09:55:22.831977 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.831952    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 23 09:55:22.832226 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.832209    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 23 09:55:22.871121 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.871078    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:22.906360 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.906321    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9fs6\" (UniqueName: \"kubernetes.io/projected/6f050684-34f6-4db5-a06c-26d7cbbefb10-kube-api-access-p9fs6\") pod \"migrator-7cc9c7ffd7-n5g9s\" (UID: \"6f050684-34f6-4db5-a06c-26d7cbbefb10\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s"
Jul 23 09:55:22.970856 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:22.970821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:23.006997 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.006967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9fs6\" (UniqueName: \"kubernetes.io/projected/6f050684-34f6-4db5-a06c-26d7cbbefb10-kube-api-access-p9fs6\") pod \"migrator-7cc9c7ffd7-n5g9s\" (UID: \"6f050684-34f6-4db5-a06c-26d7cbbefb10\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s"
Jul 23 09:55:23.015146 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.015122    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9fs6\" (UniqueName: \"kubernetes.io/projected/6f050684-34f6-4db5-a06c-26d7cbbefb10-kube-api-access-p9fs6\") pod \"migrator-7cc9c7ffd7-n5g9s\" (UID: \"6f050684-34f6-4db5-a06c-26d7cbbefb10\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s"
Jul 23 09:55:23.139373 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.139343    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s"
Jul 23 09:55:23.286335 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.286203    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s"]
Jul 23 09:55:23.288886 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:55:23.288857    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f050684_34f6_4db5_a06c_26d7cbbefb10.slice/crio-b1f28cc8475b7e9dc847a9ce26991bd7ee772622a38ee53bd67d2c76cb3ef145 WatchSource:0}: Error finding container b1f28cc8475b7e9dc847a9ce26991bd7ee772622a38ee53bd67d2c76cb3ef145: Status 404 returned error can't find the container with id b1f28cc8475b7e9dc847a9ce26991bd7ee772622a38ee53bd67d2c76cb3ef145
Jul 23 09:55:23.289325 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.289302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:23.308710 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.308671    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:23.308818 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.308719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:23.308818 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:23.308797    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 09:55:23.308898 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:23.308837    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:23.308898 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:23.308862    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm podName:e1ac7c12-efe3-46ad-9e15-1f88780f2a40 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:24.308843558 +0000 UTC m=+44.212531809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9t725" (UID: "e1ac7c12-efe3-46ad-9e15-1f88780f2a40") : configmap "kube-rbac-proxy" not found
Jul 23 09:55:23.308898 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:23.308881    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls podName:e1ac7c12-efe3-46ad-9e15-1f88780f2a40 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:24.308870752 +0000 UTC m=+44.212559003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9t725" (UID: "e1ac7c12-efe3-46ad-9e15-1f88780f2a40") : secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:23.389338 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.389286    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:23.712577 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.712529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:23.712959 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:23.712675    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:23.712959 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:23.712743    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls podName:e2381f20-e972-4eee-ae02-b63b13d6435f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:31.712723999 +0000 UTC m=+51.616412252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls") pod "dns-default-qblh8" (UID: "e2381f20-e972-4eee-ae02-b63b13d6435f") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:23.714667 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.714644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:23.816029 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.816000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:23.901824 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.901788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s" event={"ID":"6f050684-34f6-4db5-a06c-26d7cbbefb10","Type":"ContainerStarted","Data":"b1f28cc8475b7e9dc847a9ce26991bd7ee772622a38ee53bd67d2c76cb3ef145"}
Jul 23 09:55:23.988601 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:23.988515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:24.089321 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:24.089292    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:24.318671 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:24.318591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:24.318671 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:24.318637    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:24.318901 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:24.318738    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 09:55:24.318901 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:24.318774    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:24.318901 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:24.318820    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm podName:e1ac7c12-efe3-46ad-9e15-1f88780f2a40 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:26.318800262 +0000 UTC m=+46.222488530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9t725" (UID: "e1ac7c12-efe3-46ad-9e15-1f88780f2a40") : configmap "kube-rbac-proxy" not found
Jul 23 09:55:24.318901 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:24.318838    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls podName:e1ac7c12-efe3-46ad-9e15-1f88780f2a40 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:26.318829474 +0000 UTC m=+46.222517729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9t725" (UID: "e1ac7c12-efe3-46ad-9e15-1f88780f2a40") : secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:24.364513 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:24.364485    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cc9zb_ba9d1476-4001-4f45-8cf4-d99c58643653/dns-node-resolver/0.log"
Jul 23 09:55:25.592644 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.592556    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-bpqkg"]
Jul 23 09:55:25.611350 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.611318    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-bpqkg"]
Jul 23 09:55:25.611486 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.611440    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.614264 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.614224    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 23 09:55:25.614389 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.614326    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 23 09:55:25.615643 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.615622    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 23 09:55:25.615863 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.615840    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 23 09:55:25.615863 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.615849    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-m7grh\""
Jul 23 09:55:25.627114 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.627089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:25.730369 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.730332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cee425fb-33e1-4f13-a009-147ac321db5e-signing-cabundle\") pod \"service-ca-58598695f7-bpqkg\" (UID: \"cee425fb-33e1-4f13-a009-147ac321db5e\") " pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.730571 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.730407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86bfc\" (UniqueName: \"kubernetes.io/projected/cee425fb-33e1-4f13-a009-147ac321db5e-kube-api-access-86bfc\") pod \"service-ca-58598695f7-bpqkg\" (UID: \"cee425fb-33e1-4f13-a009-147ac321db5e\") " pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.730571 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.730449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cee425fb-33e1-4f13-a009-147ac321db5e-signing-key\") pod \"service-ca-58598695f7-bpqkg\" (UID: \"cee425fb-33e1-4f13-a009-147ac321db5e\") " pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.762096 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.762074    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lhx2q_f816c379-732d-46bb-83cb-1b7230cf16df/node-ca/0.log"
Jul 23 09:55:25.831491 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.831459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86bfc\" (UniqueName: \"kubernetes.io/projected/cee425fb-33e1-4f13-a009-147ac321db5e-kube-api-access-86bfc\") pod \"service-ca-58598695f7-bpqkg\" (UID: \"cee425fb-33e1-4f13-a009-147ac321db5e\") " pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.831622 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.831517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cee425fb-33e1-4f13-a009-147ac321db5e-signing-key\") pod \"service-ca-58598695f7-bpqkg\" (UID: \"cee425fb-33e1-4f13-a009-147ac321db5e\") " pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.831622 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.831564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cee425fb-33e1-4f13-a009-147ac321db5e-signing-cabundle\") pod \"service-ca-58598695f7-bpqkg\" (UID: \"cee425fb-33e1-4f13-a009-147ac321db5e\") " pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.832194 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.832175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/cee425fb-33e1-4f13-a009-147ac321db5e-signing-cabundle\") pod \"service-ca-58598695f7-bpqkg\" (UID: \"cee425fb-33e1-4f13-a009-147ac321db5e\") " pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.834196 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.834165    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/cee425fb-33e1-4f13-a009-147ac321db5e-signing-key\") pod \"service-ca-58598695f7-bpqkg\" (UID: \"cee425fb-33e1-4f13-a009-147ac321db5e\") " pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.840053 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.840024    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86bfc\" (UniqueName: \"kubernetes.io/projected/cee425fb-33e1-4f13-a009-147ac321db5e-kube-api-access-86bfc\") pod \"service-ca-58598695f7-bpqkg\" (UID: \"cee425fb-33e1-4f13-a009-147ac321db5e\") " pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.909110 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.909073    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s" event={"ID":"6f050684-34f6-4db5-a06c-26d7cbbefb10","Type":"ContainerStarted","Data":"989465c5aa6e19f941032799e2080c26fc367d29b50038bc3922b220dcd094bc"}
Jul 23 09:55:25.909348 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.909175    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s" event={"ID":"6f050684-34f6-4db5-a06c-26d7cbbefb10","Type":"ContainerStarted","Data":"11a386545a61a4302f27158c106f116dd7a57c068333cf9dd95162ca40beb942"}
Jul 23 09:55:25.921408 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.921383    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-bpqkg"
Jul 23 09:55:25.929907 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:25.929762    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-n5g9s" podStartSLOduration=2.062818598 podStartE2EDuration="3.929747676s" totalImagesPullingTime="1.866929078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:25.929138306 +0000 UTC m=+45.832826580" watchObservedRunningTime="2026-07-23 09:55:25.929747676 +0000 UTC m=+45.833435980"
Jul 23 09:55:26.007024 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:26.006994    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:26.053573 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:26.053537    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-bpqkg"]
Jul 23 09:55:26.056327 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:55:26.056303    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee425fb_33e1_4f13_a009_147ac321db5e.slice/crio-33489ddf32827101b85330b9919570d8bc032ddef8d7a5509aca624fba47fa81 WatchSource:0}: Error finding container 33489ddf32827101b85330b9919570d8bc032ddef8d7a5509aca624fba47fa81: Status 404 returned error can't find the container with id 33489ddf32827101b85330b9919570d8bc032ddef8d7a5509aca624fba47fa81
Jul 23 09:55:26.061012 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:26.060988    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:26.336502 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:26.336410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:26.336502 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:26.336461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:26.336677 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:26.336548    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 09:55:26.336677 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:26.336585    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:26.336677 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:26.336625    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls podName:e1ac7c12-efe3-46ad-9e15-1f88780f2a40 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:30.336612073 +0000 UTC m=+50.240300325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9t725" (UID: "e1ac7c12-efe3-46ad-9e15-1f88780f2a40") : secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:26.336677 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:26.336639    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm podName:e1ac7c12-efe3-46ad-9e15-1f88780f2a40 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:30.336632369 +0000 UTC m=+50.240320621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9t725" (UID: "e1ac7c12-efe3-46ad-9e15-1f88780f2a40") : configmap "kube-rbac-proxy" not found
Jul 23 09:55:26.561947 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:26.561907    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tq2cs_abdfa6ba-271e-498e-a870-94fa550f3487/serve-healthcheck-canary/0.log"
Jul 23 09:55:26.656797 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:26.656765    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:26.912812 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:26.912728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-bpqkg" event={"ID":"cee425fb-33e1-4f13-a009-147ac321db5e","Type":"ContainerStarted","Data":"33489ddf32827101b85330b9919570d8bc032ddef8d7a5509aca624fba47fa81"}
Jul 23 09:55:28.029762 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:28.029732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:28.919070 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:28.919027    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-bpqkg" event={"ID":"cee425fb-33e1-4f13-a009-147ac321db5e","Type":"ContainerStarted","Data":"b0717e9779b92f2c1669c2adf7b27b7a87ef31b60fbd26825bf4af9634f0143e"}
Jul 23 09:55:28.936620 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:28.936572    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-bpqkg" podStartSLOduration=1.435129939 podStartE2EDuration="3.936555314s" totalImagesPullingTime="2.501425375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:28.935443096 +0000 UTC m=+48.839131493" watchObservedRunningTime="2026-07-23 09:55:28.936555314 +0000 UTC m=+48.840243588"
Jul 23 09:55:29.620525 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:29.620459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:29.860824 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:29.860793    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:29.960042 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:29.960003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:30.029301 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:30.027954    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:30.084238 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:30.084190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:30.208928 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:30.208891    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:30.376615 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:30.376509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:30.376615 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:30.376581    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:30.376849 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:30.376739    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:30.376849 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:30.376824    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls podName:e1ac7c12-efe3-46ad-9e15-1f88780f2a40 nodeName:}" failed. No retries permitted until 2026-07-23 09:55:38.376800847 +0000 UTC m=+58.280489099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9t725" (UID: "e1ac7c12-efe3-46ad-9e15-1f88780f2a40") : secret "insights-runtime-extractor-tls" not found
Jul 23 09:55:30.377163 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:30.377141    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:30.393988 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:30.393958    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:30.713476 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:30.713439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:31.714047 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:31.714015    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:31.788148 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:31.788104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:31.788371 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:31.788287    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 09:55:31.788371 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:55:31.788359    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls podName:e2381f20-e972-4eee-ae02-b63b13d6435f nodeName:}" failed. No retries permitted until 2026-07-23 09:55:47.78833746 +0000 UTC m=+67.692025728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls") pod "dns-default-qblh8" (UID: "e2381f20-e972-4eee-ae02-b63b13d6435f") : secret "dns-default-metrics-tls" not found
Jul 23 09:55:32.114884 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:32.114803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:32.306603 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:32.306569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:32.511353 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:32.511320    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:32.910309 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:32.910275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:33.304701 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:33.304617    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:33.411557 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:33.411516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:33.931545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:33.931505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:33.985369 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:33.985307    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:34.347657 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:34.347575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:34.709796 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:34.709761    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:34.762151 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:34.762122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:34.912328 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:34.912295    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:35.509008 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:35.508970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:35.912307 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:35.912279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:36.115229 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:36.115193    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:36.416230 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:36.416199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:36.469974 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:36.469941    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:36.533605 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:36.533573    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:37.116128 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:37.116094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:37.377183 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:37.377097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:37.516169 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:37.516136    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:38.103310 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:38.103279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:38.160708 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:38.160675    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:38.438883 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:38.438828    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:38.441303 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:38.441274    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e1ac7c12-efe3-46ad-9e15-1f88780f2a40-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9t725\" (UID: \"e1ac7c12-efe3-46ad-9e15-1f88780f2a40\") " pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:38.510274 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:38.510224    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:38.523320 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:38.523285    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9t725"
Jul 23 09:55:38.652600 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:38.652572    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9t725"]
Jul 23 09:55:38.655815 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:55:38.655790    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1ac7c12_efe3_46ad_9e15_1f88780f2a40.slice/crio-02476464e88315b58426e20ad05e0978e6ed42dffda890b97080d6eac39c177c WatchSource:0}: Error finding container 02476464e88315b58426e20ad05e0978e6ed42dffda890b97080d6eac39c177c: Status 404 returned error can't find the container with id 02476464e88315b58426e20ad05e0978e6ed42dffda890b97080d6eac39c177c
Jul 23 09:55:38.924355 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:38.924314    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:38.946179 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:38.946148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9t725" event={"ID":"e1ac7c12-efe3-46ad-9e15-1f88780f2a40","Type":"ContainerStarted","Data":"02476464e88315b58426e20ad05e0978e6ed42dffda890b97080d6eac39c177c"}
Jul 23 09:55:39.114003 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:39.113971    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:39.711079 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:39.711034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:40.238216 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:40.238180    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:40.339655 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:40.339617    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:40.447931 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:40.447897    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:42.869063 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:42.869025    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7c9b"
Jul 23 09:55:43.962922 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:43.962882    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9t725" event={"ID":"e1ac7c12-efe3-46ad-9e15-1f88780f2a40","Type":"ContainerStarted","Data":"7623d8c9f908adffeeae30f49309cd40662d22da3575447c0eb15535676b2606"}
Jul 23 09:55:45.297491 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.297422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:45.297937 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.297501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:45.300148 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.300125    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 09:55:45.301530 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.301509    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 09:55:45.311390 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.311364    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4e8212ab-e7db-4401-a85e-692f2df349ee-original-pull-secret\") pod \"global-pull-secret-syncer-x9fcp\" (UID: \"4e8212ab-e7db-4401-a85e-692f2df349ee\") " pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:45.311904 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.311856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e4b7584-707c-4900-841c-5e86930a2695-metrics-certs\") pod \"network-metrics-daemon-gpp2p\" (UID: \"0e4b7584-707c-4900-841c-5e86930a2695\") " pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:45.421644 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.421612    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ztznw\""
Jul 23 09:55:45.430008 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.429980    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gpp2p"
Jul 23 09:55:45.434110 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.434089    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9fcp"
Jul 23 09:55:45.500982 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.500942    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf545\" (UniqueName: \"kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545\") pod \"network-check-target-v67vm\" (UID: \"08b14c0d-270a-4624-932c-1d7fa6973e0a\") " pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:45.503814 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.503775    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 09:55:45.514746 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.514713    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 09:55:45.526413 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.526382    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf545\" (UniqueName: \"kubernetes.io/projected/08b14c0d-270a-4624-932c-1d7fa6973e0a-kube-api-access-sf545\") pod \"network-check-target-v67vm\" (UID: \"08b14c0d-270a-4624-932c-1d7fa6973e0a\") " pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:45.586592 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.586558    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9fcp"]
Jul 23 09:55:45.607925 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.607810    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gpp2p"]
Jul 23 09:55:45.610113 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.610086    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"]
Jul 23 09:55:45.614331 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.614299    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.616922 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.616896    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 09:55:45.617100 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.617089    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 09:55:45.617754 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.617565    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 09:55:45.617754 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.617645    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 09:55:45.618417 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.618400    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 09:55:45.620640 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.620619    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 09:55:45.620749 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.620649    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 09:55:45.627586 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.627566    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"]
Jul 23 09:55:45.702541 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.702505    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-hub\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.702541 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.702549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.702788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.702620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.702788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.702661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-ca\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.702788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.702685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrxxw\" (UniqueName: \"kubernetes.io/projected/1dd78508-4f7a-452a-86d3-ff18ca167cff-kube-api-access-xrxxw\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.702788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.702748    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd78508-4f7a-452a-86d3-ff18ca167cff-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.729273 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.729216    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75c9fcfb6c-56d6d"]
Jul 23 09:55:45.732733 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.732709    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5t7cr\""
Jul 23 09:55:45.735150 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.734468    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.738687 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.738663    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:45.739049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.739032    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 09:55:45.739153 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.739048    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 09:55:45.739878 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.739859    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 09:55:45.739990 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.739910    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vtvtf\""
Jul 23 09:55:45.745755 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.745735    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 09:55:45.760029 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.760001    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c9fcfb6c-56d6d"]
Jul 23 09:55:45.795691 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.795657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:45.803352 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-ca\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.803352 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrxxw\" (UniqueName: \"kubernetes.io/projected/1dd78508-4f7a-452a-86d3-ff18ca167cff-kube-api-access-xrxxw\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.803575 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca7dfee7-4077-4973-8d6b-f519020fc82e-registry-certificates\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.803575 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-hub\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.803575 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.803575 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca7dfee7-4077-4973-8d6b-f519020fc82e-installation-pull-secrets\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.803766 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803576    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca7dfee7-4077-4973-8d6b-f519020fc82e-trusted-ca\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.803766 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca7dfee7-4077-4973-8d6b-f519020fc82e-bound-sa-token\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.803766 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj7wm\" (UniqueName: \"kubernetes.io/projected/ca7dfee7-4077-4973-8d6b-f519020fc82e-kube-api-access-sj7wm\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.803766 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd78508-4f7a-452a-86d3-ff18ca167cff-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.803766 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca7dfee7-4077-4973-8d6b-f519020fc82e-ca-trust-extracted\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.804004 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca7dfee7-4077-4973-8d6b-f519020fc82e-image-registry-private-configuration\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.804004 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803879    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca7dfee7-4077-4973-8d6b-f519020fc82e-registry-tls\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.804004 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.803915    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.804656 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.804605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dd78508-4f7a-452a-86d3-ff18ca167cff-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.806357 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.806334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-ca\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.806494 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.806473    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-hub\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.806537 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.806511    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.807056 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.807038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1dd78508-4f7a-452a-86d3-ff18ca167cff-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.813238 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.813217    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrxxw\" (UniqueName: \"kubernetes.io/projected/1dd78508-4f7a-452a-86d3-ff18ca167cff-kube-api-access-xrxxw\") pod \"cluster-proxy-proxy-agent-78789666bb-lqfmc\" (UID: \"1dd78508-4f7a-452a-86d3-ff18ca167cff\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:45.884346 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.884313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:45.904577 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.904532    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca7dfee7-4077-4973-8d6b-f519020fc82e-registry-certificates\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.904761 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.904602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca7dfee7-4077-4973-8d6b-f519020fc82e-installation-pull-secrets\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.904761 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.904639    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca7dfee7-4077-4973-8d6b-f519020fc82e-trusted-ca\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.904761 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.904665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca7dfee7-4077-4973-8d6b-f519020fc82e-bound-sa-token\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.904761 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.904702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj7wm\" (UniqueName: \"kubernetes.io/projected/ca7dfee7-4077-4973-8d6b-f519020fc82e-kube-api-access-sj7wm\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.904761 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.904733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca7dfee7-4077-4973-8d6b-f519020fc82e-ca-trust-extracted\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.904974 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.904768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca7dfee7-4077-4973-8d6b-f519020fc82e-image-registry-private-configuration\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.904974 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.904825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca7dfee7-4077-4973-8d6b-f519020fc82e-registry-tls\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.905472 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.905420    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ca7dfee7-4077-4973-8d6b-f519020fc82e-ca-trust-extracted\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.905598 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.905542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ca7dfee7-4077-4973-8d6b-f519020fc82e-registry-certificates\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.906000 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.905955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ca7dfee7-4077-4973-8d6b-f519020fc82e-trusted-ca\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.907645 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.907622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ca7dfee7-4077-4973-8d6b-f519020fc82e-registry-tls\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.907779 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.907761    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ca7dfee7-4077-4973-8d6b-f519020fc82e-installation-pull-secrets\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.907842 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.907798    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ca7dfee7-4077-4973-8d6b-f519020fc82e-image-registry-private-configuration\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.913797 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.913777    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj7wm\" (UniqueName: \"kubernetes.io/projected/ca7dfee7-4077-4973-8d6b-f519020fc82e-kube-api-access-sj7wm\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.914071 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.914048    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca7dfee7-4077-4973-8d6b-f519020fc82e-bound-sa-token\") pod \"image-registry-75c9fcfb6c-56d6d\" (UID: \"ca7dfee7-4077-4973-8d6b-f519020fc82e\") " pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:45.934662 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:45.934637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"
Jul 23 09:55:46.047171 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:46.047140    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:46.064142 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:46.064063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:46.165688 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:46.165650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:46.749719 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:46.749683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:46.778403 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:55:46.778366    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4b7584_707c_4900_841c_5e86930a2695.slice/crio-b04e07002e56fcaeeb57a9fadb08760487adbf47d9a39e7c5dabd28d0d1fb5a7 WatchSource:0}: Error finding container b04e07002e56fcaeeb57a9fadb08760487adbf47d9a39e7c5dabd28d0d1fb5a7: Status 404 returned error can't find the container with id b04e07002e56fcaeeb57a9fadb08760487adbf47d9a39e7c5dabd28d0d1fb5a7
Jul 23 09:55:46.817916 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:55:46.817886    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8212ab_e7db_4401_a85e_692f2df349ee.slice/crio-52080dceec2dac0b30d91a777b3958a819fa467c125531d3aad00f729644ac9f WatchSource:0}: Error finding container 52080dceec2dac0b30d91a777b3958a819fa467c125531d3aad00f729644ac9f: Status 404 returned error can't find the container with id 52080dceec2dac0b30d91a777b3958a819fa467c125531d3aad00f729644ac9f
Jul 23 09:55:46.847342 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:46.847294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:46.975054 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:46.975015    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9fcp" event={"ID":"4e8212ab-e7db-4401-a85e-692f2df349ee","Type":"ContainerStarted","Data":"52080dceec2dac0b30d91a777b3958a819fa467c125531d3aad00f729644ac9f"}
Jul 23 09:55:46.976354 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:46.976313    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gpp2p" event={"ID":"0e4b7584-707c-4900-841c-5e86930a2695","Type":"ContainerStarted","Data":"b04e07002e56fcaeeb57a9fadb08760487adbf47d9a39e7c5dabd28d0d1fb5a7"}
Jul 23 09:55:47.668981 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.668947    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v67vm"]
Jul 23 09:55:47.673452 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:55:47.673421    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08b14c0d_270a_4624_932c_1d7fa6973e0a.slice/crio-9b39f845e09791e159d06477f04b63b9c2ffe637822f081de4a1c711332307c3 WatchSource:0}: Error finding container 9b39f845e09791e159d06477f04b63b9c2ffe637822f081de4a1c711332307c3: Status 404 returned error can't find the container with id 9b39f845e09791e159d06477f04b63b9c2ffe637822f081de4a1c711332307c3
Jul 23 09:55:47.691748 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.691720    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c9fcfb6c-56d6d"]
Jul 23 09:55:47.693344 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:55:47.693302    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7dfee7_4077_4973_8d6b_f519020fc82e.slice/crio-0646b9061c0dbbc8eaf671f5f713b886f57baef787e92153a2270996c0da0314 WatchSource:0}: Error finding container 0646b9061c0dbbc8eaf671f5f713b886f57baef787e92153a2270996c0da0314: Status 404 returned error can't find the container with id 0646b9061c0dbbc8eaf671f5f713b886f57baef787e92153a2270996c0da0314
Jul 23 09:55:47.708001 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.707891    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc"]
Jul 23 09:55:47.712414 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:55:47.712382    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dd78508_4f7a_452a_86d3_ff18ca167cff.slice/crio-9dc1a2134b845229739f5bb3e8c8645a393c9299404e3ce50960a8487ab029e0 WatchSource:0}: Error finding container 9dc1a2134b845229739f5bb3e8c8645a393c9299404e3ce50960a8487ab029e0: Status 404 returned error can't find the container with id 9dc1a2134b845229739f5bb3e8c8645a393c9299404e3ce50960a8487ab029e0
Jul 23 09:55:47.822409 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.822204    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:47.825117 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.825093    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2381f20-e972-4eee-ae02-b63b13d6435f-metrics-tls\") pod \"dns-default-qblh8\" (UID: \"e2381f20-e972-4eee-ae02-b63b13d6435f\") " pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:47.981632 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.981581    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc" event={"ID":"1dd78508-4f7a-452a-86d3-ff18ca167cff","Type":"ContainerStarted","Data":"9dc1a2134b845229739f5bb3e8c8645a393c9299404e3ce50960a8487ab029e0"}
Jul 23 09:55:47.983450 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.983412    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d" event={"ID":"ca7dfee7-4077-4973-8d6b-f519020fc82e","Type":"ContainerStarted","Data":"422c0c808857cd3550217e552b82da068e639b96b21f2e0e053d8e516ca1b78c"}
Jul 23 09:55:47.983600 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.983506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d" event={"ID":"ca7dfee7-4077-4973-8d6b-f519020fc82e","Type":"ContainerStarted","Data":"0646b9061c0dbbc8eaf671f5f713b886f57baef787e92153a2270996c0da0314"}
Jul 23 09:55:47.983788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.983768    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:55:47.985154 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.985129    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v67vm" event={"ID":"08b14c0d-270a-4624-932c-1d7fa6973e0a","Type":"ContainerStarted","Data":"9b39f845e09791e159d06477f04b63b9c2ffe637822f081de4a1c711332307c3"}
Jul 23 09:55:47.987751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:47.987696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9t725" event={"ID":"e1ac7c12-efe3-46ad-9e15-1f88780f2a40","Type":"ContainerStarted","Data":"7ae877f98e0c3bd25351e5e0b1da8a4c9d898b7344a0e5dc8c17570e8738c26b"}
Jul 23 09:55:48.096207 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:48.096124    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rdkgf\""
Jul 23 09:55:48.103822 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:48.103789    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:48.377196 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:48.377095    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d" podStartSLOduration=3.377073248 podStartE2EDuration="3.377073248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:55:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:48.003744732 +0000 UTC m=+67.907433007" watchObservedRunningTime="2026-07-23 09:55:48.377073248 +0000 UTC m=+68.280761526"
Jul 23 09:55:48.377551 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:48.377531    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qblh8"]
Jul 23 09:55:48.382271 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:55:48.382227    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2381f20_e972_4eee_ae02_b63b13d6435f.slice/crio-444f2b3e870924ec9f4a96ce9e58a83e41380028c968297180ae619780c57e05 WatchSource:0}: Error finding container 444f2b3e870924ec9f4a96ce9e58a83e41380028c968297180ae619780c57e05: Status 404 returned error can't find the container with id 444f2b3e870924ec9f4a96ce9e58a83e41380028c968297180ae619780c57e05
Jul 23 09:55:48.999166 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:48.999123    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gpp2p" event={"ID":"0e4b7584-707c-4900-841c-5e86930a2695","Type":"ContainerStarted","Data":"14b311c9c24f4b3a697b86a32a61a64c253ce51c09d25c95f25a48f8ef11982d"}
Jul 23 09:55:48.999715 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:48.999198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gpp2p" event={"ID":"0e4b7584-707c-4900-841c-5e86930a2695","Type":"ContainerStarted","Data":"a0777029880bd549371248212a09cd8a7b176d4739f98cadd7f1ac91d189ca06"}
Jul 23 09:55:49.003720 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:49.003682    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qblh8" event={"ID":"e2381f20-e972-4eee-ae02-b63b13d6435f","Type":"ContainerStarted","Data":"444f2b3e870924ec9f4a96ce9e58a83e41380028c968297180ae619780c57e05"}
Jul 23 09:55:49.017607 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:49.017504    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gpp2p" podStartSLOduration=67.222823053 podStartE2EDuration="1m9.017481709s" totalImagesPullingTime="1.794658656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:49.016225454 +0000 UTC m=+68.919913728" watchObservedRunningTime="2026-07-23 09:55:49.017481709 +0000 UTC m=+68.921169965"
Jul 23 09:55:49.142589 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:49.142476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:49.245235 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:49.245133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:49.753039 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:49.753005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:49.811379 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:49.811315    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:51.424276 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:51.424223    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:51.483677 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:51.483638    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:53.212332 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:53.212292    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:53.312645 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:53.312606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:53.388807 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:53.388778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:53.806425 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:53.806390    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:53.907160 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:53.907132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:53.965950 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:53.965920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:55:58.038826 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.038791    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qblh8" event={"ID":"e2381f20-e972-4eee-ae02-b63b13d6435f","Type":"ContainerStarted","Data":"5f533df282875577f5476a1f1c3823f6b921c6d7ad881dba9c2c38ea47e82e35"}
Jul 23 09:55:58.039327 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.038882    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qblh8" event={"ID":"e2381f20-e972-4eee-ae02-b63b13d6435f","Type":"ContainerStarted","Data":"57404e4b2e28a11ab89e38fc453482f611402cba97a79472c58c683e9282ea92"}
Jul 23 09:55:58.039327 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.038914    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qblh8"
Jul 23 09:55:58.041057 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.041028    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc" event={"ID":"1dd78508-4f7a-452a-86d3-ff18ca167cff","Type":"ContainerStarted","Data":"7a9bd2553934f80dccf1b3c0cbee57bc9ea0daafc6903d364b436339588b6d15"}
Jul 23 09:55:58.041274 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.041068    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc" event={"ID":"1dd78508-4f7a-452a-86d3-ff18ca167cff","Type":"ContainerStarted","Data":"fe63f1cbe06445dd3af74227585ec1a0c0bdc519ce74ccfc7b0f87d3b968ee47"}
Jul 23 09:55:58.041274 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.041082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc" event={"ID":"1dd78508-4f7a-452a-86d3-ff18ca167cff","Type":"ContainerStarted","Data":"3cb9372d9626be127b505d108606b24e465803ee2d0304fde927d78d10a778cd"}
Jul 23 09:55:58.042761 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.042739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v67vm" event={"ID":"08b14c0d-270a-4624-932c-1d7fa6973e0a","Type":"ContainerStarted","Data":"898fc9b95a7012ba89247afb89a55354d19f9d5cdbad2ae1e67550483e0acf3e"}
Jul 23 09:55:58.042877 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.042802    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:55:58.044716 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.044691    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9t725" event={"ID":"e1ac7c12-efe3-46ad-9e15-1f88780f2a40","Type":"ContainerStarted","Data":"aefaeb2e18fcbe35088bc3e584433110f863e788515f64f366070c313edd8d55"}
Jul 23 09:55:58.045943 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.045923    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9fcp" event={"ID":"4e8212ab-e7db-4401-a85e-692f2df349ee","Type":"ContainerStarted","Data":"eae301a92910ec8959a56c34862d55a02ef8f42d86b3cdba2ac6bfe5b11f5cd0"}
Jul 23 09:55:58.056979 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.056935    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qblh8" podStartSLOduration=34.423786992 podStartE2EDuration="43.05692217s" totalImagesPullingTime="8.633135178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:55:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:58.056195072 +0000 UTC m=+77.959883345" watchObservedRunningTime="2026-07-23 09:55:58.05692217 +0000 UTC m=+77.960610443"
Jul 23 09:55:58.073583 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.073536    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78789666bb-lqfmc" podStartSLOduration=3.7533012 podStartE2EDuration="13.073522037s" totalImagesPullingTime="9.320220837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:58.07283782 +0000 UTC m=+77.976526128" watchObservedRunningTime="2026-07-23 09:55:58.073522037 +0000 UTC m=+77.977210310"
Jul 23 09:55:58.087077 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.087019    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x9fcp" podStartSLOduration=67.88492557000001 podStartE2EDuration="1m18.086995353s" totalImagesPullingTime="10.202069783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:58.086887533 +0000 UTC m=+77.990575808" watchObservedRunningTime="2026-07-23 09:55:58.086995353 +0000 UTC m=+77.990683629"
Jul 23 09:55:58.100885 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.100842    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v67vm" podStartSLOduration=68.742134001 podStartE2EDuration="1m18.100828644s" totalImagesPullingTime="9.358694643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:54:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:58.100709579 +0000 UTC m=+78.004397854" watchObservedRunningTime="2026-07-23 09:55:58.100828644 +0000 UTC m=+78.004516896"
Jul 23 09:55:58.117807 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:55:58.117753    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9t725" podStartSLOduration=17.944798702 podStartE2EDuration="36.11773302s" totalImagesPullingTime="18.172934318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 09:55:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:55:58.116945936 +0000 UTC m=+78.020634215" watchObservedRunningTime="2026-07-23 09:55:58.11773302 +0000 UTC m=+78.021421294"
Jul 23 09:56:01.406209 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:01.406055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:01.475103 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:01.475067    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:01.650247 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:01.650215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:03.342661 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:03.342586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:03.906934 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:03.906901    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:04.006796 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:04.006768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:04.060016 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:04.059987    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:05.579562 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.579529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:05.781421 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.781388    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:05.851000 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.850910    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hsk9b"]
Jul 23 09:56:05.856989 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.856962    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:05.860033 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.860010    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 09:56:05.860033 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.860009    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 09:56:05.861047 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.861023    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4ftdv\""
Jul 23 09:56:05.861147 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.861051    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 09:56:05.861147 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.861023    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 09:56:05.861147 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.861079    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 09:56:05.861429 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.861413    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 09:56:05.891859 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.891823    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:05.961072 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.961042    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:05.961280 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.961089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/572512f6-e9d4-4b90-bd46-acedb36c6cb9-sys\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:05.961280 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.961115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/572512f6-e9d4-4b90-bd46-acedb36c6cb9-root\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:05.961280 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.961169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-tls\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:05.961280 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.961206    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-wtmp\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:05.961280 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.961228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:05.961465 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.961298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572512f6-e9d4-4b90-bd46-acedb36c6cb9-metrics-client-ca\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:05.961465 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.961319    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22ww5\" (UniqueName: \"kubernetes.io/projected/572512f6-e9d4-4b90-bd46-acedb36c6cb9-kube-api-access-22ww5\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:05.961465 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.961379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-textfile\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:05.989397 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:05.989366    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:06.053623 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.053588    2564 patch_prober.go:28] interesting pod/image-registry-75c9fcfb6c-56d6d container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 09:56:06.053797 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.053658    2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d" podUID="ca7dfee7-4077-4973-8d6b-f519020fc82e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 09:56:06.062537 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062513    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-textfile\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.062700 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.062700 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/572512f6-e9d4-4b90-bd46-acedb36c6cb9-sys\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.062700 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/572512f6-e9d4-4b90-bd46-acedb36c6cb9-sys\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.062857 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/572512f6-e9d4-4b90-bd46-acedb36c6cb9-root\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.062857 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-tls\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.062857 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-wtmp\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.062857 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.063051 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:56:06.062883    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 09:56:06.063051 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-textfile\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.063051 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:56:06.062937    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-tls podName:572512f6-e9d4-4b90-bd46-acedb36c6cb9 nodeName:}" failed. No retries permitted until 2026-07-23 09:56:06.562917588 +0000 UTC m=+86.466605862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-tls") pod "node-exporter-hsk9b" (UID: "572512f6-e9d4-4b90-bd46-acedb36c6cb9") : secret "node-exporter-tls" not found
Jul 23 09:56:06.063051 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/572512f6-e9d4-4b90-bd46-acedb36c6cb9-root\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.063051 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062957    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-wtmp\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.063051 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.062984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572512f6-e9d4-4b90-bd46-acedb36c6cb9-metrics-client-ca\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.063051 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.063007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22ww5\" (UniqueName: \"kubernetes.io/projected/572512f6-e9d4-4b90-bd46-acedb36c6cb9-kube-api-access-22ww5\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.063484 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.063465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/572512f6-e9d4-4b90-bd46-acedb36c6cb9-metrics-client-ca\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.063788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.063769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-accelerators-collector-config\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.065113 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.065092    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.074513 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.074487    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22ww5\" (UniqueName: \"kubernetes.io/projected/572512f6-e9d4-4b90-bd46-acedb36c6cb9-kube-api-access-22ww5\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.086474 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.086438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:06.190946 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.190916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:06.279873 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.279837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:06.387133 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.387100    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:06.568172 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.568082    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-tls\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.570535 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.570504    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/572512f6-e9d4-4b90-bd46-acedb36c6cb9-node-exporter-tls\") pod \"node-exporter-hsk9b\" (UID: \"572512f6-e9d4-4b90-bd46-acedb36c6cb9\") " pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.642004 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.641964    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:06.768991 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.768951    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hsk9b"
Jul 23 09:56:06.783414 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:56:06.783333    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572512f6_e9d4_4b90_bd46_acedb36c6cb9.slice/crio-c532af96ae25d08d2e7141f8315634dcf4dc283a20751a57952e84e03e863691 WatchSource:0}: Error finding container c532af96ae25d08d2e7141f8315634dcf4dc283a20751a57952e84e03e863691: Status 404 returned error can't find the container with id c532af96ae25d08d2e7141f8315634dcf4dc283a20751a57952e84e03e863691
Jul 23 09:56:06.798675 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.798646    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:06.879211 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:06.879177    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:07.080055 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:07.080010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hsk9b" event={"ID":"572512f6-e9d4-4b90-bd46-acedb36c6cb9","Type":"ContainerStarted","Data":"c532af96ae25d08d2e7141f8315634dcf4dc283a20751a57952e84e03e863691"}
Jul 23 09:56:08.051633 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:08.051547    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qblh8"
Jul 23 09:56:08.086678 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:08.086640    2564 generic.go:356] "Generic (PLEG): container finished" podID="572512f6-e9d4-4b90-bd46-acedb36c6cb9" containerID="451ad058549c21ea0b34dceff6f55e6617c1343369dce1baa93623b45346940e" exitCode=0
Jul 23 09:56:08.086852 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:08.086723    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hsk9b" event={"ID":"572512f6-e9d4-4b90-bd46-acedb36c6cb9","Type":"ContainerDied","Data":"451ad058549c21ea0b34dceff6f55e6617c1343369dce1baa93623b45346940e"}
Jul 23 09:56:08.434812 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:08.434776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:09.007929 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:09.007903    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75c9fcfb6c-56d6d"
Jul 23 09:56:09.037549 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:09.037520    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:09.092504 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:09.092470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hsk9b" event={"ID":"572512f6-e9d4-4b90-bd46-acedb36c6cb9","Type":"ContainerStarted","Data":"5b348a2d524ed41ddee00bc858b3ac1b154cfb63380d8f17e47ebe696540f164"}
Jul 23 09:56:09.092977 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:09.092531    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hsk9b" event={"ID":"572512f6-e9d4-4b90-bd46-acedb36c6cb9","Type":"ContainerStarted","Data":"221c675aef4593b5113ed489fe92adbc5b438365c73333bc721c31307927af50"}
Jul 23 09:56:09.105574 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:09.105546    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:09.122946 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:09.122899    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hsk9b" podStartSLOduration=3.062574285 podStartE2EDuration="4.122884173s" totalImagesPullingTime="989.161832ms" totalInitContainerRuntime="71.148056ms" isStatefulPod=true podCreationTimestamp="2026-07-23 09:56:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:56:09.121066796 +0000 UTC m=+89.024755070" watchObservedRunningTime="2026-07-23 09:56:09.122884173 +0000 UTC m=+89.026572447"
Jul 23 09:56:10.256267 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.256215    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-558fd88468-qd7md"]
Jul 23 09:56:10.259392 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.259370    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.263314 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.263286    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 23 09:56:10.263446 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.263286    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 09:56:10.263446 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.263288    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 23 09:56:10.263446 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.263288    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-6vrjn\""
Jul 23 09:56:10.263446 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.263290    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 23 09:56:10.263446 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.263297    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-edsn5fhooa078\""
Jul 23 09:56:10.269890 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.269868    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-558fd88468-qd7md"]
Jul 23 09:56:10.398168 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.398127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.398168 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.398177    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwqc4\" (UniqueName: \"kubernetes.io/projected/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-kube-api-access-mwqc4\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.398414 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.398203    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-metrics-server-audit-profiles\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.398414 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.398242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-audit-log\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.398414 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.398288    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-secret-metrics-server-tls\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.398414 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.398308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-secret-metrics-server-client-certs\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.398414 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.398332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-client-ca-bundle\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.498682 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.498655    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-metrics-server-audit-profiles\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.498838 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.498697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-audit-log\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.498838 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.498717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-secret-metrics-server-tls\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.498838 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.498740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-secret-metrics-server-client-certs\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.498838 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.498770    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-client-ca-bundle\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.498838 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.498793    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.498838 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.498820    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwqc4\" (UniqueName: \"kubernetes.io/projected/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-kube-api-access-mwqc4\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.499154 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.499130    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-audit-log\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.499536 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.499507    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.499815 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.499795    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-metrics-server-audit-profiles\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.501658 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.501627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-secret-metrics-server-client-certs\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.501901 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.501882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-client-ca-bundle\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.501967 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.501905    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-secret-metrics-server-tls\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.506358 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.506308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwqc4\" (UniqueName: \"kubernetes.io/projected/f94d6f29-cbf8-45f6-bc45-f7cba019dfc3-kube-api-access-mwqc4\") pod \"metrics-server-558fd88468-qd7md\" (UID: \"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3\") " pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.568439 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.568405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:10.707815 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:10.707708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-558fd88468-qd7md"]
Jul 23 09:56:10.710195 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:56:10.710163    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94d6f29_cbf8_45f6_bc45_f7cba019dfc3.slice/crio-8a65feac71a393f22cc2964598866fa8e5191cad79f3c5d84879269fca35d05b WatchSource:0}: Error finding container 8a65feac71a393f22cc2964598866fa8e5191cad79f3c5d84879269fca35d05b: Status 404 returned error can't find the container with id 8a65feac71a393f22cc2964598866fa8e5191cad79f3c5d84879269fca35d05b
Jul 23 09:56:11.101824 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:11.101789    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-558fd88468-qd7md" event={"ID":"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3","Type":"ContainerStarted","Data":"8a65feac71a393f22cc2964598866fa8e5191cad79f3c5d84879269fca35d05b"}
Jul 23 09:56:11.132965 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:11.132930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:11.185313 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:11.185281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:11.705753 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:11.705718    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:11.911727 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:11.911694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:12.100666 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.100587    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 09:56:12.108699 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.108672    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.111392 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.111369    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 09:56:12.111759 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.111743    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 09:56:12.112415 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.112006    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 09:56:12.112415 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.112020    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 09:56:12.112415 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.112031    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 09:56:12.112415 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.112049    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 09:56:12.112415 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.112072    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 09:56:12.112415 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.112020    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 09:56:12.112415 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.112009    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 09:56:12.112415 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.112158    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fqnlx\""
Jul 23 09:56:12.112840 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.112598    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 09:56:12.113017 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.113000    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1llnnkf13tju3\""
Jul 23 09:56:12.113288 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.113205    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 09:56:12.113371 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.113291    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 09:56:12.116069 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.116049    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 09:56:12.121673 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.121650    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 09:56:12.122662 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.122636    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 09:56:12.123188 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.123163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:12.212808 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.212774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.212808 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.212812    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.212834    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.212856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.212902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config-out\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.212930    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-web-config\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.212977    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213019    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213183    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bspzl\" (UniqueName: \"kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-kube-api-access-bspzl\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.213545 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.213380    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.314576 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.314776 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.314776 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.314776 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.314776 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config-out\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.314776 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-web-config\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.314776 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314727    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.314776 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314753    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.314776 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314779    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314880    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314909    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.314969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.315015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.315082    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.315111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bspzl\" (UniqueName: \"kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-kube-api-access-bspzl\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.315149    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315214 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.315194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.315785 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.315353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.316329 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.316220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.316432 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.316327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.317406 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.317089    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.318074 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.318053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.321132 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.318542    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.321132 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.318897    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-web-config\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.321132 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.319408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.321132 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.319530    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config-out\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.321132 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.320121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.321132 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.320531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.321132 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.321067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.321132 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.321093    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.322461 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.321867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.322461 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.322015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.322461 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.322421    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.322892 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.322862    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.323148 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.323128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.323708 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.323688    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.324739 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.324716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bspzl\" (UniqueName: \"kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-kube-api-access-bspzl\") pod \"prometheus-k8s-0\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.421798 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.421765    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:12.467729 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.467690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:12.772412 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.772379    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 09:56:12.808506 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.808474    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:12.898013 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:56:12.897977    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc35e65c_e4ca_4585_a31a_b7afa71d7f3e.slice/crio-1f17c52403c7df6ff725c1ea470458027d331c9ea8596239dd34bedf9b030fdf WatchSource:0}: Error finding container 1f17c52403c7df6ff725c1ea470458027d331c9ea8596239dd34bedf9b030fdf: Status 404 returned error can't find the container with id 1f17c52403c7df6ff725c1ea470458027d331c9ea8596239dd34bedf9b030fdf
Jul 23 09:56:12.908795 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:12.908732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:13.108249 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:13.108221    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:13.111003 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:13.110977    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-558fd88468-qd7md" event={"ID":"f94d6f29-cbf8-45f6-bc45-f7cba019dfc3","Type":"ContainerStarted","Data":"9f54351b7e272ad91209d7eeffaec86e37cc1b6ca0a68ba1bac0397e2073fe6d"}
Jul 23 09:56:13.112220 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:13.112198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerStarted","Data":"1f17c52403c7df6ff725c1ea470458027d331c9ea8596239dd34bedf9b030fdf"}
Jul 23 09:56:13.130207 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:13.130161    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-558fd88468-qd7md" podStartSLOduration=0.927115893 podStartE2EDuration="3.130145534s" totalImagesPullingTime="2.203029641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:56:13.129396144 +0000 UTC m=+93.033084418" watchObservedRunningTime="2026-07-23 09:56:13.130145534 +0000 UTC m=+93.033833807"
Jul 23 09:56:13.209802 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:13.209688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:15.121278 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:15.121221    2564 generic.go:356] "Generic (PLEG): container finished" podID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerID="723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c" exitCode=0
Jul 23 09:56:15.121676 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:15.121287    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerDied","Data":"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"}
Jul 23 09:56:16.120519 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:16.120486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:16.177194 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:16.177154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:16.285182 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:16.285152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:16.343175 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:16.343130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:19.139694 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:19.139653    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerStarted","Data":"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"}
Jul 23 09:56:19.140066 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:19.139719    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerStarted","Data":"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"}
Jul 23 09:56:21.151480 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:21.151451    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerStarted","Data":"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"}
Jul 23 09:56:21.151906 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:21.151522    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerStarted","Data":"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"}
Jul 23 09:56:21.831882 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:21.831846    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:21.937688 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:21.937655    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:22.158572 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:22.158535    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerStarted","Data":"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"}
Jul 23 09:56:22.159089 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:22.158598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerStarted","Data":"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"}
Jul 23 09:56:22.188806 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:22.188749    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.071154263 podStartE2EDuration="10.1887312s" totalImagesPullingTime="7.099296328s" totalInitContainerRuntime="18.280609ms" isStatefulPod=false podCreationTimestamp="2026-07-23 09:56:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:56:22.186378837 +0000 UTC m=+102.090067111" watchObservedRunningTime="2026-07-23 09:56:22.1887312 +0000 UTC m=+102.092419473"
Jul 23 09:56:22.422501 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:22.422406    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:56:25.352471 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:25.352441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:25.406947 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:25.406916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:26.513807 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:26.513757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:26.570767 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:26.570732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:29.052719 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:29.052689    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v67vm"
Jul 23 09:56:29.931195 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:29.931151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:29.994786 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:29.994755    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:30.568888 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:30.568859    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:30.569376 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:30.568915    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:36.319548 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:36.319512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:36.378516 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:36.378483    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:36.437041 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:36.437008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:36.493438 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:36.493403    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:37.732223 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:37.732189    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:37.790458 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:37.790426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:39.343937 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:39.343907    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:39.448932 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:39.448899    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:50.574768 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:50.574733    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:50.579186 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:50.579162    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-558fd88468-qd7md"
Jul 23 09:56:51.416966 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:51.416927    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:56:51.517502 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:56:51.517467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:12.422369 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:12.422309    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:12.442407 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:12.442380    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:13.357060 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:13.357028    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:21.913011 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:21.912978    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:21.967422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:21.967396    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:23.432524 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:23.432491    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:23.533659 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:23.533630    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:23.634468 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:23.634432    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:23.686303 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:23.686213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:24.172961 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:24.172931    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:30.434972 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.434935    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 09:57:30.435603 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.435543    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="prometheus" containerID="cri-o://bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6" gracePeriod=600
Jul 23 09:57:30.436541 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.435860    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy" containerID="cri-o://f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f" gracePeriod=600
Jul 23 09:57:30.436541 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.435915    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="thanos-sidecar" containerID="cri-o://cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00" gracePeriod=600
Jul 23 09:57:30.436541 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.436016    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="config-reloader" containerID="cri-o://c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26" gracePeriod=600
Jul 23 09:57:30.436541 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.436072    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy-web" containerID="cri-o://87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a" gracePeriod=600
Jul 23 09:57:30.436541 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.436174    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538" gracePeriod=600
Jul 23 09:57:30.686280 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.686200    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:30.787973 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.787933    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-metrics-client-ca\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.787973 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.787975    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-1\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.787995    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-trusted-ca-bundle\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788012    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-thanos-prometheus-http-client-file\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788031    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788054    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-kube-rbac-proxy\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788082    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-tls-assets\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788108    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-grpc-tls\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788134    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bspzl\" (UniqueName: \"kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-kube-api-access-bspzl\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788163    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-kubelet-serving-ca-bundle\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788191    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-2\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788231    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788292    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config-out\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788334    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-0\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788362    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-web-config\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788387    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-tls\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788414    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788446    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-metrics-client-certs\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788444    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:30.788751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788465    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:30.788751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788478    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-db\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.788751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.788554    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-serving-certs-ca-bundle\") pod \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\" (UID: \"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e\") "
Jul 23 09:57:30.789449 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.789081    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-metrics-client-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.789449 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.789083    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:30.789449 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.789102    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.789698 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.789671    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:30.789764 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.789738    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:30.790005 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.789805    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:57:30.790099 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.790032    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:30.790556 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.790524    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:57:30.792170 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.792144    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:57:30.792555 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.792516    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config" (OuterVolumeSpecName: "config") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:30.792656 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.792639    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:30.792720 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.792668    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:30.792783 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.792721    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:30.793183 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.793156    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:30.793183 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.793160    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config-out" (OuterVolumeSpecName: "config-out") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:57:30.793329 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.793196    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:30.793329 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.793194    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-kube-api-access-bspzl" (OuterVolumeSpecName: "kube-api-access-bspzl") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "kube-api-access-bspzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:57:30.794086 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.794064    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:30.794366 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.794343    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:30.803853 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.803823    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-web-config" (OuterVolumeSpecName: "web-config") pod "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" (UID: "dc35e65c-e4ca-4585-a31a-b7afa71d7f3e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:57:30.890153 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890114    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890153 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890146    2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890153 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890159    2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890169    2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-kube-rbac-proxy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890178    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-tls-assets\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890188    2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-grpc-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890197    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bspzl\" (UniqueName: \"kubernetes.io/projected/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-kube-api-access-bspzl\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890205    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890214    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890224    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890233    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-config-out\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890243    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890273    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-web-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890282    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890290    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890298    2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-secret-metrics-client-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890306    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-prometheus-k8s-db\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:30.890422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:30.890313    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:57:31.409767 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409682    2564 generic.go:356] "Generic (PLEG): container finished" podID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerID="0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538" exitCode=0
Jul 23 09:57:31.409767 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409714    2564 generic.go:356] "Generic (PLEG): container finished" podID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerID="f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f" exitCode=0
Jul 23 09:57:31.409767 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409723    2564 generic.go:356] "Generic (PLEG): container finished" podID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerID="87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a" exitCode=0
Jul 23 09:57:31.409767 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409731    2564 generic.go:356] "Generic (PLEG): container finished" podID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerID="cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00" exitCode=0
Jul 23 09:57:31.409767 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409739    2564 generic.go:356] "Generic (PLEG): container finished" podID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerID="c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26" exitCode=0
Jul 23 09:57:31.409767 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409747    2564 generic.go:356] "Generic (PLEG): container finished" podID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerID="bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6" exitCode=0
Jul 23 09:57:31.410058 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerDied","Data":"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"}
Jul 23 09:57:31.410058 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409794    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.410058 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerDied","Data":"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"}
Jul 23 09:57:31.410058 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerDied","Data":"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"}
Jul 23 09:57:31.410058 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerDied","Data":"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"}
Jul 23 09:57:31.410058 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409938    2564 scope.go:117] "RemoveContainer" containerID="0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"
Jul 23 09:57:31.410058 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerDied","Data":"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"}
Jul 23 09:57:31.410058 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.409987    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerDied","Data":"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"}
Jul 23 09:57:31.410058 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.410011    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc35e65c-e4ca-4585-a31a-b7afa71d7f3e","Type":"ContainerDied","Data":"1f17c52403c7df6ff725c1ea470458027d331c9ea8596239dd34bedf9b030fdf"}
Jul 23 09:57:31.418705 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.418687    2564 scope.go:117] "RemoveContainer" containerID="f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"
Jul 23 09:57:31.425748 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.425730    2564 scope.go:117] "RemoveContainer" containerID="87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"
Jul 23 09:57:31.432746 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.432727    2564 scope.go:117] "RemoveContainer" containerID="cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"
Jul 23 09:57:31.435909 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.435882    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 09:57:31.441853 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.441690    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 09:57:31.441853 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.441740    2564 scope.go:117] "RemoveContainer" containerID="c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"
Jul 23 09:57:31.449001 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.448977    2564 scope.go:117] "RemoveContainer" containerID="bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"
Jul 23 09:57:31.464205 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464176    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 09:57:31.464467 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464455    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="init-config-reloader"
Jul 23 09:57:31.464525 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464470    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="init-config-reloader"
Jul 23 09:57:31.464525 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464479    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy-web"
Jul 23 09:57:31.464525 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464485    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy-web"
Jul 23 09:57:31.464525 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464491    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy"
Jul 23 09:57:31.464525 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464500    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy"
Jul 23 09:57:31.464525 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464511    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="config-reloader"
Jul 23 09:57:31.464525 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464516    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="config-reloader"
Jul 23 09:57:31.464525 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464523    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="thanos-sidecar"
Jul 23 09:57:31.464525 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464528    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="thanos-sidecar"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464535    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy-thanos"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464540    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy-thanos"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464548    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="prometheus"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464553    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="prometheus"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464599    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy-thanos"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464614    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="config-reloader"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464619    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="thanos-sidecar"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464624    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464631    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="prometheus"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464638    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" containerName="kube-rbac-proxy-web"
Jul 23 09:57:31.464855 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.464595    2564 scope.go:117] "RemoveContainer" containerID="723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"
Jul 23 09:57:31.469439 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.469418    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.474788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474238    2564 scope.go:117] "RemoveContainer" containerID="0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"
Jul 23 09:57:31.474788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474405    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 09:57:31.474788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474509    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 09:57:31.474788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474509    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 09:57:31.474788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474562    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 09:57:31.474788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474511    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 09:57:31.474788 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474704    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 09:57:31.475198 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474858    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 09:57:31.475198 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474874    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 09:57:31.475198 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474897    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fqnlx\""
Jul 23 09:57:31.475198 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474940    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 09:57:31.475198 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.474995    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 09:57:31.475198 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.475017    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 09:57:31.475198 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:57:31.475146    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": container with ID starting with 0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538 not found: ID does not exist" containerID="0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"
Jul 23 09:57:31.475508 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.475181    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"} err="failed to get container status \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": rpc error: code = NotFound desc = could not find container \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": container with ID starting with 0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538 not found: ID does not exist"
Jul 23 09:57:31.475508 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.475226    2564 scope.go:117] "RemoveContainer" containerID="f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"
Jul 23 09:57:31.475616 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:57:31.475542    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": container with ID starting with f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f not found: ID does not exist" containerID="f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"
Jul 23 09:57:31.475616 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.475574    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"} err="failed to get container status \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": rpc error: code = NotFound desc = could not find container \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": container with ID starting with f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f not found: ID does not exist"
Jul 23 09:57:31.475616 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.475598    2564 scope.go:117] "RemoveContainer" containerID="87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"
Jul 23 09:57:31.475757 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.475671    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1llnnkf13tju3\""
Jul 23 09:57:31.476002 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:57:31.475971    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": container with ID starting with 87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a not found: ID does not exist" containerID="87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"
Jul 23 09:57:31.476083 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.475996    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"} err="failed to get container status \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": rpc error: code = NotFound desc = could not find container \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": container with ID starting with 87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a not found: ID does not exist"
Jul 23 09:57:31.476083 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.476023    2564 scope.go:117] "RemoveContainer" containerID="cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"
Jul 23 09:57:31.476422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.476380    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 09:57:31.476422 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:57:31.476396    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": container with ID starting with cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00 not found: ID does not exist" containerID="cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"
Jul 23 09:57:31.476626 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.476426    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"} err="failed to get container status \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": rpc error: code = NotFound desc = could not find container \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": container with ID starting with cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00 not found: ID does not exist"
Jul 23 09:57:31.476626 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.476447    2564 scope.go:117] "RemoveContainer" containerID="c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"
Jul 23 09:57:31.476753 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:57:31.476713    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": container with ID starting with c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26 not found: ID does not exist" containerID="c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"
Jul 23 09:57:31.476753 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.476736    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"} err="failed to get container status \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": rpc error: code = NotFound desc = could not find container \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": container with ID starting with c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26 not found: ID does not exist"
Jul 23 09:57:31.476864 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.476759    2564 scope.go:117] "RemoveContainer" containerID="bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"
Jul 23 09:57:31.477016 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:57:31.476992    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": container with ID starting with bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6 not found: ID does not exist" containerID="bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"
Jul 23 09:57:31.477016 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.477023    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"} err="failed to get container status \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": rpc error: code = NotFound desc = could not find container \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": container with ID starting with bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6 not found: ID does not exist"
Jul 23 09:57:31.477156 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.477040    2564 scope.go:117] "RemoveContainer" containerID="723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"
Jul 23 09:57:31.477420 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:57:31.477392    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": container with ID starting with 723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c not found: ID does not exist" containerID="723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"
Jul 23 09:57:31.477505 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.477424    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"} err="failed to get container status \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": rpc error: code = NotFound desc = could not find container \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": container with ID starting with 723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c not found: ID does not exist"
Jul 23 09:57:31.477505 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.477444    2564 scope.go:117] "RemoveContainer" containerID="0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"
Jul 23 09:57:31.477621 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.477503    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 09:57:31.477744 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.477721    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"} err="failed to get container status \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": rpc error: code = NotFound desc = could not find container \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": container with ID starting with 0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538 not found: ID does not exist"
Jul 23 09:57:31.477799 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.477747    2564 scope.go:117] "RemoveContainer" containerID="f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"
Jul 23 09:57:31.478020 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.478000    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"} err="failed to get container status \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": rpc error: code = NotFound desc = could not find container \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": container with ID starting with f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f not found: ID does not exist"
Jul 23 09:57:31.478071 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.478021    2564 scope.go:117] "RemoveContainer" containerID="87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"
Jul 23 09:57:31.478231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.478211    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"} err="failed to get container status \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": rpc error: code = NotFound desc = could not find container \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": container with ID starting with 87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a not found: ID does not exist"
Jul 23 09:57:31.478231 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.478231    2564 scope.go:117] "RemoveContainer" containerID="cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"
Jul 23 09:57:31.478536 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.478520    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"} err="failed to get container status \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": rpc error: code = NotFound desc = could not find container \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": container with ID starting with cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00 not found: ID does not exist"
Jul 23 09:57:31.478609 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.478537    2564 scope.go:117] "RemoveContainer" containerID="c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"
Jul 23 09:57:31.478815 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.478788    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"} err="failed to get container status \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": rpc error: code = NotFound desc = could not find container \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": container with ID starting with c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26 not found: ID does not exist"
Jul 23 09:57:31.478815 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.478815    2564 scope.go:117] "RemoveContainer" containerID="bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"
Jul 23 09:57:31.479098 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.479060    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"} err="failed to get container status \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": rpc error: code = NotFound desc = could not find container \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": container with ID starting with bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6 not found: ID does not exist"
Jul 23 09:57:31.479171 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.479104    2564 scope.go:117] "RemoveContainer" containerID="723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"
Jul 23 09:57:31.479397 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.479372    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"} err="failed to get container status \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": rpc error: code = NotFound desc = could not find container \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": container with ID starting with 723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c not found: ID does not exist"
Jul 23 09:57:31.479474 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.479398    2564 scope.go:117] "RemoveContainer" containerID="0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"
Jul 23 09:57:31.479649 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.479626    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"} err="failed to get container status \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": rpc error: code = NotFound desc = could not find container \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": container with ID starting with 0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538 not found: ID does not exist"
Jul 23 09:57:31.479723 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.479651    2564 scope.go:117] "RemoveContainer" containerID="f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"
Jul 23 09:57:31.480046 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.479885    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"} err="failed to get container status \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": rpc error: code = NotFound desc = could not find container \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": container with ID starting with f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f not found: ID does not exist"
Jul 23 09:57:31.480046 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.479909    2564 scope.go:117] "RemoveContainer" containerID="87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"
Jul 23 09:57:31.480306 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.480274    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"} err="failed to get container status \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": rpc error: code = NotFound desc = could not find container \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": container with ID starting with 87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a not found: ID does not exist"
Jul 23 09:57:31.480306 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.480300    2564 scope.go:117] "RemoveContainer" containerID="cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"
Jul 23 09:57:31.480583 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.480563    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"} err="failed to get container status \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": rpc error: code = NotFound desc = could not find container \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": container with ID starting with cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00 not found: ID does not exist"
Jul 23 09:57:31.480583 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.480582    2564 scope.go:117] "RemoveContainer" containerID="c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"
Jul 23 09:57:31.480724 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.480639    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 09:57:31.480864 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.480844    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"} err="failed to get container status \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": rpc error: code = NotFound desc = could not find container \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": container with ID starting with c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26 not found: ID does not exist"
Jul 23 09:57:31.480935 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.480868    2564 scope.go:117] "RemoveContainer" containerID="bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"
Jul 23 09:57:31.481122 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.481105    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"} err="failed to get container status \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": rpc error: code = NotFound desc = could not find container \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": container with ID starting with bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6 not found: ID does not exist"
Jul 23 09:57:31.481178 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.481123    2564 scope.go:117] "RemoveContainer" containerID="723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"
Jul 23 09:57:31.481422 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.481403    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"} err="failed to get container status \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": rpc error: code = NotFound desc = could not find container \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": container with ID starting with 723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c not found: ID does not exist"
Jul 23 09:57:31.481485 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.481423    2564 scope.go:117] "RemoveContainer" containerID="0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"
Jul 23 09:57:31.481671 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.481654    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"} err="failed to get container status \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": rpc error: code = NotFound desc = could not find container \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": container with ID starting with 0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538 not found: ID does not exist"
Jul 23 09:57:31.481720 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.481673    2564 scope.go:117] "RemoveContainer" containerID="f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"
Jul 23 09:57:31.481885 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.481868    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"} err="failed to get container status \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": rpc error: code = NotFound desc = could not find container \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": container with ID starting with f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f not found: ID does not exist"
Jul 23 09:57:31.481950 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.481886    2564 scope.go:117] "RemoveContainer" containerID="87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"
Jul 23 09:57:31.482131 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.482112    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"} err="failed to get container status \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": rpc error: code = NotFound desc = could not find container \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": container with ID starting with 87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a not found: ID does not exist"
Jul 23 09:57:31.482178 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.482133    2564 scope.go:117] "RemoveContainer" containerID="cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"
Jul 23 09:57:31.482404 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.482385    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"} err="failed to get container status \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": rpc error: code = NotFound desc = could not find container \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": container with ID starting with cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00 not found: ID does not exist"
Jul 23 09:57:31.482404 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.482403    2564 scope.go:117] "RemoveContainer" containerID="c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"
Jul 23 09:57:31.482615 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.482593    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"} err="failed to get container status \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": rpc error: code = NotFound desc = could not find container \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": container with ID starting with c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26 not found: ID does not exist"
Jul 23 09:57:31.482666 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.482615    2564 scope.go:117] "RemoveContainer" containerID="bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"
Jul 23 09:57:31.482851 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.482832    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"} err="failed to get container status \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": rpc error: code = NotFound desc = could not find container \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": container with ID starting with bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6 not found: ID does not exist"
Jul 23 09:57:31.482925 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.482852    2564 scope.go:117] "RemoveContainer" containerID="723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"
Jul 23 09:57:31.483050 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.483033    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"} err="failed to get container status \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": rpc error: code = NotFound desc = could not find container \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": container with ID starting with 723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c not found: ID does not exist"
Jul 23 09:57:31.483127 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.483051    2564 scope.go:117] "RemoveContainer" containerID="0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"
Jul 23 09:57:31.483300 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.483278    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"} err="failed to get container status \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": rpc error: code = NotFound desc = could not find container \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": container with ID starting with 0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538 not found: ID does not exist"
Jul 23 09:57:31.483361 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.483303    2564 scope.go:117] "RemoveContainer" containerID="f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"
Jul 23 09:57:31.483552 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.483524    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"} err="failed to get container status \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": rpc error: code = NotFound desc = could not find container \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": container with ID starting with f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f not found: ID does not exist"
Jul 23 09:57:31.483552 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.483549    2564 scope.go:117] "RemoveContainer" containerID="87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"
Jul 23 09:57:31.483790 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.483770    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"} err="failed to get container status \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": rpc error: code = NotFound desc = could not find container \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": container with ID starting with 87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a not found: ID does not exist"
Jul 23 09:57:31.483887 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.483797    2564 scope.go:117] "RemoveContainer" containerID="cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"
Jul 23 09:57:31.484096 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.484063    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"} err="failed to get container status \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": rpc error: code = NotFound desc = could not find container \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": container with ID starting with cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00 not found: ID does not exist"
Jul 23 09:57:31.484096 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.484086    2564 scope.go:117] "RemoveContainer" containerID="c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"
Jul 23 09:57:31.484444 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.484413    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"} err="failed to get container status \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": rpc error: code = NotFound desc = could not find container \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": container with ID starting with c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26 not found: ID does not exist"
Jul 23 09:57:31.484546 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.484446    2564 scope.go:117] "RemoveContainer" containerID="bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"
Jul 23 09:57:31.484725 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.484704    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"} err="failed to get container status \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": rpc error: code = NotFound desc = could not find container \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": container with ID starting with bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6 not found: ID does not exist"
Jul 23 09:57:31.484725 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.484723    2564 scope.go:117] "RemoveContainer" containerID="723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"
Jul 23 09:57:31.484968 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.484947    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"} err="failed to get container status \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": rpc error: code = NotFound desc = could not find container \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": container with ID starting with 723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c not found: ID does not exist"
Jul 23 09:57:31.484968 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.484967    2564 scope.go:117] "RemoveContainer" containerID="0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"
Jul 23 09:57:31.485278 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.485213    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538"} err="failed to get container status \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": rpc error: code = NotFound desc = could not find container \"0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538\": container with ID starting with 0a459967a45d18614537c18431f9d9e679cf4af050aaa8c892acfb9d70012538 not found: ID does not exist"
Jul 23 09:57:31.485278 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.485243    2564 scope.go:117] "RemoveContainer" containerID="f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"
Jul 23 09:57:31.485708 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.485690    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f"} err="failed to get container status \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": rpc error: code = NotFound desc = could not find container \"f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f\": container with ID starting with f028c79813f2572abad3b696d2fd0ed4cfdbf3b2e4c89602bcf7d731be1e9c7f not found: ID does not exist"
Jul 23 09:57:31.485708 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.485708    2564 scope.go:117] "RemoveContainer" containerID="87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"
Jul 23 09:57:31.485981 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.485957    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a"} err="failed to get container status \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": rpc error: code = NotFound desc = could not find container \"87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a\": container with ID starting with 87b4854c216f6921995b5736fda7908990870c241f114728701b6ad017087e2a not found: ID does not exist"
Jul 23 09:57:31.486053 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.485983    2564 scope.go:117] "RemoveContainer" containerID="cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"
Jul 23 09:57:31.486053 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.486010    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 09:57:31.486235 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.486215    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00"} err="failed to get container status \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": rpc error: code = NotFound desc = could not find container \"cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00\": container with ID starting with cf9f2c12ad1535a582c50975a40051d26b5613f09c79fc019299028e454abc00 not found: ID does not exist"
Jul 23 09:57:31.486316 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.486238    2564 scope.go:117] "RemoveContainer" containerID="c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"
Jul 23 09:57:31.486506 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.486485    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26"} err="failed to get container status \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": rpc error: code = NotFound desc = could not find container \"c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26\": container with ID starting with c6fb060b80b83741e546d63a781d4b6161e036b1e0d6bf39cd19fcf90d131f26 not found: ID does not exist"
Jul 23 09:57:31.486577 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.486508    2564 scope.go:117] "RemoveContainer" containerID="bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"
Jul 23 09:57:31.486739 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.486723    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6"} err="failed to get container status \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": rpc error: code = NotFound desc = could not find container \"bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6\": container with ID starting with bf49495a267719bd383aaad5ae6cec1982c5b13dcf4e3c62bc647825423684d6 not found: ID does not exist"
Jul 23 09:57:31.486859 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.486741    2564 scope.go:117] "RemoveContainer" containerID="723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"
Jul 23 09:57:31.491507 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.487402    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c"} err="failed to get container status \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": rpc error: code = NotFound desc = could not find container \"723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c\": container with ID starting with 723a5edcf6a212d6dc1ad29b338300a5c981077783c3596180a80ba8a00f6d0c not found: ID does not exist"
Jul 23 09:57:31.493995 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.493972    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494102 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z47hx\" (UniqueName: \"kubernetes.io/projected/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-kube-api-access-z47hx\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494102 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494025    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494102 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494102 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494102 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494295 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494120    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494295 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494295 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494167    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494295 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494223    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494295 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494295 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494281    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494466 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494466 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494329    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494466 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494398    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494466 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-config\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494466 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494613 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494493    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494613 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.494613 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.494548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595326 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595284    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595326 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595401    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595416    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-config\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595439    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595519    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.595580 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z47hx\" (UniqueName: \"kubernetes.io/projected/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-kube-api-access-z47hx\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.596105 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.596105 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595626    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.596105 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.596105 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.596105 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.596105 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595748    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.596105 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595771    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.596105 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.595848    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.596714 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.596075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.596714 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.596615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.597444 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.597415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.598731 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.598414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.598731 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.598566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.598731 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.598614    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.598952 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.598927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.599045 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.599021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.599680 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.599643    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.600038 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.600010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.600246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.600218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.600432 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.600335    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.601313 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.601239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-config\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.601406 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.601350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.601406 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.601350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.601652 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.601630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.602130 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.602110    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.602371 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.602343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.607179 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.607158    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z47hx\" (UniqueName: \"kubernetes.io/projected/9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff-kube-api-access-z47hx\") pod \"prometheus-k8s-0\" (UID: \"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.783820 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.783724    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:57:31.926343 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:31.926314    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 09:57:31.928299 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:57:31.928269    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a3d397c_bcaa_4195_8b42_fe9af9a6b1ff.slice/crio-4fe8e84cc283c9e055d6e93dabac33468a416f8d81f1c285686931269e148257 WatchSource:0}: Error finding container 4fe8e84cc283c9e055d6e93dabac33468a416f8d81f1c285686931269e148257: Status 404 returned error can't find the container with id 4fe8e84cc283c9e055d6e93dabac33468a416f8d81f1c285686931269e148257
Jul 23 09:57:32.416598 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:32.416565    2564 generic.go:356] "Generic (PLEG): container finished" podID="9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff" containerID="ae7d1cba599dce44581ff23b5c3db6c7eb8746e97eabaed857a26fd034d72546" exitCode=0
Jul 23 09:57:32.416762 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:32.416630    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff","Type":"ContainerDied","Data":"ae7d1cba599dce44581ff23b5c3db6c7eb8746e97eabaed857a26fd034d72546"}
Jul 23 09:57:32.416762 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:32.416683    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff","Type":"ContainerStarted","Data":"4fe8e84cc283c9e055d6e93dabac33468a416f8d81f1c285686931269e148257"}
Jul 23 09:57:32.613116 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:32.612666    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc35e65c-e4ca-4585-a31a-b7afa71d7f3e" path="/var/lib/kubelet/pods/dc35e65c-e4ca-4585-a31a-b7afa71d7f3e/volumes"
Jul 23 09:57:33.423686 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:33.423645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff","Type":"ContainerStarted","Data":"fcdfa58788d873bc30844dd101cfe4888b60c84b46753fb5019c8915069a3257"}
Jul 23 09:57:33.423882 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:33.423718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff","Type":"ContainerStarted","Data":"f9ad375e1fb89435e8454a6d2e28d359bcfc76b5e29f7f91d7acf1723609c799"}
Jul 23 09:57:33.423882 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:33.423746    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff","Type":"ContainerStarted","Data":"ddddafa5488482cfd679e6c7df6a976ecb87ef2420cc3c7ec1525aab5d5c7f17"}
Jul 23 09:57:33.423882 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:33.423779    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff","Type":"ContainerStarted","Data":"024a4d9e14772c51b2f4656a900e478495ee6dd0aee2ea31311395dd6d153d79"}
Jul 23 09:57:33.423882 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:33.423806    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff","Type":"ContainerStarted","Data":"1c08833e81a7c76b5c01ef9d9d6d07f18b301a0ea8867d4019a6f1491b6aafa8"}
Jul 23 09:57:33.423882 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:33.423830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff","Type":"ContainerStarted","Data":"91b99d446be141fa32d80e516bb32f49b6c5e3a33c2c90db86626b63ef420cd9"}
Jul 23 09:57:33.452680 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:33.452614    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.431397293 podStartE2EDuration="2.452591464s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.194171ms" isStatefulPod=false podCreationTimestamp="2026-07-23 09:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:57:33.450085463 +0000 UTC m=+173.353773737" watchObservedRunningTime="2026-07-23 09:57:33.452591464 +0000 UTC m=+173.356279740"
Jul 23 09:57:33.810090 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:33.809999    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:33.859830 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:33.859797    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:34.325498 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:34.325466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:34.425640 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:34.425600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:34.477820 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:34.477787    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:36.416917 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:36.416881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:36.518522 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:36.518489    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:36.618685 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:36.618658    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:57:36.784037 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:57:36.783949    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:58:01.742641 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:01.742609    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:05.962157 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:05.962123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:08.800274 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:08.800223    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:08.895569 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:08.895535    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:13.818614 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:13.818580    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:30.420415 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:30.420376    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:31.387857 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:31.387820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:31.784858 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:31.784756    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:58:31.800753 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:31.800722    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:58:32.658288 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:32.658243    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 09:58:34.045559 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:34.045523    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:34.145609 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:34.145575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:35.722559 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:35.722523    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:35.846373 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:35.846346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:35.952776 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:35.952747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:36.044098 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:36.044008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:38.302951 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:38.302921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:38.715713 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:38.715681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:40.818800 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:40.818771    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:40.919393 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:40.919360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:45.918888 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:45.918854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:48.495639 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:48.495604    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:48.595409 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:48.595371    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:53.139322 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:53.139284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:53.242540 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:53.242503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:55.245030 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:55.245000    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:57.176767 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:57.176733    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:57.277649 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:57.277609    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:58:57.369117 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:58:57.369086    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:05.872660 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:05.872578    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:05.973793 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:05.973760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:09.256148 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:09.256111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:09.347453 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:09.347421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:10.057827 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.057794    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:10.261369 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.261334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:10.363148 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.363059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:10.411943 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.411905    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"]
Jul 23 09:59:10.415001 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.414976    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.418146 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.418124    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 09:59:10.418287 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.418128    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 09:59:10.418644 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.418624    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 09:59:10.418733 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.418652    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5pgqj\""
Jul 23 09:59:10.418888 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.418871    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 09:59:10.432109 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.432081    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"]
Jul 23 09:59:10.527366 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.527332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96j9n\" (UniqueName: \"kubernetes.io/projected/f23c1728-8d73-4564-9d57-15e28bdae03e-kube-api-access-96j9n\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.527522 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.527373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f23c1728-8d73-4564-9d57-15e28bdae03e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.527522 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.527462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f23c1728-8d73-4564-9d57-15e28bdae03e-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.527611 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.527527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f23c1728-8d73-4564-9d57-15e28bdae03e-tmp\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.527611 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.527560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f23c1728-8d73-4564-9d57-15e28bdae03e-manifests\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.561432 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.561398    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:10.628527 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.628499    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f23c1728-8d73-4564-9d57-15e28bdae03e-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.628708 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.628558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f23c1728-8d73-4564-9d57-15e28bdae03e-tmp\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.628708 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.628592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f23c1728-8d73-4564-9d57-15e28bdae03e-manifests\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.628708 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.628628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96j9n\" (UniqueName: \"kubernetes.io/projected/f23c1728-8d73-4564-9d57-15e28bdae03e-kube-api-access-96j9n\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.628708 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.628658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f23c1728-8d73-4564-9d57-15e28bdae03e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.629089 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.629056    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f23c1728-8d73-4564-9d57-15e28bdae03e-manifests\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.631104 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.631081    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f23c1728-8d73-4564-9d57-15e28bdae03e-tmp\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.631298 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.631279    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f23c1728-8d73-4564-9d57-15e28bdae03e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.631358 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.631342    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f23c1728-8d73-4564-9d57-15e28bdae03e-webhook-cert\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.636465 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.636447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96j9n\" (UniqueName: \"kubernetes.io/projected/f23c1728-8d73-4564-9d57-15e28bdae03e-kube-api-access-96j9n\") pod \"opendatahub-operator-controller-manager-86bc8b458c-swdj4\" (UID: \"f23c1728-8d73-4564-9d57-15e28bdae03e\") " pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.659354 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.659320    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:10.725669 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.725633    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:10.759945 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.759918    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:10.852617 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.852589    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:10.869823 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.869725    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"]
Jul 23 09:59:10.872713 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:59:10.872686    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23c1728_8d73_4564_9d57_15e28bdae03e.slice/crio-5f5fc58b31c349bf7125295ce3daa90b8a9d851f4988f0e949b87abf6d07cf71 WatchSource:0}: Error finding container 5f5fc58b31c349bf7125295ce3daa90b8a9d851f4988f0e949b87abf6d07cf71: Status 404 returned error can't find the container with id 5f5fc58b31c349bf7125295ce3daa90b8a9d851f4988f0e949b87abf6d07cf71
Jul 23 09:59:10.911137 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:10.911047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:11.018443 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:11.018414    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:11.779321 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:11.779281    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4" event={"ID":"f23c1728-8d73-4564-9d57-15e28bdae03e","Type":"ContainerStarted","Data":"5f5fc58b31c349bf7125295ce3daa90b8a9d851f4988f0e949b87abf6d07cf71"}
Jul 23 09:59:14.793190 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:14.793145    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4" event={"ID":"f23c1728-8d73-4564-9d57-15e28bdae03e","Type":"ContainerStarted","Data":"9073f92ce31c45cc6dbd7f9ecbf1448b83e22ee10963ce979e6fe25dc96c2ddf"}
Jul 23 09:59:15.798338 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:15.798303    2564 generic.go:356] "Generic (PLEG): container finished" podID="f23c1728-8d73-4564-9d57-15e28bdae03e" containerID="9073f92ce31c45cc6dbd7f9ecbf1448b83e22ee10963ce979e6fe25dc96c2ddf" exitCode=0
Jul 23 09:59:15.798739 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:15.798346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4" event={"ID":"f23c1728-8d73-4564-9d57-15e28bdae03e","Type":"ContainerDied","Data":"9073f92ce31c45cc6dbd7f9ecbf1448b83e22ee10963ce979e6fe25dc96c2ddf"}
Jul 23 09:59:16.803906 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:16.803875    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4" event={"ID":"f23c1728-8d73-4564-9d57-15e28bdae03e","Type":"ContainerStarted","Data":"9ec5a1516e5bd54abb312ee484a78d91661447a25b19bf9f5c53361175364510"}
Jul 23 09:59:16.804308 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:16.803951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:16.825907 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:16.825848    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4" podStartSLOduration=2.291103268 podStartE2EDuration="6.825815679s" totalImagesPullingTime="3.495281877s" totalInitContainerRuntime="1.039430534s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:16.824618006 +0000 UTC m=+276.728306272" watchObservedRunningTime="2026-07-23 09:59:16.825815679 +0000 UTC m=+276.729503955"
Jul 23 09:59:18.869448 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:18.869419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:22.256529 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:22.256498    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:22.359998 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:22.359963    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:23.592492 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:23.592457    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:23.698920 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:23.698888    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:27.810584 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:27.810553    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86bc8b458c-swdj4"
Jul 23 09:59:29.334895 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:29.334854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:29.475572 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:29.475536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:29.764893 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:29.764859    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:30.011206 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.011170    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"]
Jul 23 09:59:30.020912 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.020843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.024312 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.024289    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 09:59:30.025306 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.025285    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 09:59:30.025588 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.025293    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 09:59:30.025899 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.025877    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sf9r5\""
Jul 23 09:59:30.025990 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.025900    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 09:59:30.028153 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.028130    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"]
Jul 23 09:59:30.092220 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.092184    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70a159bf-6e69-45ac-a8b5-04a1e4582795-tls-certs\") pod \"kube-auth-proxy-565557bd5f-rn67f\" (UID: \"70a159bf-6e69-45ac-a8b5-04a1e4582795\") " pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.092410 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.092231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70a159bf-6e69-45ac-a8b5-04a1e4582795-tmp\") pod \"kube-auth-proxy-565557bd5f-rn67f\" (UID: \"70a159bf-6e69-45ac-a8b5-04a1e4582795\") " pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.092410 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.092367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhfdp\" (UniqueName: \"kubernetes.io/projected/70a159bf-6e69-45ac-a8b5-04a1e4582795-kube-api-access-zhfdp\") pod \"kube-auth-proxy-565557bd5f-rn67f\" (UID: \"70a159bf-6e69-45ac-a8b5-04a1e4582795\") " pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.189858 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.189827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:30.192978 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.192955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70a159bf-6e69-45ac-a8b5-04a1e4582795-tmp\") pod \"kube-auth-proxy-565557bd5f-rn67f\" (UID: \"70a159bf-6e69-45ac-a8b5-04a1e4582795\") " pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.193049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.193006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhfdp\" (UniqueName: \"kubernetes.io/projected/70a159bf-6e69-45ac-a8b5-04a1e4582795-kube-api-access-zhfdp\") pod \"kube-auth-proxy-565557bd5f-rn67f\" (UID: \"70a159bf-6e69-45ac-a8b5-04a1e4582795\") " pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.193049 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.193041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70a159bf-6e69-45ac-a8b5-04a1e4582795-tls-certs\") pod \"kube-auth-proxy-565557bd5f-rn67f\" (UID: \"70a159bf-6e69-45ac-a8b5-04a1e4582795\") " pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.195505 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.195482    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70a159bf-6e69-45ac-a8b5-04a1e4582795-tmp\") pod \"kube-auth-proxy-565557bd5f-rn67f\" (UID: \"70a159bf-6e69-45ac-a8b5-04a1e4582795\") " pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.195751 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.195730    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70a159bf-6e69-45ac-a8b5-04a1e4582795-tls-certs\") pod \"kube-auth-proxy-565557bd5f-rn67f\" (UID: \"70a159bf-6e69-45ac-a8b5-04a1e4582795\") " pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.210869 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.210834    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhfdp\" (UniqueName: \"kubernetes.io/projected/70a159bf-6e69-45ac-a8b5-04a1e4582795-kube-api-access-zhfdp\") pod \"kube-auth-proxy-565557bd5f-rn67f\" (UID: \"70a159bf-6e69-45ac-a8b5-04a1e4582795\") " pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.332965 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.332872    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"
Jul 23 09:59:30.407780 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.407748    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6xxzg"]
Jul 23 09:59:30.411708 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.411680    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:30.414944 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.414849    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 09:59:30.415611 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.415279    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-pf5t4\""
Jul 23 09:59:30.426115 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.426042    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6xxzg"]
Jul 23 09:59:30.469352 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.469333    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-565557bd5f-rn67f"]
Jul 23 09:59:30.472004 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:59:30.471976    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a159bf_6e69_45ac_a8b5_04a1e4582795.slice/crio-233c05a14d5717badb16a0a355787859f3457976b34223abae0de18553a2d075 WatchSource:0}: Error finding container 233c05a14d5717badb16a0a355787859f3457976b34223abae0de18553a2d075: Status 404 returned error can't find the container with id 233c05a14d5717badb16a0a355787859f3457976b34223abae0de18553a2d075
Jul 23 09:59:30.495105 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.495069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83db31c6-5a47-4659-aa96-32b5b6cae36e-cert\") pod \"odh-model-controller-7998c67dc4-6xxzg\" (UID: \"83db31c6-5a47-4659-aa96-32b5b6cae36e\") " pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:30.495273 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.495125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-545j9\" (UniqueName: \"kubernetes.io/projected/83db31c6-5a47-4659-aa96-32b5b6cae36e-kube-api-access-545j9\") pod \"odh-model-controller-7998c67dc4-6xxzg\" (UID: \"83db31c6-5a47-4659-aa96-32b5b6cae36e\") " pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:30.531705 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.531647    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:30.596646 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.596551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83db31c6-5a47-4659-aa96-32b5b6cae36e-cert\") pod \"odh-model-controller-7998c67dc4-6xxzg\" (UID: \"83db31c6-5a47-4659-aa96-32b5b6cae36e\") " pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:30.596646 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.596606    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-545j9\" (UniqueName: \"kubernetes.io/projected/83db31c6-5a47-4659-aa96-32b5b6cae36e-kube-api-access-545j9\") pod \"odh-model-controller-7998c67dc4-6xxzg\" (UID: \"83db31c6-5a47-4659-aa96-32b5b6cae36e\") " pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:30.596869 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:59:30.596704    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 09:59:30.596869 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:59:30.596773    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83db31c6-5a47-4659-aa96-32b5b6cae36e-cert podName:83db31c6-5a47-4659-aa96-32b5b6cae36e nodeName:}" failed. No retries permitted until 2026-07-23 09:59:31.096753828 +0000 UTC m=+291.000442083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/83db31c6-5a47-4659-aa96-32b5b6cae36e-cert") pod "odh-model-controller-7998c67dc4-6xxzg" (UID: "83db31c6-5a47-4659-aa96-32b5b6cae36e") : secret "odh-model-controller-webhook-cert" not found
Jul 23 09:59:30.621786 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.621758    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-545j9\" (UniqueName: \"kubernetes.io/projected/83db31c6-5a47-4659-aa96-32b5b6cae36e-kube-api-access-545j9\") pod \"odh-model-controller-7998c67dc4-6xxzg\" (UID: \"83db31c6-5a47-4659-aa96-32b5b6cae36e\") " pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:30.656862 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.656817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:30.766209 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.766176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:30.857660 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.857565    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f" event={"ID":"70a159bf-6e69-45ac-a8b5-04a1e4582795","Type":"ContainerStarted","Data":"233c05a14d5717badb16a0a355787859f3457976b34223abae0de18553a2d075"}
Jul 23 09:59:30.866509 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.866479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:30.966311 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:30.966277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:31.088201 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.088168    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"]
Jul 23 09:59:31.090376 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.090353    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:31.091504 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.091491    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.094195 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.094173    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 09:59:31.094323 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.094204    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 09:59:31.094323 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.094204    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 09:59:31.094489 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.094467    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 09:59:31.094705 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.094691    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-sd76z\""
Jul 23 09:59:31.101200 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.101178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83db31c6-5a47-4659-aa96-32b5b6cae36e-cert\") pod \"odh-model-controller-7998c67dc4-6xxzg\" (UID: \"83db31c6-5a47-4659-aa96-32b5b6cae36e\") " pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:31.103355 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.103336    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"]
Jul 23 09:59:31.103997 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.103973    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83db31c6-5a47-4659-aa96-32b5b6cae36e-cert\") pod \"odh-model-controller-7998c67dc4-6xxzg\" (UID: \"83db31c6-5a47-4659-aa96-32b5b6cae36e\") " pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:31.150452 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.150419    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:31.201889 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.201851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-cacerts\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.202077 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.201910    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.202077 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.201986    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.202077 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.202046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.202246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.202103    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-token\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.202246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.202151    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv5dj\" (UniqueName: \"kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-kube-api-access-pv5dj\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.202246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.202198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4005eaec-160e-43f1-9398-74309e8bbbcb-local-certs\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.303000 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.302963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.303212 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.303030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.303212 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.303057    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.303212 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.303107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-token\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.303212 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.303155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5dj\" (UniqueName: \"kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-kube-api-access-pv5dj\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.303212 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.303200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4005eaec-160e-43f1-9398-74309e8bbbcb-local-certs\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.303493 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.303227    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-cacerts\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.303844 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.303815    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.306596 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.306552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.306596 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.306577    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4005eaec-160e-43f1-9398-74309e8bbbcb-local-certs\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.306721 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.306649    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-cacerts\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.306757 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.306742    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.311789 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.311769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-token\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.312548 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.312522    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv5dj\" (UniqueName: \"kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-kube-api-access-pv5dj\") pod \"istiod-openshift-gateway-7574459656-wl7jt\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.325376 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.325351    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:31.401065 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.400674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:31.440784 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.440022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:31.499671 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.499641    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6xxzg"]
Jul 23 09:59:31.503362 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:59:31.503326    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83db31c6_5a47_4659_aa96_32b5b6cae36e.slice/crio-adb2e9fb922754308f3b1fa6e85cc26c5bf6e4e36c1f4482a4ba77e29fc5aeaf WatchSource:0}: Error finding container adb2e9fb922754308f3b1fa6e85cc26c5bf6e4e36c1f4482a4ba77e29fc5aeaf: Status 404 returned error can't find the container with id adb2e9fb922754308f3b1fa6e85cc26c5bf6e4e36c1f4482a4ba77e29fc5aeaf
Jul 23 09:59:31.580272 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.580214    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"]
Jul 23 09:59:31.584104 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:59:31.584072    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4005eaec_160e_43f1_9398_74309e8bbbcb.slice/crio-7c39c9535cad6144fcf6aff22fba20b62f6eb012a08f6dd46ad8974bc2ba4f76 WatchSource:0}: Error finding container 7c39c9535cad6144fcf6aff22fba20b62f6eb012a08f6dd46ad8974bc2ba4f76: Status 404 returned error can't find the container with id 7c39c9535cad6144fcf6aff22fba20b62f6eb012a08f6dd46ad8974bc2ba4f76
Jul 23 09:59:31.609863 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.609835    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:31.864447 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.864358    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt" event={"ID":"4005eaec-160e-43f1-9398-74309e8bbbcb","Type":"ContainerStarted","Data":"7c39c9535cad6144fcf6aff22fba20b62f6eb012a08f6dd46ad8974bc2ba4f76"}
Jul 23 09:59:31.865709 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:31.865662    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg" event={"ID":"83db31c6-5a47-4659-aa96-32b5b6cae36e","Type":"ContainerStarted","Data":"adb2e9fb922754308f3b1fa6e85cc26c5bf6e4e36c1f4482a4ba77e29fc5aeaf"}
Jul 23 09:59:32.098856 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:32.098821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:34.884420 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:34.884381    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f" event={"ID":"70a159bf-6e69-45ac-a8b5-04a1e4582795","Type":"ContainerStarted","Data":"591a2e5149c3360e9bb9237b3534b336c6d8d09f45c5724a059027d4c5528959"}
Jul 23 09:59:34.886382 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:34.886352    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg" event={"ID":"83db31c6-5a47-4659-aa96-32b5b6cae36e","Type":"ContainerStarted","Data":"47eb6ecc981cc7e77d52869097dda846b9a851c182d993cee03a9d9022f6f00f"}
Jul 23 09:59:34.886522 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:34.886497    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:34.900050 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:34.899989    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-565557bd5f-rn67f" podStartSLOduration=2.027753052 podStartE2EDuration="5.899969838s" totalImagesPullingTime="3.872216786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:34.898996939 +0000 UTC m=+294.802685212" watchObservedRunningTime="2026-07-23 09:59:34.899969838 +0000 UTC m=+294.803658112"
Jul 23 09:59:34.917411 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:34.917347    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg" podStartSLOduration=2.030879511 podStartE2EDuration="4.917324987s" totalImagesPullingTime="2.886445476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:34.914919393 +0000 UTC m=+294.818607668" watchObservedRunningTime="2026-07-23 09:59:34.917324987 +0000 UTC m=+294.821013265"
Jul 23 09:59:36.287996 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:36.283575    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 23 09:59:36.287996 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:36.283729    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 23 09:59:36.719391 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:36.719343    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:36.819040 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:36.819009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:36.896824 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:36.896784    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt" event={"ID":"4005eaec-160e-43f1-9398-74309e8bbbcb","Type":"ContainerStarted","Data":"07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9"}
Jul 23 09:59:36.896995 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:36.896947    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:36.918693 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:36.918637    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt" podStartSLOduration=1.222219641 podStartE2EDuration="5.918620853s" totalImagesPullingTime="4.696401212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:36.916768387 +0000 UTC m=+296.820456662" watchObservedRunningTime="2026-07-23 09:59:36.918620853 +0000 UTC m=+296.822309128"
Jul 23 09:59:36.996994 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:36.996916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:37.356296 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:37.356175    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:37.459150 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:37.459121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:37.903542 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:37.903512    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:40.439858 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.439825    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:40.490557 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.490514    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"]
Jul 23 09:59:40.495010 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.494982    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 09:59:40.497698 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.497669    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 09:59:40.498648 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.498627    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"]
Jul 23 09:59:40.499134 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.499116    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:40.501644 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.501623    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 09:59:40.501912 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.501658    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-lb7qq\""
Jul 23 09:59:40.502699 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.502675    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"
Jul 23 09:59:40.505752 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.505727    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 23 09:59:40.507098 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.507075    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fsxsc\""
Jul 23 09:59:40.508985 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.508963    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 09:59:40.510395 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.510374    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"]
Jul 23 09:59:40.511634 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.511607    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"]
Jul 23 09:59:40.593866 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.593700    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9302ee41-aaca-48fc-ae76-e7f5dbca9e12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-spmmh\" (UID: \"9302ee41-aaca-48fc-ae76-e7f5dbca9e12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"
Jul 23 09:59:40.593866 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.593785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp6nv\" (UniqueName: \"kubernetes.io/projected/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-kube-api-access-wp6nv\") pod \"kserve-controller-manager-d6f4b65b8-9fkcb\" (UID: \"91485fdf-3fc3-4e69-af62-93d8f3ca7fec\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:40.593866 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.593842    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-cert\") pod \"kserve-controller-manager-d6f4b65b8-9fkcb\" (UID: \"91485fdf-3fc3-4e69-af62-93d8f3ca7fec\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:40.615985 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.593903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5kgs\" (UniqueName: \"kubernetes.io/projected/9302ee41-aaca-48fc-ae76-e7f5dbca9e12-kube-api-access-c5kgs\") pod \"llmisvc-controller-manager-777c6bd7d5-spmmh\" (UID: \"9302ee41-aaca-48fc-ae76-e7f5dbca9e12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"
Jul 23 09:59:40.695246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.695144    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9302ee41-aaca-48fc-ae76-e7f5dbca9e12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-spmmh\" (UID: \"9302ee41-aaca-48fc-ae76-e7f5dbca9e12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"
Jul 23 09:59:40.695246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.695212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp6nv\" (UniqueName: \"kubernetes.io/projected/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-kube-api-access-wp6nv\") pod \"kserve-controller-manager-d6f4b65b8-9fkcb\" (UID: \"91485fdf-3fc3-4e69-af62-93d8f3ca7fec\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:40.695246 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.695249    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-cert\") pod \"kserve-controller-manager-d6f4b65b8-9fkcb\" (UID: \"91485fdf-3fc3-4e69-af62-93d8f3ca7fec\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:40.695540 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.695280    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5kgs\" (UniqueName: \"kubernetes.io/projected/9302ee41-aaca-48fc-ae76-e7f5dbca9e12-kube-api-access-c5kgs\") pod \"llmisvc-controller-manager-777c6bd7d5-spmmh\" (UID: \"9302ee41-aaca-48fc-ae76-e7f5dbca9e12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"
Jul 23 09:59:40.695540 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:59:40.695390    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 23 09:59:40.695540 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:59:40.695460    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-cert podName:91485fdf-3fc3-4e69-af62-93d8f3ca7fec nodeName:}" failed. No retries permitted until 2026-07-23 09:59:41.195440058 +0000 UTC m=+301.099128329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-cert") pod "kserve-controller-manager-d6f4b65b8-9fkcb" (UID: "91485fdf-3fc3-4e69-af62-93d8f3ca7fec") : secret "kserve-webhook-server-cert" not found
Jul 23 09:59:40.697971 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.697949    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9302ee41-aaca-48fc-ae76-e7f5dbca9e12-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-spmmh\" (UID: \"9302ee41-aaca-48fc-ae76-e7f5dbca9e12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"
Jul 23 09:59:40.715657 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.715627    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5kgs\" (UniqueName: \"kubernetes.io/projected/9302ee41-aaca-48fc-ae76-e7f5dbca9e12-kube-api-access-c5kgs\") pod \"llmisvc-controller-manager-777c6bd7d5-spmmh\" (UID: \"9302ee41-aaca-48fc-ae76-e7f5dbca9e12\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"
Jul 23 09:59:40.716051 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.716030    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp6nv\" (UniqueName: \"kubernetes.io/projected/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-kube-api-access-wp6nv\") pod \"kserve-controller-manager-d6f4b65b8-9fkcb\" (UID: \"91485fdf-3fc3-4e69-af62-93d8f3ca7fec\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:40.834156 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.834118    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"
Jul 23 09:59:40.983816 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:40.983628    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"]
Jul 23 09:59:40.986436 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:59:40.986397    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9302ee41_aaca_48fc_ae76_e7f5dbca9e12.slice/crio-4b51356e4c98a65b4a9529339f46c47c63886f1657d5085bc00afc99000b5bd4 WatchSource:0}: Error finding container 4b51356e4c98a65b4a9529339f46c47c63886f1657d5085bc00afc99000b5bd4: Status 404 returned error can't find the container with id 4b51356e4c98a65b4a9529339f46c47c63886f1657d5085bc00afc99000b5bd4
Jul 23 09:59:41.199006 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:41.198961    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-cert\") pod \"kserve-controller-manager-d6f4b65b8-9fkcb\" (UID: \"91485fdf-3fc3-4e69-af62-93d8f3ca7fec\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:41.199193 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:59:41.199127    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 23 09:59:41.199234 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:59:41.199207    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-cert podName:91485fdf-3fc3-4e69-af62-93d8f3ca7fec nodeName:}" failed. No retries permitted until 2026-07-23 09:59:42.199189639 +0000 UTC m=+302.102877890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-cert") pod "kserve-controller-manager-d6f4b65b8-9fkcb" (UID: "91485fdf-3fc3-4e69-af62-93d8f3ca7fec") : secret "kserve-webhook-server-cert" not found
Jul 23 09:59:41.767467 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:41.767434    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:41.887932 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:41.887892    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 09:59:41.921457 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:41.921419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh" event={"ID":"9302ee41-aaca-48fc-ae76-e7f5dbca9e12","Type":"ContainerStarted","Data":"4b51356e4c98a65b4a9529339f46c47c63886f1657d5085bc00afc99000b5bd4"}
Jul 23 09:59:42.207868 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:42.207831    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-cert\") pod \"kserve-controller-manager-d6f4b65b8-9fkcb\" (UID: \"91485fdf-3fc3-4e69-af62-93d8f3ca7fec\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:42.210417 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:42.210391    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91485fdf-3fc3-4e69-af62-93d8f3ca7fec-cert\") pod \"kserve-controller-manager-d6f4b65b8-9fkcb\" (UID: \"91485fdf-3fc3-4e69-af62-93d8f3ca7fec\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:42.325457 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:42.325404    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:42.643225 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:42.643192    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"]
Jul 23 09:59:42.646091 ip-10-0-141-187 kubenswrapper[2564]: W0723 09:59:42.646064    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91485fdf_3fc3_4e69_af62_93d8f3ca7fec.slice/crio-6697cd470b6c7fdf94e13d931a971ab9802bce2ddb782c20a42dc339f1054f63 WatchSource:0}: Error finding container 6697cd470b6c7fdf94e13d931a971ab9802bce2ddb782c20a42dc339f1054f63: Status 404 returned error can't find the container with id 6697cd470b6c7fdf94e13d931a971ab9802bce2ddb782c20a42dc339f1054f63
Jul 23 09:59:42.647550 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:42.647530    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 09:59:42.817378 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:42.817285    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"]
Jul 23 09:59:42.817811 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:42.817480    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt" podUID="4005eaec-160e-43f1-9398-74309e8bbbcb" containerName="discovery" containerID="cri-o://07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9" gracePeriod=30
Jul 23 09:59:42.927711 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:42.927678    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb" event={"ID":"91485fdf-3fc3-4e69-af62-93d8f3ca7fec","Type":"ContainerStarted","Data":"6697cd470b6c7fdf94e13d931a971ab9802bce2ddb782c20a42dc339f1054f63"}
Jul 23 09:59:43.076727 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.076653    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:43.217960 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.217905    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-ca-configmap\") pod \"4005eaec-160e-43f1-9398-74309e8bbbcb\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") "
Jul 23 09:59:43.217960 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.217960    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-token\") pod \"4005eaec-160e-43f1-9398-74309e8bbbcb\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") "
Jul 23 09:59:43.218233 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.217998    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-kubeconfig\") pod \"4005eaec-160e-43f1-9398-74309e8bbbcb\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") "
Jul 23 09:59:43.218233 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.218018    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4005eaec-160e-43f1-9398-74309e8bbbcb-local-certs\") pod \"4005eaec-160e-43f1-9398-74309e8bbbcb\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") "
Jul 23 09:59:43.218233 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.218038    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-cacerts\") pod \"4005eaec-160e-43f1-9398-74309e8bbbcb\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") "
Jul 23 09:59:43.218233 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.218082    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-dns-cert\") pod \"4005eaec-160e-43f1-9398-74309e8bbbcb\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") "
Jul 23 09:59:43.218233 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.218116    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv5dj\" (UniqueName: \"kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-kube-api-access-pv5dj\") pod \"4005eaec-160e-43f1-9398-74309e8bbbcb\" (UID: \"4005eaec-160e-43f1-9398-74309e8bbbcb\") "
Jul 23 09:59:43.218518 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.218464    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "4005eaec-160e-43f1-9398-74309e8bbbcb" (UID: "4005eaec-160e-43f1-9398-74309e8bbbcb"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 09:59:43.220567 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.220531    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-token" (OuterVolumeSpecName: "istio-token") pod "4005eaec-160e-43f1-9398-74309e8bbbcb" (UID: "4005eaec-160e-43f1-9398-74309e8bbbcb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:59:43.220739 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.220715    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-kube-api-access-pv5dj" (OuterVolumeSpecName: "kube-api-access-pv5dj") pod "4005eaec-160e-43f1-9398-74309e8bbbcb" (UID: "4005eaec-160e-43f1-9398-74309e8bbbcb"). InnerVolumeSpecName "kube-api-access-pv5dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 09:59:43.220810 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.220752    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "4005eaec-160e-43f1-9398-74309e8bbbcb" (UID: "4005eaec-160e-43f1-9398-74309e8bbbcb"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:59:43.220810 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.220778    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "4005eaec-160e-43f1-9398-74309e8bbbcb" (UID: "4005eaec-160e-43f1-9398-74309e8bbbcb"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:59:43.220968 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.220942    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-cacerts" (OuterVolumeSpecName: "cacerts") pod "4005eaec-160e-43f1-9398-74309e8bbbcb" (UID: "4005eaec-160e-43f1-9398-74309e8bbbcb"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 09:59:43.220968 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.220949    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4005eaec-160e-43f1-9398-74309e8bbbcb-local-certs" (OuterVolumeSpecName: "local-certs") pod "4005eaec-160e-43f1-9398-74309e8bbbcb" (UID: "4005eaec-160e-43f1-9398-74309e8bbbcb"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 09:59:43.319391 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.319352    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-kubeconfig\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:59:43.319391 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.319387    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4005eaec-160e-43f1-9398-74309e8bbbcb-local-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:59:43.319391 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.319402    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-cacerts\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:59:43.319712 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.319416    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-dns-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:59:43.319712 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.319428    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv5dj\" (UniqueName: \"kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-kube-api-access-pv5dj\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:59:43.319712 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.319436    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-csr-ca-configmap\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:59:43.319712 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.319444    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4005eaec-160e-43f1-9398-74309e8bbbcb-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 09:59:43.935552 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.935511    2564 generic.go:356] "Generic (PLEG): container finished" podID="4005eaec-160e-43f1-9398-74309e8bbbcb" containerID="07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9" exitCode=0
Jul 23 09:59:43.935938 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.935564    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"
Jul 23 09:59:43.935938 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.935593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt" event={"ID":"4005eaec-160e-43f1-9398-74309e8bbbcb","Type":"ContainerDied","Data":"07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9"}
Jul 23 09:59:43.935938 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.935646    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt" event={"ID":"4005eaec-160e-43f1-9398-74309e8bbbcb","Type":"ContainerDied","Data":"7c39c9535cad6144fcf6aff22fba20b62f6eb012a08f6dd46ad8974bc2ba4f76"}
Jul 23 09:59:43.935938 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.935670    2564 scope.go:117] "RemoveContainer" containerID="07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9"
Jul 23 09:59:43.956902 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.956875    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"]
Jul 23 09:59:43.961732 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.961710    2564 scope.go:117] "RemoveContainer" containerID="07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9"
Jul 23 09:59:43.962389 ip-10-0-141-187 kubenswrapper[2564]: E0723 09:59:43.962352    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9\": container with ID starting with 07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9 not found: ID does not exist" containerID="07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9"
Jul 23 09:59:43.962526 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.962401    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9"} err="failed to get container status \"07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9\": rpc error: code = NotFound desc = could not find container \"07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9\": container with ID starting with 07c46d1cda9ed20b16c260ffb45aab47cddbb557e9df8e10bc55fff5b53fa2c9 not found: ID does not exist"
Jul 23 09:59:43.964069 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:43.964049    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-wl7jt"]
Jul 23 09:59:44.610168 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:44.610133    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4005eaec-160e-43f1-9398-74309e8bbbcb" path="/var/lib/kubelet/pods/4005eaec-160e-43f1-9398-74309e8bbbcb/volumes"
Jul 23 09:59:44.941948 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:44.941906    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh" event={"ID":"9302ee41-aaca-48fc-ae76-e7f5dbca9e12","Type":"ContainerStarted","Data":"41fc5c002118d6374f6d07b2cf676ef6b37dcf6b55d41e0910668d07baa0619c"}
Jul 23 09:59:44.942473 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:44.942114    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"
Jul 23 09:59:44.981275 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:44.981206    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh" podStartSLOduration=2.000802566 podStartE2EDuration="4.9811864s" totalImagesPullingTime="2.980383834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:44.979322314 +0000 UTC m=+304.883010588" watchObservedRunningTime="2026-07-23 09:59:44.9811864 +0000 UTC m=+304.884874678"
Jul 23 09:59:45.893558 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:45.893524    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6xxzg"
Jul 23 09:59:45.949925 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:45.949841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb" event={"ID":"91485fdf-3fc3-4e69-af62-93d8f3ca7fec","Type":"ContainerStarted","Data":"cf79e03170a44dc8afa21768fdc4cace967665b0bbead4b93a7a754eea9e3bee"}
Jul 23 09:59:45.950372 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:45.950121    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 09:59:45.967096 ip-10-0-141-187 kubenswrapper[2564]: I0723 09:59:45.966917    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb" podStartSLOduration=2.957393476 podStartE2EDuration="5.966894784s" totalImagesPullingTime="3.009501308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 09:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 09:59:45.965903944 +0000 UTC m=+305.869592220" watchObservedRunningTime="2026-07-23 09:59:45.966894784 +0000 UTC m=+305.870583061"
Jul 23 10:00:13.219023 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:13.218989    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:00:13.270902 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:13.270873    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:00:15.387583 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:15.387540    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:00:15.488182 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:15.488149    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:00:15.952325 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:15.952295    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-spmmh"
Jul 23 10:00:16.964763 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:16.964728    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9fkcb"
Jul 23 10:00:30.861219 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:30.861184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:00:30.952460 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:30.952406    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:00:30.984323 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:30.984287    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgln5"]
Jul 23 10:00:30.984609 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:30.984597    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4005eaec-160e-43f1-9398-74309e8bbbcb" containerName="discovery"
Jul 23 10:00:30.984649 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:30.984611    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4005eaec-160e-43f1-9398-74309e8bbbcb" containerName="discovery"
Jul 23 10:00:30.984683 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:30.984674    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4005eaec-160e-43f1-9398-74309e8bbbcb" containerName="discovery"
Jul 23 10:00:30.987490 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:30.987474    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgln5"
Jul 23 10:00:30.990677 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:30.990546    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 10:00:30.991751 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:30.991725    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 10:00:30.991996 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:30.991755    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xmq2m\""
Jul 23 10:00:31.002087 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.002064    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgln5"]
Jul 23 10:00:31.025701 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.025672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnnmf\" (UniqueName: \"kubernetes.io/projected/d8d85af6-7aaf-4de1-b2d3-81ad40719c28-kube-api-access-rnnmf\") pod \"kuadrant-operator-catalog-sgln5\" (UID: \"d8d85af6-7aaf-4de1-b2d3-81ad40719c28\") " pod="kuadrant-system/kuadrant-operator-catalog-sgln5"
Jul 23 10:00:31.052164 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.052135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:00:31.127037 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.126952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnnmf\" (UniqueName: \"kubernetes.io/projected/d8d85af6-7aaf-4de1-b2d3-81ad40719c28-kube-api-access-rnnmf\") pod \"kuadrant-operator-catalog-sgln5\" (UID: \"d8d85af6-7aaf-4de1-b2d3-81ad40719c28\") " pod="kuadrant-system/kuadrant-operator-catalog-sgln5"
Jul 23 10:00:31.134954 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.134917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnnmf\" (UniqueName: \"kubernetes.io/projected/d8d85af6-7aaf-4de1-b2d3-81ad40719c28-kube-api-access-rnnmf\") pod \"kuadrant-operator-catalog-sgln5\" (UID: \"d8d85af6-7aaf-4de1-b2d3-81ad40719c28\") " pod="kuadrant-system/kuadrant-operator-catalog-sgln5"
Jul 23 10:00:31.297778 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.297685    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgln5"
Jul 23 10:00:31.370230 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.370198    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgln5"]
Jul 23 10:00:31.446940 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.446913    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgln5"]
Jul 23 10:00:31.449426 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:00:31.449397    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d85af6_7aaf_4de1_b2d3_81ad40719c28.slice/crio-0b7ea201c312dea3b797d6336bc9d5fd70ab8ff5306ca1e433d99d7d7761339a WatchSource:0}: Error finding container 0b7ea201c312dea3b797d6336bc9d5fd70ab8ff5306ca1e433d99d7d7761339a: Status 404 returned error can't find the container with id 0b7ea201c312dea3b797d6336bc9d5fd70ab8ff5306ca1e433d99d7d7761339a
Jul 23 10:00:31.563138 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.563103    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t9wzx"]
Jul 23 10:00:31.567480 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.567463    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t9wzx"
Jul 23 10:00:31.573444 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.573420    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t9wzx"]
Jul 23 10:00:31.630895 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.630863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w4kc\" (UniqueName: \"kubernetes.io/projected/d9067278-bd37-44d4-95ee-d173d5a6432d-kube-api-access-4w4kc\") pod \"kuadrant-operator-catalog-t9wzx\" (UID: \"d9067278-bd37-44d4-95ee-d173d5a6432d\") " pod="kuadrant-system/kuadrant-operator-catalog-t9wzx"
Jul 23 10:00:31.732214 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.732125    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w4kc\" (UniqueName: \"kubernetes.io/projected/d9067278-bd37-44d4-95ee-d173d5a6432d-kube-api-access-4w4kc\") pod \"kuadrant-operator-catalog-t9wzx\" (UID: \"d9067278-bd37-44d4-95ee-d173d5a6432d\") " pod="kuadrant-system/kuadrant-operator-catalog-t9wzx"
Jul 23 10:00:31.740176 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.740154    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w4kc\" (UniqueName: \"kubernetes.io/projected/d9067278-bd37-44d4-95ee-d173d5a6432d-kube-api-access-4w4kc\") pod \"kuadrant-operator-catalog-t9wzx\" (UID: \"d9067278-bd37-44d4-95ee-d173d5a6432d\") " pod="kuadrant-system/kuadrant-operator-catalog-t9wzx"
Jul 23 10:00:31.878331 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:31.878230    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-t9wzx"
Jul 23 10:00:32.008864 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:32.008783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:00:32.024623 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:32.024403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-t9wzx"]
Jul 23 10:00:32.027044 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:00:32.027014    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9067278_bd37_44d4_95ee_d173d5a6432d.slice/crio-f36fc4cae2c239002d9cc52d1f97316cb222ccc264d10ad78094fc1822e740fa WatchSource:0}: Error finding container f36fc4cae2c239002d9cc52d1f97316cb222ccc264d10ad78094fc1822e740fa: Status 404 returned error can't find the container with id f36fc4cae2c239002d9cc52d1f97316cb222ccc264d10ad78094fc1822e740fa
Jul 23 10:00:32.110303 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:32.109481    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:00:32.147640 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:32.147601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgln5" event={"ID":"d8d85af6-7aaf-4de1-b2d3-81ad40719c28","Type":"ContainerStarted","Data":"0b7ea201c312dea3b797d6336bc9d5fd70ab8ff5306ca1e433d99d7d7761339a"}
Jul 23 10:00:32.148783 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:32.148751    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t9wzx" event={"ID":"d9067278-bd37-44d4-95ee-d173d5a6432d","Type":"ContainerStarted","Data":"f36fc4cae2c239002d9cc52d1f97316cb222ccc264d10ad78094fc1822e740fa"}
Jul 23 10:00:34.161967 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:34.161932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-t9wzx" event={"ID":"d9067278-bd37-44d4-95ee-d173d5a6432d","Type":"ContainerStarted","Data":"f4d3f47da875969db4aa0d4b2243da16e08c2372c3a1d2ff524079fac393d7b8"}
Jul 23 10:00:34.163357 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:34.163332    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgln5" event={"ID":"d8d85af6-7aaf-4de1-b2d3-81ad40719c28","Type":"ContainerStarted","Data":"edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002"}
Jul 23 10:00:34.163459 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:34.163425    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sgln5" podUID="d8d85af6-7aaf-4de1-b2d3-81ad40719c28" containerName="registry-server" containerID="cri-o://edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002" gracePeriod=2
Jul 23 10:00:34.178071 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:34.178029    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-t9wzx" podStartSLOduration=1.515422229 podStartE2EDuration="3.178013983s" totalImagesPullingTime="1.662591754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:00:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:00:34.176087969 +0000 UTC m=+354.079776243" watchObservedRunningTime="2026-07-23 10:00:34.178013983 +0000 UTC m=+354.081702257"
Jul 23 10:00:34.190201 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:34.190152    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sgln5" podStartSLOduration=1.9504652249999999 podStartE2EDuration="4.190136938s" totalImagesPullingTime="2.239671713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:00:34.189249103 +0000 UTC m=+354.092937379" watchObservedRunningTime="2026-07-23 10:00:34.190136938 +0000 UTC m=+354.093825233"
Jul 23 10:00:34.411027 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:34.411000    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgln5"
Jul 23 10:00:34.456140 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:34.456040    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnnmf\" (UniqueName: \"kubernetes.io/projected/d8d85af6-7aaf-4de1-b2d3-81ad40719c28-kube-api-access-rnnmf\") pod \"d8d85af6-7aaf-4de1-b2d3-81ad40719c28\" (UID: \"d8d85af6-7aaf-4de1-b2d3-81ad40719c28\") "
Jul 23 10:00:34.458414 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:34.458383    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d85af6-7aaf-4de1-b2d3-81ad40719c28-kube-api-access-rnnmf" (OuterVolumeSpecName: "kube-api-access-rnnmf") pod "d8d85af6-7aaf-4de1-b2d3-81ad40719c28" (UID: "d8d85af6-7aaf-4de1-b2d3-81ad40719c28"). InnerVolumeSpecName "kube-api-access-rnnmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:00:34.557344 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:34.557301    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnnmf\" (UniqueName: \"kubernetes.io/projected/d8d85af6-7aaf-4de1-b2d3-81ad40719c28-kube-api-access-rnnmf\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:00:35.168563 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:35.168523    2564 generic.go:356] "Generic (PLEG): container finished" podID="d8d85af6-7aaf-4de1-b2d3-81ad40719c28" containerID="edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002" exitCode=0
Jul 23 10:00:35.168563 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:35.168563    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sgln5"
Jul 23 10:00:35.169024 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:35.168608    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgln5" event={"ID":"d8d85af6-7aaf-4de1-b2d3-81ad40719c28","Type":"ContainerDied","Data":"edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002"}
Jul 23 10:00:35.169024 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:35.168653    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sgln5" event={"ID":"d8d85af6-7aaf-4de1-b2d3-81ad40719c28","Type":"ContainerDied","Data":"0b7ea201c312dea3b797d6336bc9d5fd70ab8ff5306ca1e433d99d7d7761339a"}
Jul 23 10:00:35.169024 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:35.168673    2564 scope.go:117] "RemoveContainer" containerID="edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002"
Jul 23 10:00:35.177697 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:35.177680    2564 scope.go:117] "RemoveContainer" containerID="edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002"
Jul 23 10:00:35.177933 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:00:35.177913    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002\": container with ID starting with edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002 not found: ID does not exist" containerID="edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002"
Jul 23 10:00:35.178013 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:35.177944    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002"} err="failed to get container status \"edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002\": rpc error: code = NotFound desc = could not find container \"edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002\": container with ID starting with edaa45b44a36e2e874fe39a57e2875e128d1eac6f3df48019370c402231ee002 not found: ID does not exist"
Jul 23 10:00:35.185121 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:35.185097    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgln5"]
Jul 23 10:00:35.187549 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:35.187524    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sgln5"]
Jul 23 10:00:36.609770 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:36.609741    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d85af6-7aaf-4de1-b2d3-81ad40719c28" path="/var/lib/kubelet/pods/d8d85af6-7aaf-4de1-b2d3-81ad40719c28/volumes"
Jul 23 10:00:41.878871 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:41.878838    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-t9wzx"
Jul 23 10:00:41.879322 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:41.878921    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-t9wzx"
Jul 23 10:00:41.901543 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:41.901506    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-t9wzx"
Jul 23 10:00:42.220339 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:42.220241    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-t9wzx"
Jul 23 10:00:59.119424 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:59.119386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:00:59.718844 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:00:59.718800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:03.179415 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.179381    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-27cxh"]
Jul 23 10:01:03.179819 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.179713    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d85af6-7aaf-4de1-b2d3-81ad40719c28" containerName="registry-server"
Jul 23 10:01:03.179819 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.179725    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d85af6-7aaf-4de1-b2d3-81ad40719c28" containerName="registry-server"
Jul 23 10:01:03.179819 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.179781    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d85af6-7aaf-4de1-b2d3-81ad40719c28" containerName="registry-server"
Jul 23 10:01:03.182967 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.182950    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27cxh"
Jul 23 10:01:03.186415 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.186392    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-njfjq\""
Jul 23 10:01:03.194599 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.194565    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-27cxh"]
Jul 23 10:01:03.311892 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.311856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwf6n\" (UniqueName: \"kubernetes.io/projected/236ab872-6cc0-441b-8e90-9347bb9a4361-kube-api-access-cwf6n\") pod \"authorino-operator-75cc8d5cb7-27cxh\" (UID: \"236ab872-6cc0-441b-8e90-9347bb9a4361\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-27cxh"
Jul 23 10:01:03.412852 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.412807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwf6n\" (UniqueName: \"kubernetes.io/projected/236ab872-6cc0-441b-8e90-9347bb9a4361-kube-api-access-cwf6n\") pod \"authorino-operator-75cc8d5cb7-27cxh\" (UID: \"236ab872-6cc0-441b-8e90-9347bb9a4361\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-27cxh"
Jul 23 10:01:03.423213 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.423178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwf6n\" (UniqueName: \"kubernetes.io/projected/236ab872-6cc0-441b-8e90-9347bb9a4361-kube-api-access-cwf6n\") pod \"authorino-operator-75cc8d5cb7-27cxh\" (UID: \"236ab872-6cc0-441b-8e90-9347bb9a4361\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-27cxh"
Jul 23 10:01:03.493529 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.493433    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27cxh"
Jul 23 10:01:03.654971 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:03.654935    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-27cxh"]
Jul 23 10:01:03.658295 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:01:03.658248    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236ab872_6cc0_441b_8e90_9347bb9a4361.slice/crio-6364e7aa94d0e6c8703aa69ad3958078f74e6542176bc7ab742c992a68d112e0 WatchSource:0}: Error finding container 6364e7aa94d0e6c8703aa69ad3958078f74e6542176bc7ab742c992a68d112e0: Status 404 returned error can't find the container with id 6364e7aa94d0e6c8703aa69ad3958078f74e6542176bc7ab742c992a68d112e0
Jul 23 10:01:04.288381 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:04.288336    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27cxh" event={"ID":"236ab872-6cc0-441b-8e90-9347bb9a4361","Type":"ContainerStarted","Data":"6364e7aa94d0e6c8703aa69ad3958078f74e6542176bc7ab742c992a68d112e0"}
Jul 23 10:01:04.529658 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:04.529620    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:06.455813 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.455780    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"]
Jul 23 10:01:06.460403 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.460379    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:06.464022 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.464003    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7cbbr\""
Jul 23 10:01:06.473886 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.473858    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"]
Jul 23 10:01:06.537926 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.537875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrhsw\" (UniqueName: \"kubernetes.io/projected/f4b9916e-172d-44bf-81d7-2a61fc385701-kube-api-access-nrhsw\") pod \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" (UID: \"f4b9916e-172d-44bf-81d7-2a61fc385701\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:06.638394 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.638354    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrhsw\" (UniqueName: \"kubernetes.io/projected/f4b9916e-172d-44bf-81d7-2a61fc385701-kube-api-access-nrhsw\") pod \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" (UID: \"f4b9916e-172d-44bf-81d7-2a61fc385701\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:06.662850 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.662805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:06.665226 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.665207    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrhsw\" (UniqueName: \"kubernetes.io/projected/f4b9916e-172d-44bf-81d7-2a61fc385701-kube-api-access-nrhsw\") pod \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" (UID: \"f4b9916e-172d-44bf-81d7-2a61fc385701\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:06.774640 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.774550    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:06.849275 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.849229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:06.910343 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:06.910320    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"]
Jul 23 10:01:06.912869 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:01:06.912839    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b9916e_172d_44bf_81d7_2a61fc385701.slice/crio-a91718c266de79052b6813865302ad37138d116678c0b233ab8a75476a8a2d26 WatchSource:0}: Error finding container a91718c266de79052b6813865302ad37138d116678c0b233ab8a75476a8a2d26: Status 404 returned error can't find the container with id a91718c266de79052b6813865302ad37138d116678c0b233ab8a75476a8a2d26
Jul 23 10:01:07.122751 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:07.122667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:07.305514 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:07.305471    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4" event={"ID":"f4b9916e-172d-44bf-81d7-2a61fc385701","Type":"ContainerStarted","Data":"a91718c266de79052b6813865302ad37138d116678c0b233ab8a75476a8a2d26"}
Jul 23 10:01:07.307020 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:07.306989    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27cxh" event={"ID":"236ab872-6cc0-441b-8e90-9347bb9a4361","Type":"ContainerStarted","Data":"2d8632f2c314bf8b642ba6d61f0c74bf52ad9888016eac14c93b8e56f3036656"}
Jul 23 10:01:07.307148 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:07.307115    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27cxh"
Jul 23 10:01:07.328612 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:07.328561    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27cxh" podStartSLOduration=1.563948764 podStartE2EDuration="4.328540287s" totalImagesPullingTime="2.764591523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:01:07.326233533 +0000 UTC m=+387.229921809" watchObservedRunningTime="2026-07-23 10:01:07.328540287 +0000 UTC m=+387.232228563"
Jul 23 10:01:09.024454 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:09.024425    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:09.317464 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:09.317366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4" event={"ID":"f4b9916e-172d-44bf-81d7-2a61fc385701","Type":"ContainerStarted","Data":"2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e"}
Jul 23 10:01:09.317641 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:09.317476    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:09.338245 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:09.338184    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4" podStartSLOduration=1.631392832 podStartE2EDuration="3.338168213s" totalImagesPullingTime="1.706775381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:01:09.336880984 +0000 UTC m=+389.240569267" watchObservedRunningTime="2026-07-23 10:01:09.338168213 +0000 UTC m=+389.241856487"
Jul 23 10:01:10.755764 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:10.755728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:11.141077 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.141046    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"]
Jul 23 10:01:11.143447 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.143430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:11.146118 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.146097    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7jndm\""
Jul 23 10:01:11.162278 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.162218    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"]
Jul 23 10:01:11.181463 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.181430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttvs5\" (UniqueName: \"kubernetes.io/projected/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-kube-api-access-ttvs5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" (UID: \"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:11.181632 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.181479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" (UID: \"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:11.282618 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.282584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" (UID: \"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:11.282800 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.282664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttvs5\" (UniqueName: \"kubernetes.io/projected/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-kube-api-access-ttvs5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" (UID: \"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:11.283060 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.283035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" (UID: \"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:11.291171 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.291141    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttvs5\" (UniqueName: \"kubernetes.io/projected/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-kube-api-access-ttvs5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" (UID: \"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:11.454365 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.454248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:11.593485 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:11.593460    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"]
Jul 23 10:01:11.595984 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:01:11.595958    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cf8b4e_df0d_49fa_b7f6_08a7b5559920.slice/crio-902114593d44de276214a355b057df414e763e71bab5cd0ad2ece886fd94341e WatchSource:0}: Error finding container 902114593d44de276214a355b057df414e763e71bab5cd0ad2ece886fd94341e: Status 404 returned error can't find the container with id 902114593d44de276214a355b057df414e763e71bab5cd0ad2ece886fd94341e
Jul 23 10:01:12.331973 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:12.331937    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj" event={"ID":"82cf8b4e-df0d-49fa-b7f6-08a7b5559920","Type":"ContainerStarted","Data":"902114593d44de276214a355b057df414e763e71bab5cd0ad2ece886fd94341e"}
Jul 23 10:01:12.333904 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:12.333877    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:13.949653 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:13.949618    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:14.316228 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:14.316145    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj"]
Jul 23 10:01:14.318983 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:14.318961    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj"
Jul 23 10:01:14.321565 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:14.321542    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 10:01:14.321690 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:14.321543    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zm7cn\""
Jul 23 10:01:14.329694 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:14.329644    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj"]
Jul 23 10:01:14.412067 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:14.412025    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf6ms\" (UniqueName: \"kubernetes.io/projected/420f30d0-7a30-4191-a4cf-d8271c303223-kube-api-access-jf6ms\") pod \"dns-operator-controller-manager-864dd78c4c-cqkpj\" (UID: \"420f30d0-7a30-4191-a4cf-d8271c303223\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj"
Jul 23 10:01:14.513003 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:14.512957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6ms\" (UniqueName: \"kubernetes.io/projected/420f30d0-7a30-4191-a4cf-d8271c303223-kube-api-access-jf6ms\") pod \"dns-operator-controller-manager-864dd78c4c-cqkpj\" (UID: \"420f30d0-7a30-4191-a4cf-d8271c303223\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj"
Jul 23 10:01:14.524797 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:14.524760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf6ms\" (UniqueName: \"kubernetes.io/projected/420f30d0-7a30-4191-a4cf-d8271c303223-kube-api-access-jf6ms\") pod \"dns-operator-controller-manager-864dd78c4c-cqkpj\" (UID: \"420f30d0-7a30-4191-a4cf-d8271c303223\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj"
Jul 23 10:01:14.631148 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:14.631117    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj"
Jul 23 10:01:14.772936 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:14.772913    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj"]
Jul 23 10:01:14.775218 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:01:14.775188    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420f30d0_7a30_4191_a4cf_d8271c303223.slice/crio-ad09d741bbf0a8c0cbcc0abedb8a382a6ad1a4d1af5e9568de61340e52a11d30 WatchSource:0}: Error finding container ad09d741bbf0a8c0cbcc0abedb8a382a6ad1a4d1af5e9568de61340e52a11d30: Status 404 returned error can't find the container with id ad09d741bbf0a8c0cbcc0abedb8a382a6ad1a4d1af5e9568de61340e52a11d30
Jul 23 10:01:15.349396 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:15.349355    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj" event={"ID":"420f30d0-7a30-4191-a4cf-d8271c303223","Type":"ContainerStarted","Data":"ad09d741bbf0a8c0cbcc0abedb8a382a6ad1a4d1af5e9568de61340e52a11d30"}
Jul 23 10:01:15.925298 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:15.925238    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:15.979560 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:15.979507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:16.324216 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:16.324076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:16.376966 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:16.376930    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:18.314430 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:18.314395    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-27cxh"
Jul 23 10:01:18.366125 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:18.366089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj" event={"ID":"82cf8b4e-df0d-49fa-b7f6-08a7b5559920","Type":"ContainerStarted","Data":"a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba"}
Jul 23 10:01:18.366321 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:18.366225    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:18.367902 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:18.367866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj" event={"ID":"420f30d0-7a30-4191-a4cf-d8271c303223","Type":"ContainerStarted","Data":"9108b283e9489350b9b36be253340148b1e18be6d97b949df8bcd6ab1350d2cf"}
Jul 23 10:01:18.368024 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:18.367989    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj"
Jul 23 10:01:18.394731 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:18.394685    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj" podStartSLOduration=1.254644134 podStartE2EDuration="7.394669919s" totalImagesPullingTime="6.140025785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:01:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:01:18.393304088 +0000 UTC m=+398.296992363" watchObservedRunningTime="2026-07-23 10:01:18.394669919 +0000 UTC m=+398.298358193"
Jul 23 10:01:18.404100 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:18.404074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:18.411269 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:18.411216    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj" podStartSLOduration=1.399689683 podStartE2EDuration="4.411201639s" totalImagesPullingTime="3.011511956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:01:18.409763119 +0000 UTC m=+398.313451387" watchObservedRunningTime="2026-07-23 10:01:18.411201639 +0000 UTC m=+398.314889913"
Jul 23 10:01:18.504531 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:18.504497    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:19.931051 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:19.931016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:20.088435 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:20.088386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:20.323767 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:20.323690    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:20.570964 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:20.570934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:20.823748 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:20.823716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:23.124297 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:23.124242    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:23.185643 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:23.185611    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:29.375426 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:29.375381    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cqkpj"
Jul 23 10:01:29.375825 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:29.375504    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:29.376898 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:29.376877    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:29.608018 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:29.607982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:29.711042 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:29.711003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:30.546365 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:30.546329    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"]
Jul 23 10:01:30.549855 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:30.549837    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:30.565418 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:30.565389    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"]
Jul 23 10:01:30.655172 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:30.655132    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"]
Jul 23 10:01:30.655504 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:30.655478    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-f7hh8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f" podUID="2dd58a69-864e-4247-bfa0-4032b8a56eff"
Jul 23 10:01:30.670289 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:30.670218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7hh8\" (UniqueName: \"kubernetes.io/projected/2dd58a69-864e-4247-bfa0-4032b8a56eff-kube-api-access-f7hh8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" (UID: \"2dd58a69-864e-4247-bfa0-4032b8a56eff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:30.670289 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:30.670286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd58a69-864e-4247-bfa0-4032b8a56eff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" (UID: \"2dd58a69-864e-4247-bfa0-4032b8a56eff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:30.770979 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:30.770936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7hh8\" (UniqueName: \"kubernetes.io/projected/2dd58a69-864e-4247-bfa0-4032b8a56eff-kube-api-access-f7hh8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" (UID: \"2dd58a69-864e-4247-bfa0-4032b8a56eff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:30.771161 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:30.770994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd58a69-864e-4247-bfa0-4032b8a56eff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" (UID: \"2dd58a69-864e-4247-bfa0-4032b8a56eff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:30.771518 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:30.771496    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd58a69-864e-4247-bfa0-4032b8a56eff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" (UID: \"2dd58a69-864e-4247-bfa0-4032b8a56eff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:30.782665 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:30.782643    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7hh8\" (UniqueName: \"kubernetes.io/projected/2dd58a69-864e-4247-bfa0-4032b8a56eff-kube-api-access-f7hh8\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" (UID: \"2dd58a69-864e-4247-bfa0-4032b8a56eff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:31.130735 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.130698    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"]
Jul 23 10:01:31.137964 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.137931    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"]
Jul 23 10:01:31.149846 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.149817    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"]
Jul 23 10:01:31.150060 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.150023    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" containerName="manager" containerID="cri-o://a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba" gracePeriod=2
Jul 23 10:01:31.168396 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.168369    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"]
Jul 23 10:01:31.179264 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.179193    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\": pods \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:31.182666 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.182621    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"]
Jul 23 10:01:31.183159 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.183136    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" containerName="manager"
Jul 23 10:01:31.183159 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.183156    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" containerName="manager"
Jul 23 10:01:31.183282 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.183231    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" containerName="manager"
Jul 23 10:01:31.186426 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.186394    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"]
Jul 23 10:01:31.186623 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.186595    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" containerName="manager" containerID="cri-o://2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e" gracePeriod=2
Jul 23 10:01:31.186717 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.186658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:31.188730 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.188708    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"]
Jul 23 10:01:31.189824 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.189798    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:31.192119 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.192086    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:31.201317 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.201292    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"]
Jul 23 10:01:31.210818 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.210789    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd"]
Jul 23 10:01:31.211570 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.211547    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" containerName="manager"
Jul 23 10:01:31.211570 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.211571    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" containerName="manager"
Jul 23 10:01:31.211710 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.211685    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" containerName="manager"
Jul 23 10:01:31.214914 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.214890    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd"
Jul 23 10:01:31.215598 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.215566    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:31.217799 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.217764    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:31.220037 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.220013    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:31.222512 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.222319    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:31.225841 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.225817    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd"]
Jul 23 10:01:31.275125 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.275094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxgds\" (UniqueName: \"kubernetes.io/projected/76c98beb-baa2-499e-931e-2709906b84aa-kube-api-access-qxgds\") pod \"kuadrant-operator-controller-manager-8684c9ff49-24ktl\" (UID: \"76c98beb-baa2-499e-931e-2709906b84aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:31.275125 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.275135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76c98beb-baa2-499e-931e-2709906b84aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-24ktl\" (UID: \"76c98beb-baa2-499e-931e-2709906b84aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:31.375926 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.375887    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsq9l\" (UniqueName: \"kubernetes.io/projected/95aaca2c-716b-43f7-bbd7-1df4c46ccda8-kube-api-access-lsq9l\") pod \"limitador-operator-controller-manager-859d7b78bd-dkrtd\" (UID: \"95aaca2c-716b-43f7-bbd7-1df4c46ccda8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd"
Jul 23 10:01:31.376099 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.376059    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxgds\" (UniqueName: \"kubernetes.io/projected/76c98beb-baa2-499e-931e-2709906b84aa-kube-api-access-qxgds\") pod \"kuadrant-operator-controller-manager-8684c9ff49-24ktl\" (UID: \"76c98beb-baa2-499e-931e-2709906b84aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:31.376162 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.376120    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76c98beb-baa2-499e-931e-2709906b84aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-24ktl\" (UID: \"76c98beb-baa2-499e-931e-2709906b84aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:31.376638 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.376613    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76c98beb-baa2-499e-931e-2709906b84aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-24ktl\" (UID: \"76c98beb-baa2-499e-931e-2709906b84aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:31.385914 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.385842    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxgds\" (UniqueName: \"kubernetes.io/projected/76c98beb-baa2-499e-931e-2709906b84aa-kube-api-access-qxgds\") pod \"kuadrant-operator-controller-manager-8684c9ff49-24ktl\" (UID: \"76c98beb-baa2-499e-931e-2709906b84aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:31.426812 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.426789    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:31.428473 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.428447    2564 generic.go:356] "Generic (PLEG): container finished" podID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" containerID="a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba" exitCode=0
Jul 23 10:01:31.428578 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.428489    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:31.428578 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.428540    2564 scope.go:117] "RemoveContainer" containerID="a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba"
Jul 23 10:01:31.429686 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.429660    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:31.429794 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.429777    2564 generic.go:356] "Generic (PLEG): container finished" podID="f4b9916e-172d-44bf-81d7-2a61fc385701" containerID="2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e" exitCode=0
Jul 23 10:01:31.429872 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.429861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:31.431514 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.431490    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:31.434082 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.434057    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:31.436409 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.436389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:31.436471 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.436416    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:31.437161 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.437147    2564 scope.go:117] "RemoveContainer" containerID="a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba"
Jul 23 10:01:31.437444 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.437424    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba\": container with ID starting with a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba not found: ID does not exist" containerID="a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba"
Jul 23 10:01:31.437501 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.437453    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba"} err="failed to get container status \"a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba\": rpc error: code = NotFound desc = could not find container \"a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba\": container with ID starting with a00af1eee6840cfaa9c379bfb371baacdb53b6d57e2472311047eb621511dfba not found: ID does not exist"
Jul 23 10:01:31.437501 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.437468    2564 scope.go:117] "RemoveContainer" containerID="2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e"
Jul 23 10:01:31.438744 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.438713    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:31.440839 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.440811    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="2dd58a69-864e-4247-bfa0-4032b8a56eff" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:31.442921 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.442901    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:31.444905 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.444881    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:31.445754 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.445738    2564 scope.go:117] "RemoveContainer" containerID="2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e"
Jul 23 10:01:31.446004 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.445988    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e\": container with ID starting with 2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e not found: ID does not exist" containerID="2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e"
Jul 23 10:01:31.446047 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.446012    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e"} err="failed to get container status \"2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e\": rpc error: code = NotFound desc = could not find container \"2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e\": container with ID starting with 2d3f3982f3069bd4a7170aa54fb19536efb4c97773a854cd459889985250142e not found: ID does not exist"
Jul 23 10:01:31.446948 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.446929    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="2dd58a69-864e-4247-bfa0-4032b8a56eff" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:31.477073 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.477028    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsq9l\" (UniqueName: \"kubernetes.io/projected/95aaca2c-716b-43f7-bbd7-1df4c46ccda8-kube-api-access-lsq9l\") pod \"limitador-operator-controller-manager-859d7b78bd-dkrtd\" (UID: \"95aaca2c-716b-43f7-bbd7-1df4c46ccda8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd"
Jul 23 10:01:31.488558 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.488526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsq9l\" (UniqueName: \"kubernetes.io/projected/95aaca2c-716b-43f7-bbd7-1df4c46ccda8-kube-api-access-lsq9l\") pod \"limitador-operator-controller-manager-859d7b78bd-dkrtd\" (UID: \"95aaca2c-716b-43f7-bbd7-1df4c46ccda8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd"
Jul 23 10:01:31.578486 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.578444    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrhsw\" (UniqueName: \"kubernetes.io/projected/f4b9916e-172d-44bf-81d7-2a61fc385701-kube-api-access-nrhsw\") pod \"f4b9916e-172d-44bf-81d7-2a61fc385701\" (UID: \"f4b9916e-172d-44bf-81d7-2a61fc385701\") "
Jul 23 10:01:31.578486 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.578497    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-extensions-socket-volume\") pod \"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\" (UID: \"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\") "
Jul 23 10:01:31.579040 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.578563    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttvs5\" (UniqueName: \"kubernetes.io/projected/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-kube-api-access-ttvs5\") pod \"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\" (UID: \"82cf8b4e-df0d-49fa-b7f6-08a7b5559920\") "
Jul 23 10:01:31.579040 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.578630    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7hh8\" (UniqueName: \"kubernetes.io/projected/2dd58a69-864e-4247-bfa0-4032b8a56eff-kube-api-access-f7hh8\") pod \"2dd58a69-864e-4247-bfa0-4032b8a56eff\" (UID: \"2dd58a69-864e-4247-bfa0-4032b8a56eff\") "
Jul 23 10:01:31.579040 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.578674    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd58a69-864e-4247-bfa0-4032b8a56eff-extensions-socket-volume\") pod \"2dd58a69-864e-4247-bfa0-4032b8a56eff\" (UID: \"2dd58a69-864e-4247-bfa0-4032b8a56eff\") "
Jul 23 10:01:31.579040 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.578991    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dd58a69-864e-4247-bfa0-4032b8a56eff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2dd58a69-864e-4247-bfa0-4032b8a56eff" (UID: "2dd58a69-864e-4247-bfa0-4032b8a56eff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:01:31.579040 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.579020    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "82cf8b4e-df0d-49fa-b7f6-08a7b5559920" (UID: "82cf8b4e-df0d-49fa-b7f6-08a7b5559920"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:01:31.580825 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.580804    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dd58a69-864e-4247-bfa0-4032b8a56eff-kube-api-access-f7hh8" (OuterVolumeSpecName: "kube-api-access-f7hh8") pod "2dd58a69-864e-4247-bfa0-4032b8a56eff" (UID: "2dd58a69-864e-4247-bfa0-4032b8a56eff"). InnerVolumeSpecName "kube-api-access-f7hh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:01:31.580910 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.580820    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-kube-api-access-ttvs5" (OuterVolumeSpecName: "kube-api-access-ttvs5") pod "82cf8b4e-df0d-49fa-b7f6-08a7b5559920" (UID: "82cf8b4e-df0d-49fa-b7f6-08a7b5559920"). InnerVolumeSpecName "kube-api-access-ttvs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:01:31.580910 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.580820    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4b9916e-172d-44bf-81d7-2a61fc385701-kube-api-access-nrhsw" (OuterVolumeSpecName: "kube-api-access-nrhsw") pod "f4b9916e-172d-44bf-81d7-2a61fc385701" (UID: "f4b9916e-172d-44bf-81d7-2a61fc385701"). InnerVolumeSpecName "kube-api-access-nrhsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:01:31.587974 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.587955    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:31.594154 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.594137    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd"
Jul 23 10:01:31.680120 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.680013    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrhsw\" (UniqueName: \"kubernetes.io/projected/f4b9916e-172d-44bf-81d7-2a61fc385701-kube-api-access-nrhsw\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:01:31.680120 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.680047    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-extensions-socket-volume\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:01:31.680120 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.680064    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttvs5\" (UniqueName: \"kubernetes.io/projected/82cf8b4e-df0d-49fa-b7f6-08a7b5559920-kube-api-access-ttvs5\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:01:31.680120 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.680085    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7hh8\" (UniqueName: \"kubernetes.io/projected/2dd58a69-864e-4247-bfa0-4032b8a56eff-kube-api-access-f7hh8\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:01:31.680120 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.680098    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd58a69-864e-4247-bfa0-4032b8a56eff-extensions-socket-volume\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:01:31.738639 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.738558    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"]
Jul 23 10:01:31.740756 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.740728    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="2dd58a69-864e-4247-bfa0-4032b8a56eff" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:31.740964 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:01:31.740940    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c98beb_baa2_499e_931e_2709906b84aa.slice/crio-67b419c9fd9e8ee1d6057f358d0f54beea5382fda1d2fc5ec8dbd008dde0734e WatchSource:0}: Error finding container 67b419c9fd9e8ee1d6057f358d0f54beea5382fda1d2fc5ec8dbd008dde0734e: Status 404 returned error can't find the container with id 67b419c9fd9e8ee1d6057f358d0f54beea5382fda1d2fc5ec8dbd008dde0734e
Jul 23 10:01:31.742814 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.742790    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:31.744886 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:31.744866    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:31.760412 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:31.760361    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd"]
Jul 23 10:01:31.762406 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:01:31.762382    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95aaca2c_716b_43f7_bbd7_1df4c46ccda8.slice/crio-5a6aa52cc6004043ee31d8c62043e95b93e85b857d4b1ca05074b0b8fb5181b2 WatchSource:0}: Error finding container 5a6aa52cc6004043ee31d8c62043e95b93e85b857d4b1ca05074b0b8fb5181b2: Status 404 returned error can't find the container with id 5a6aa52cc6004043ee31d8c62043e95b93e85b857d4b1ca05074b0b8fb5181b2
Jul 23 10:01:32.437988 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.437948    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl" event={"ID":"76c98beb-baa2-499e-931e-2709906b84aa","Type":"ContainerStarted","Data":"644e0ee8665326ae59c8f18f10d14709cca1bf8be4f6aae66e4eb77285e16416"}
Jul 23 10:01:32.438193 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.438099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:32.438193 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.438135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl" event={"ID":"76c98beb-baa2-499e-931e-2709906b84aa","Type":"ContainerStarted","Data":"67b419c9fd9e8ee1d6057f358d0f54beea5382fda1d2fc5ec8dbd008dde0734e"}
Jul 23 10:01:32.438944 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.438925    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:32.440651 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.440630    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd" event={"ID":"95aaca2c-716b-43f7-bbd7-1df4c46ccda8","Type":"ContainerStarted","Data":"29041de1edcc5b3b70a4a66bdf0b5c29b57334764c5b65228d32d32bb0152973"}
Jul 23 10:01:32.440651 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.440640    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:32.440804 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.440667    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd" event={"ID":"95aaca2c-716b-43f7-bbd7-1df4c46ccda8","Type":"ContainerStarted","Data":"5a6aa52cc6004043ee31d8c62043e95b93e85b857d4b1ca05074b0b8fb5181b2"}
Jul 23 10:01:32.440804 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.440753    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd"
Jul 23 10:01:32.461966 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.461904    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl" podStartSLOduration=1.461883139 podStartE2EDuration="1.461883139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:01:32.460620668 +0000 UTC m=+412.364308943" watchObservedRunningTime="2026-07-23 10:01:32.461883139 +0000 UTC m=+412.365571414"
Jul 23 10:01:32.463321 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:32.463295    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="2dd58a69-864e-4247-bfa0-4032b8a56eff" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:32.465627 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:32.465604    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:32.467754 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:32.467728    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:32.491289 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.491227    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd" podStartSLOduration=1.4912109789999999 podStartE2EDuration="1.491210979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:01:32.490773683 +0000 UTC m=+412.394461957" watchObservedRunningTime="2026-07-23 10:01:32.491210979 +0000 UTC m=+412.394899256"
Jul 23 10:01:32.493030 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:32.493007    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-xfg9f\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="2dd58a69-864e-4247-bfa0-4032b8a56eff" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-xfg9f"
Jul 23 10:01:32.495182 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:32.495151    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jjfd4\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jjfd4"
Jul 23 10:01:32.497361 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:01:32.497338    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-r5dtj\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-r5dtj"
Jul 23 10:01:32.610433 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.610391    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dd58a69-864e-4247-bfa0-4032b8a56eff" path="/var/lib/kubelet/pods/2dd58a69-864e-4247-bfa0-4032b8a56eff/volumes"
Jul 23 10:01:32.610931 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.610759    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82cf8b4e-df0d-49fa-b7f6-08a7b5559920" path="/var/lib/kubelet/pods/82cf8b4e-df0d-49fa-b7f6-08a7b5559920/volumes"
Jul 23 10:01:32.611153 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:32.611133    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4b9916e-172d-44bf-81d7-2a61fc385701" path="/var/lib/kubelet/pods/f4b9916e-172d-44bf-81d7-2a61fc385701/volumes"
Jul 23 10:01:35.290959 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:35.290929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:35.342582 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:35.342551    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:35.891494 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:35.891459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:35.951037 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:35.951009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:39.292321 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:39.292284    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:39.393396 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:39.393358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:42.893301 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:42.893268    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:42.994991 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:42.994959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:43.447601 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:43.447559    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-dkrtd"
Jul 23 10:01:43.447781 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:43.447637    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:50.897338 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:50.897298    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:50.993590 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:50.993554    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:01:59.396280 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.396229    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"]
Jul 23 10:01:59.396751 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.396457    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl" podUID="76c98beb-baa2-499e-931e-2709906b84aa" containerName="manager" containerID="cri-o://644e0ee8665326ae59c8f18f10d14709cca1bf8be4f6aae66e4eb77285e16416" gracePeriod=10
Jul 23 10:01:59.562897 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.562866    2564 generic.go:356] "Generic (PLEG): container finished" podID="76c98beb-baa2-499e-931e-2709906b84aa" containerID="644e0ee8665326ae59c8f18f10d14709cca1bf8be4f6aae66e4eb77285e16416" exitCode=0
Jul 23 10:01:59.563077 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.562934    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl" event={"ID":"76c98beb-baa2-499e-931e-2709906b84aa","Type":"ContainerDied","Data":"644e0ee8665326ae59c8f18f10d14709cca1bf8be4f6aae66e4eb77285e16416"}
Jul 23 10:01:59.622398 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.622365    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"]
Jul 23 10:01:59.625236 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.625218    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:01:59.645199 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.645167    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"]
Jul 23 10:01:59.657014 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.656924    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:01:59.718399 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.718360    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxgds\" (UniqueName: \"kubernetes.io/projected/76c98beb-baa2-499e-931e-2709906b84aa-kube-api-access-qxgds\") pod \"76c98beb-baa2-499e-931e-2709906b84aa\" (UID: \"76c98beb-baa2-499e-931e-2709906b84aa\") "
Jul 23 10:01:59.718572 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.718417    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76c98beb-baa2-499e-931e-2709906b84aa-extensions-socket-volume\") pod \"76c98beb-baa2-499e-931e-2709906b84aa\" (UID: \"76c98beb-baa2-499e-931e-2709906b84aa\") "
Jul 23 10:01:59.718623 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.718572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/189ab051-bd3c-427c-b3ba-d6761d7753f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2jchw\" (UID: \"189ab051-bd3c-427c-b3ba-d6761d7753f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:01:59.718623 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.718612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxmhc\" (UniqueName: \"kubernetes.io/projected/189ab051-bd3c-427c-b3ba-d6761d7753f8-kube-api-access-gxmhc\") pod \"kuadrant-operator-controller-manager-86878c769f-2jchw\" (UID: \"189ab051-bd3c-427c-b3ba-d6761d7753f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:01:59.718899 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.718872    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76c98beb-baa2-499e-931e-2709906b84aa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "76c98beb-baa2-499e-931e-2709906b84aa" (UID: "76c98beb-baa2-499e-931e-2709906b84aa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:01:59.720669 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.720645    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c98beb-baa2-499e-931e-2709906b84aa-kube-api-access-qxgds" (OuterVolumeSpecName: "kube-api-access-qxgds") pod "76c98beb-baa2-499e-931e-2709906b84aa" (UID: "76c98beb-baa2-499e-931e-2709906b84aa"). InnerVolumeSpecName "kube-api-access-qxgds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:01:59.819585 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.819543    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/189ab051-bd3c-427c-b3ba-d6761d7753f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2jchw\" (UID: \"189ab051-bd3c-427c-b3ba-d6761d7753f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:01:59.819585 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.819588    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxmhc\" (UniqueName: \"kubernetes.io/projected/189ab051-bd3c-427c-b3ba-d6761d7753f8-kube-api-access-gxmhc\") pod \"kuadrant-operator-controller-manager-86878c769f-2jchw\" (UID: \"189ab051-bd3c-427c-b3ba-d6761d7753f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:01:59.819785 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.819656    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxgds\" (UniqueName: \"kubernetes.io/projected/76c98beb-baa2-499e-931e-2709906b84aa-kube-api-access-qxgds\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:01:59.819785 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.819667    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76c98beb-baa2-499e-931e-2709906b84aa-extensions-socket-volume\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:01:59.819969 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.819944    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/189ab051-bd3c-427c-b3ba-d6761d7753f8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2jchw\" (UID: \"189ab051-bd3c-427c-b3ba-d6761d7753f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:01:59.848046 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.848019    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxmhc\" (UniqueName: \"kubernetes.io/projected/189ab051-bd3c-427c-b3ba-d6761d7753f8-kube-api-access-gxmhc\") pod \"kuadrant-operator-controller-manager-86878c769f-2jchw\" (UID: \"189ab051-bd3c-427c-b3ba-d6761d7753f8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:01:59.936144 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:01:59.936050    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:02:00.078327 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:00.078303    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"]
Jul 23 10:02:00.081041 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:02:00.081013    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod189ab051_bd3c_427c_b3ba_d6761d7753f8.slice/crio-c89a92eb4d3bc5bb274c33314fee33a0bda5e8faeb0c5816c5c2179f6425964b WatchSource:0}: Error finding container c89a92eb4d3bc5bb274c33314fee33a0bda5e8faeb0c5816c5c2179f6425964b: Status 404 returned error can't find the container with id c89a92eb4d3bc5bb274c33314fee33a0bda5e8faeb0c5816c5c2179f6425964b
Jul 23 10:02:00.570218 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:00.570167    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw" event={"ID":"189ab051-bd3c-427c-b3ba-d6761d7753f8","Type":"ContainerStarted","Data":"ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a"}
Jul 23 10:02:00.570697 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:00.570268    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:02:00.570697 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:00.570297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw" event={"ID":"189ab051-bd3c-427c-b3ba-d6761d7753f8","Type":"ContainerStarted","Data":"c89a92eb4d3bc5bb274c33314fee33a0bda5e8faeb0c5816c5c2179f6425964b"}
Jul 23 10:02:00.571564 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:00.571539    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl" event={"ID":"76c98beb-baa2-499e-931e-2709906b84aa","Type":"ContainerDied","Data":"67b419c9fd9e8ee1d6057f358d0f54beea5382fda1d2fc5ec8dbd008dde0734e"}
Jul 23 10:02:00.571707 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:00.571564    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"
Jul 23 10:02:00.571707 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:00.571585    2564 scope.go:117] "RemoveContainer" containerID="644e0ee8665326ae59c8f18f10d14709cca1bf8be4f6aae66e4eb77285e16416"
Jul 23 10:02:00.596180 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:00.596129    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw" podStartSLOduration=1.596110439 podStartE2EDuration="1.596110439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:01:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:02:00.592955626 +0000 UTC m=+440.496643900" watchObservedRunningTime="2026-07-23 10:02:00.596110439 +0000 UTC m=+440.499798712"
Jul 23 10:02:00.614457 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:00.614419    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"]
Jul 23 10:02:00.618496 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:00.618468    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-24ktl"]
Jul 23 10:02:02.610355 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:02.610247    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76c98beb-baa2-499e-931e-2709906b84aa" path="/var/lib/kubelet/pods/76c98beb-baa2-499e-931e-2709906b84aa/volumes"
Jul 23 10:02:11.579795 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:11.579758    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:02:15.813585 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:15.813544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:16.157420 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:16.157377    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:17.540462 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.540429    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jszx7"]
Jul 23 10:02:17.540832 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.540803    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c98beb-baa2-499e-931e-2709906b84aa" containerName="manager"
Jul 23 10:02:17.540832 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.540814    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c98beb-baa2-499e-931e-2709906b84aa" containerName="manager"
Jul 23 10:02:17.540900 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.540869    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="76c98beb-baa2-499e-931e-2709906b84aa" containerName="manager"
Jul 23 10:02:17.543172 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.543147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:17.546213 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.546121    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8gbj9\""
Jul 23 10:02:17.546213 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.546138    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 10:02:17.551891 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.551858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:17.553532 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.553511    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jszx7"]
Jul 23 10:02:17.637047 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.637008    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jszx7"]
Jul 23 10:02:17.661623 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.661587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:17.671950 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.671919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7e75d894-ddaf-4a96-bce4-8032a895eb01-config-file\") pod \"limitador-limitador-64c94fd64f-jszx7\" (UID: \"7e75d894-ddaf-4a96-bce4-8032a895eb01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:17.672091 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.672043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x8pd\" (UniqueName: \"kubernetes.io/projected/7e75d894-ddaf-4a96-bce4-8032a895eb01-kube-api-access-2x8pd\") pod \"limitador-limitador-64c94fd64f-jszx7\" (UID: \"7e75d894-ddaf-4a96-bce4-8032a895eb01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:17.721142 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.721105    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:17.772993 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.772957    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7e75d894-ddaf-4a96-bce4-8032a895eb01-config-file\") pod \"limitador-limitador-64c94fd64f-jszx7\" (UID: \"7e75d894-ddaf-4a96-bce4-8032a895eb01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:17.773182 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.773003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x8pd\" (UniqueName: \"kubernetes.io/projected/7e75d894-ddaf-4a96-bce4-8032a895eb01-kube-api-access-2x8pd\") pod \"limitador-limitador-64c94fd64f-jszx7\" (UID: \"7e75d894-ddaf-4a96-bce4-8032a895eb01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:17.773616 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.773594    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7e75d894-ddaf-4a96-bce4-8032a895eb01-config-file\") pod \"limitador-limitador-64c94fd64f-jszx7\" (UID: \"7e75d894-ddaf-4a96-bce4-8032a895eb01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:17.781148 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.781119    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x8pd\" (UniqueName: \"kubernetes.io/projected/7e75d894-ddaf-4a96-bce4-8032a895eb01-kube-api-access-2x8pd\") pod \"limitador-limitador-64c94fd64f-jszx7\" (UID: \"7e75d894-ddaf-4a96-bce4-8032a895eb01\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:17.855134 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.855046    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:17.996081 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:17.996053    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jszx7"]
Jul 23 10:02:17.998589 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:02:17.998556    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e75d894_ddaf_4a96_bce4_8032a895eb01.slice/crio-0df745f9f95a90c94621a29bb9a1307ab8d3b0e710c4483e86a2b91c8fb26557 WatchSource:0}: Error finding container 0df745f9f95a90c94621a29bb9a1307ab8d3b0e710c4483e86a2b91c8fb26557: Status 404 returned error can't find the container with id 0df745f9f95a90c94621a29bb9a1307ab8d3b0e710c4483e86a2b91c8fb26557
Jul 23 10:02:18.360508 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.360480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:18.417218 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.417184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:18.502537 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.502503    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-fcwh6"]
Jul 23 10:02:18.505415 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.505396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fcwh6"
Jul 23 10:02:18.507925 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.507900    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f6qjl\""
Jul 23 10:02:18.517012 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.516986    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fcwh6"]
Jul 23 10:02:18.580792 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.580758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdbdp\" (UniqueName: \"kubernetes.io/projected/b512f1d4-1161-4bd0-80b9-d205cc2d3ec2-kube-api-access-zdbdp\") pod \"authorino-75d556bd77-fcwh6\" (UID: \"b512f1d4-1161-4bd0-80b9-d205cc2d3ec2\") " pod="kuadrant-system/authorino-75d556bd77-fcwh6"
Jul 23 10:02:18.660921 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.660887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7" event={"ID":"7e75d894-ddaf-4a96-bce4-8032a895eb01","Type":"ContainerStarted","Data":"0df745f9f95a90c94621a29bb9a1307ab8d3b0e710c4483e86a2b91c8fb26557"}
Jul 23 10:02:18.681209 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.681177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbdp\" (UniqueName: \"kubernetes.io/projected/b512f1d4-1161-4bd0-80b9-d205cc2d3ec2-kube-api-access-zdbdp\") pod \"authorino-75d556bd77-fcwh6\" (UID: \"b512f1d4-1161-4bd0-80b9-d205cc2d3ec2\") " pod="kuadrant-system/authorino-75d556bd77-fcwh6"
Jul 23 10:02:18.689339 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.689310    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdbdp\" (UniqueName: \"kubernetes.io/projected/b512f1d4-1161-4bd0-80b9-d205cc2d3ec2-kube-api-access-zdbdp\") pod \"authorino-75d556bd77-fcwh6\" (UID: \"b512f1d4-1161-4bd0-80b9-d205cc2d3ec2\") " pod="kuadrant-system/authorino-75d556bd77-fcwh6"
Jul 23 10:02:18.814851 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.814813    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fcwh6"
Jul 23 10:02:18.976093 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:18.976003    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fcwh6"]
Jul 23 10:02:18.979667 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:02:18.979632    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb512f1d4_1161_4bd0_80b9_d205cc2d3ec2.slice/crio-fbeab8a92e9baf2f7c6f072fd92a020b2e05d4054a9a9422302223f96a37523b WatchSource:0}: Error finding container fbeab8a92e9baf2f7c6f072fd92a020b2e05d4054a9a9422302223f96a37523b: Status 404 returned error can't find the container with id fbeab8a92e9baf2f7c6f072fd92a020b2e05d4054a9a9422302223f96a37523b
Jul 23 10:02:19.670808 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:19.670710    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fcwh6" event={"ID":"b512f1d4-1161-4bd0-80b9-d205cc2d3ec2","Type":"ContainerStarted","Data":"fbeab8a92e9baf2f7c6f072fd92a020b2e05d4054a9a9422302223f96a37523b"}
Jul 23 10:02:23.693240 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:23.693074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7" event={"ID":"7e75d894-ddaf-4a96-bce4-8032a895eb01","Type":"ContainerStarted","Data":"902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce"}
Jul 23 10:02:23.693767 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:23.693341    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:23.695464 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:23.695438    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fcwh6" event={"ID":"b512f1d4-1161-4bd0-80b9-d205cc2d3ec2","Type":"ContainerStarted","Data":"49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d"}
Jul 23 10:02:23.710222 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:23.710173    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7" podStartSLOduration=1.8620744980000001 podStartE2EDuration="6.710156728s" totalImagesPullingTime="4.84808223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:02:23.708124995 +0000 UTC m=+463.611813269" watchObservedRunningTime="2026-07-23 10:02:23.710156728 +0000 UTC m=+463.613845020"
Jul 23 10:02:23.722102 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:23.722050    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-fcwh6" podStartSLOduration=1.85457611 podStartE2EDuration="5.722035757s" totalImagesPullingTime="3.867459647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:02:23.721141501 +0000 UTC m=+463.624829766" watchObservedRunningTime="2026-07-23 10:02:23.722035757 +0000 UTC m=+463.625724030"
Jul 23 10:02:34.701906 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:34.701877    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:35.586310 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:35.586247    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jszx7"]
Jul 23 10:02:35.586517 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:35.586496    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7" podUID="7e75d894-ddaf-4a96-bce4-8032a895eb01" containerName="limitador" containerID="cri-o://902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce" gracePeriod=30
Jul 23 10:02:36.137010 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.136979    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:36.235560 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.235459    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7e75d894-ddaf-4a96-bce4-8032a895eb01-config-file\") pod \"7e75d894-ddaf-4a96-bce4-8032a895eb01\" (UID: \"7e75d894-ddaf-4a96-bce4-8032a895eb01\") "
Jul 23 10:02:36.235560 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.235503    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x8pd\" (UniqueName: \"kubernetes.io/projected/7e75d894-ddaf-4a96-bce4-8032a895eb01-kube-api-access-2x8pd\") pod \"7e75d894-ddaf-4a96-bce4-8032a895eb01\" (UID: \"7e75d894-ddaf-4a96-bce4-8032a895eb01\") "
Jul 23 10:02:36.235805 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.235784    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e75d894-ddaf-4a96-bce4-8032a895eb01-config-file" (OuterVolumeSpecName: "config-file") pod "7e75d894-ddaf-4a96-bce4-8032a895eb01" (UID: "7e75d894-ddaf-4a96-bce4-8032a895eb01"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:02:36.237736 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.237702    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e75d894-ddaf-4a96-bce4-8032a895eb01-kube-api-access-2x8pd" (OuterVolumeSpecName: "kube-api-access-2x8pd") pod "7e75d894-ddaf-4a96-bce4-8032a895eb01" (UID: "7e75d894-ddaf-4a96-bce4-8032a895eb01"). InnerVolumeSpecName "kube-api-access-2x8pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:02:36.336203 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.336157    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7e75d894-ddaf-4a96-bce4-8032a895eb01-config-file\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:02:36.336203 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.336196    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x8pd\" (UniqueName: \"kubernetes.io/projected/7e75d894-ddaf-4a96-bce4-8032a895eb01-kube-api-access-2x8pd\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:02:36.766091 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.766046    2564 generic.go:356] "Generic (PLEG): container finished" podID="7e75d894-ddaf-4a96-bce4-8032a895eb01" containerID="902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce" exitCode=0
Jul 23 10:02:36.766288 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.766109    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7" event={"ID":"7e75d894-ddaf-4a96-bce4-8032a895eb01","Type":"ContainerDied","Data":"902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce"}
Jul 23 10:02:36.766288 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.766155    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7"
Jul 23 10:02:36.766288 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.766165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jszx7" event={"ID":"7e75d894-ddaf-4a96-bce4-8032a895eb01","Type":"ContainerDied","Data":"0df745f9f95a90c94621a29bb9a1307ab8d3b0e710c4483e86a2b91c8fb26557"}
Jul 23 10:02:36.766288 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.766199    2564 scope.go:117] "RemoveContainer" containerID="902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce"
Jul 23 10:02:36.775647 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.775625    2564 scope.go:117] "RemoveContainer" containerID="902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce"
Jul 23 10:02:36.776023 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:02:36.776002    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce\": container with ID starting with 902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce not found: ID does not exist" containerID="902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce"
Jul 23 10:02:36.776082 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.776033    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce"} err="failed to get container status \"902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce\": rpc error: code = NotFound desc = could not find container \"902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce\": container with ID starting with 902e426d0fbce42e9170f12c5dd057c7aad312d698dc22ad71b8a87dc1f283ce not found: ID does not exist"
Jul 23 10:02:36.785158 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.785111    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jszx7"]
Jul 23 10:02:36.786689 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.786668    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jszx7"]
Jul 23 10:02:36.926734 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:36.926698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:38.609809 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:38.609772    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e75d894-ddaf-4a96-bce4-8032a895eb01" path="/var/lib/kubelet/pods/7e75d894-ddaf-4a96-bce4-8032a895eb01/volumes"
Jul 23 10:02:38.881833 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:38.881804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:39.000244 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.000210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:39.354824 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.354738    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"]
Jul 23 10:02:39.355170 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.355152    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e75d894-ddaf-4a96-bce4-8032a895eb01" containerName="limitador"
Jul 23 10:02:39.355278 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.355175    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e75d894-ddaf-4a96-bce4-8032a895eb01" containerName="limitador"
Jul 23 10:02:39.355331 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.355304    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e75d894-ddaf-4a96-bce4-8032a895eb01" containerName="limitador"
Jul 23 10:02:39.358101 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.358079    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"
Jul 23 10:02:39.360883 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.360810    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7mssd\""
Jul 23 10:02:39.360883 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.360871    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 10:02:39.361929 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.361907    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 10:02:39.362051 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.361928    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 10:02:39.366536 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.366507    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"]
Jul 23 10:02:39.384705 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.384673    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:39.463300 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.463230    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg7pf\" (UniqueName: \"kubernetes.io/projected/0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a-kube-api-access-wg7pf\") pod \"postgres-69fb4594cf-t7v89\" (UID: \"0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"
Jul 23 10:02:39.463502 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.463376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a-data\") pod \"postgres-69fb4594cf-t7v89\" (UID: \"0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"
Jul 23 10:02:39.563999 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.563959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a-data\") pod \"postgres-69fb4594cf-t7v89\" (UID: \"0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"
Jul 23 10:02:39.564210 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.564022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg7pf\" (UniqueName: \"kubernetes.io/projected/0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a-kube-api-access-wg7pf\") pod \"postgres-69fb4594cf-t7v89\" (UID: \"0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"
Jul 23 10:02:39.564458 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.564434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a-data\") pod \"postgres-69fb4594cf-t7v89\" (UID: \"0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"
Jul 23 10:02:39.572958 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.572928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg7pf\" (UniqueName: \"kubernetes.io/projected/0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a-kube-api-access-wg7pf\") pod \"postgres-69fb4594cf-t7v89\" (UID: \"0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"
Jul 23 10:02:39.670524 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.670494    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"
Jul 23 10:02:39.814806 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:39.814776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"]
Jul 23 10:02:39.817552 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:02:39.817523    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad8f4cb_9a01_4db9_8a0f_ee80e1fb1c5a.slice/crio-e7c935c1c06f3eb1e846db3e772bb070e9084b3f383204a741ddc6b5a9e4e664 WatchSource:0}: Error finding container e7c935c1c06f3eb1e846db3e772bb070e9084b3f383204a741ddc6b5a9e4e664: Status 404 returned error can't find the container with id e7c935c1c06f3eb1e846db3e772bb070e9084b3f383204a741ddc6b5a9e4e664
Jul 23 10:02:40.793723 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:40.793633    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89" event={"ID":"0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a","Type":"ContainerStarted","Data":"e7c935c1c06f3eb1e846db3e772bb070e9084b3f383204a741ddc6b5a9e4e664"}
Jul 23 10:02:44.632960 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:44.632936    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 10:02:44.815529 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:44.815492    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89" event={"ID":"0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a","Type":"ContainerStarted","Data":"9cc955239915342a29952731bb48d7c1d8241c02f5a15aa752440a6f64bc0437"}
Jul 23 10:02:44.815701 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:44.815569    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"
Jul 23 10:02:44.831745 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:44.831677    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89" podStartSLOduration=1.020397294 podStartE2EDuration="5.831660596s" totalImagesPullingTime="4.811263302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:02:44.831422018 +0000 UTC m=+484.735110292" watchObservedRunningTime="2026-07-23 10:02:44.831660596 +0000 UTC m=+484.735348869"
Jul 23 10:02:50.852191 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:50.852153    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t7v89"
Jul 23 10:02:51.168062 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.168026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:51.355893 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.355854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:51.672644 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.672605    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6887794b84-bwwvz"]
Jul 23 10:02:51.833581 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.833532    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6887794b84-bwwvz"]
Jul 23 10:02:51.833581 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.833582    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6887794b84-bwwvz"]
Jul 23 10:02:51.833847 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.833601    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-647997d7b4-c9zx8"]
Jul 23 10:02:51.833847 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.833742    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6887794b84-bwwvz"
Jul 23 10:02:51.849775 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.849735    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6887794b84-bwwvz"
Jul 23 10:02:51.849775 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.849755    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-647997d7b4-c9zx8"]
Jul 23 10:02:51.850014 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.849845    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647997d7b4-c9zx8"
Jul 23 10:02:51.852394 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.852373    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 10:02:51.879003 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.878965    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skbk7\" (UniqueName: \"kubernetes.io/projected/32fd7e4e-8704-4288-bd75-998bef7491e8-kube-api-access-skbk7\") pod \"authorino-647997d7b4-c9zx8\" (UID: \"32fd7e4e-8704-4288-bd75-998bef7491e8\") " pod="kuadrant-system/authorino-647997d7b4-c9zx8"
Jul 23 10:02:51.879168 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.879106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32fd7e4e-8704-4288-bd75-998bef7491e8-tls-cert\") pod \"authorino-647997d7b4-c9zx8\" (UID: \"32fd7e4e-8704-4288-bd75-998bef7491e8\") " pod="kuadrant-system/authorino-647997d7b4-c9zx8"
Jul 23 10:02:51.980662 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.980566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skbk7\" (UniqueName: \"kubernetes.io/projected/32fd7e4e-8704-4288-bd75-998bef7491e8-kube-api-access-skbk7\") pod \"authorino-647997d7b4-c9zx8\" (UID: \"32fd7e4e-8704-4288-bd75-998bef7491e8\") " pod="kuadrant-system/authorino-647997d7b4-c9zx8"
Jul 23 10:02:51.980662 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.980633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32fd7e4e-8704-4288-bd75-998bef7491e8-tls-cert\") pod \"authorino-647997d7b4-c9zx8\" (UID: \"32fd7e4e-8704-4288-bd75-998bef7491e8\") " pod="kuadrant-system/authorino-647997d7b4-c9zx8"
Jul 23 10:02:51.983146 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.983122    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32fd7e4e-8704-4288-bd75-998bef7491e8-tls-cert\") pod \"authorino-647997d7b4-c9zx8\" (UID: \"32fd7e4e-8704-4288-bd75-998bef7491e8\") " pod="kuadrant-system/authorino-647997d7b4-c9zx8"
Jul 23 10:02:51.988938 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:51.988910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skbk7\" (UniqueName: \"kubernetes.io/projected/32fd7e4e-8704-4288-bd75-998bef7491e8-kube-api-access-skbk7\") pod \"authorino-647997d7b4-c9zx8\" (UID: \"32fd7e4e-8704-4288-bd75-998bef7491e8\") " pod="kuadrant-system/authorino-647997d7b4-c9zx8"
Jul 23 10:02:52.159464 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:52.159433    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647997d7b4-c9zx8"
Jul 23 10:02:52.296727 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:52.296701    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-647997d7b4-c9zx8"]
Jul 23 10:02:52.299822 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:02:52.299796    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32fd7e4e_8704_4288_bd75_998bef7491e8.slice/crio-fade6ab66b0a28812eba763787449a751a33f0aa599fbb5610de7a94953e6fdc WatchSource:0}: Error finding container fade6ab66b0a28812eba763787449a751a33f0aa599fbb5610de7a94953e6fdc: Status 404 returned error can't find the container with id fade6ab66b0a28812eba763787449a751a33f0aa599fbb5610de7a94953e6fdc
Jul 23 10:02:52.852573 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:52.852542    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6887794b84-bwwvz"
Jul 23 10:02:52.852988 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:52.852579    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647997d7b4-c9zx8" event={"ID":"32fd7e4e-8704-4288-bd75-998bef7491e8","Type":"ContainerStarted","Data":"b5bd9a6d07bab7a70cba3dd229e70d3b17d46c086a07832255d27ef5a2cc5791"}
Jul 23 10:02:52.852988 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:52.852618    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647997d7b4-c9zx8" event={"ID":"32fd7e4e-8704-4288-bd75-998bef7491e8","Type":"ContainerStarted","Data":"fade6ab66b0a28812eba763787449a751a33f0aa599fbb5610de7a94953e6fdc"}
Jul 23 10:02:52.870836 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:52.870768    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-647997d7b4-c9zx8" podStartSLOduration=1.431038996 podStartE2EDuration="1.870749067s" totalImagesPullingTime="439.710071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:02:52.868568002 +0000 UTC m=+492.772256275" watchObservedRunningTime="2026-07-23 10:02:52.870749067 +0000 UTC m=+492.774437341"
Jul 23 10:02:52.894808 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:52.894775    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fcwh6"]
Jul 23 10:02:52.895017 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:52.894991    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-fcwh6" podUID="b512f1d4-1161-4bd0-80b9-d205cc2d3ec2" containerName="authorino" containerID="cri-o://49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d" gracePeriod=30
Jul 23 10:02:52.896824 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:52.896796    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6887794b84-bwwvz"]
Jul 23 10:02:52.900292 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:52.900248    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6887794b84-bwwvz"]
Jul 23 10:02:53.145861 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.145834    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fcwh6"
Jul 23 10:02:53.191919 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.191887    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdbdp\" (UniqueName: \"kubernetes.io/projected/b512f1d4-1161-4bd0-80b9-d205cc2d3ec2-kube-api-access-zdbdp\") pod \"b512f1d4-1161-4bd0-80b9-d205cc2d3ec2\" (UID: \"b512f1d4-1161-4bd0-80b9-d205cc2d3ec2\") "
Jul 23 10:02:53.194121 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.194091    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b512f1d4-1161-4bd0-80b9-d205cc2d3ec2-kube-api-access-zdbdp" (OuterVolumeSpecName: "kube-api-access-zdbdp") pod "b512f1d4-1161-4bd0-80b9-d205cc2d3ec2" (UID: "b512f1d4-1161-4bd0-80b9-d205cc2d3ec2"). InnerVolumeSpecName "kube-api-access-zdbdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:02:53.293395 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.293301    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdbdp\" (UniqueName: \"kubernetes.io/projected/b512f1d4-1161-4bd0-80b9-d205cc2d3ec2-kube-api-access-zdbdp\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:02:53.858814 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.858779    2564 generic.go:356] "Generic (PLEG): container finished" podID="b512f1d4-1161-4bd0-80b9-d205cc2d3ec2" containerID="49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d" exitCode=0
Jul 23 10:02:53.859300 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.858824    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fcwh6"
Jul 23 10:02:53.859300 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.858834    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fcwh6" event={"ID":"b512f1d4-1161-4bd0-80b9-d205cc2d3ec2","Type":"ContainerDied","Data":"49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d"}
Jul 23 10:02:53.859300 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.858874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fcwh6" event={"ID":"b512f1d4-1161-4bd0-80b9-d205cc2d3ec2","Type":"ContainerDied","Data":"fbeab8a92e9baf2f7c6f072fd92a020b2e05d4054a9a9422302223f96a37523b"}
Jul 23 10:02:53.859300 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.858896    2564 scope.go:117] "RemoveContainer" containerID="49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d"
Jul 23 10:02:53.867636 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.867585    2564 scope.go:117] "RemoveContainer" containerID="49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d"
Jul 23 10:02:53.867977 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:02:53.867950    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d\": container with ID starting with 49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d not found: ID does not exist" containerID="49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d"
Jul 23 10:02:53.868069 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.867990    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d"} err="failed to get container status \"49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d\": rpc error: code = NotFound desc = could not find container \"49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d\": container with ID starting with 49d261678752fa7db9f0acaedb9abbc7c9787839794bdf122cce85a53661042d not found: ID does not exist"
Jul 23 10:02:53.879651 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.879615    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fcwh6"]
Jul 23 10:02:53.885225 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:53.885199    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fcwh6"]
Jul 23 10:02:54.609504 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:54.609473    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b512f1d4-1161-4bd0-80b9-d205cc2d3ec2" path="/var/lib/kubelet/pods/b512f1d4-1161-4bd0-80b9-d205cc2d3ec2/volumes"
Jul 23 10:02:57.670548 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.670510    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fb77cfddc-gr68b"]
Jul 23 10:02:57.671009 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.670870    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b512f1d4-1161-4bd0-80b9-d205cc2d3ec2" containerName="authorino"
Jul 23 10:02:57.671009 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.670883    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b512f1d4-1161-4bd0-80b9-d205cc2d3ec2" containerName="authorino"
Jul 23 10:02:57.671009 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.670972    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b512f1d4-1161-4bd0-80b9-d205cc2d3ec2" containerName="authorino"
Jul 23 10:02:57.673746 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.673728    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:02:57.676732 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.676702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:57.676882 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.676814    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jkv8t\""
Jul 23 10:02:57.676882 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.676825    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 10:02:57.677855 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.677834    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 10:02:57.686671 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.686645    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fb77cfddc-gr68b"]
Jul 23 10:02:57.737691 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.737654    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d749fe8-8683-441c-b4ee-a9210f5eda3e-webhook-cert\") pod \"maas-controller-6fb77cfddc-gr68b\" (UID: \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\") " pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:02:57.737887 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.737709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7czv\" (UniqueName: \"kubernetes.io/projected/1d749fe8-8683-441c-b4ee-a9210f5eda3e-kube-api-access-q7czv\") pod \"maas-controller-6fb77cfddc-gr68b\" (UID: \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\") " pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:02:57.805085 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.805051    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:57.838154 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.838114    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d749fe8-8683-441c-b4ee-a9210f5eda3e-webhook-cert\") pod \"maas-controller-6fb77cfddc-gr68b\" (UID: \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\") " pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:02:57.838381 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.838181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7czv\" (UniqueName: \"kubernetes.io/projected/1d749fe8-8683-441c-b4ee-a9210f5eda3e-kube-api-access-q7czv\") pod \"maas-controller-6fb77cfddc-gr68b\" (UID: \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\") " pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:02:57.838381 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:02:57.838291    2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 23 10:02:57.838381 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:02:57.838366    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d749fe8-8683-441c-b4ee-a9210f5eda3e-webhook-cert podName:1d749fe8-8683-441c-b4ee-a9210f5eda3e nodeName:}" failed. No retries permitted until 2026-07-23 10:02:58.338344027 +0000 UTC m=+498.242032290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1d749fe8-8683-441c-b4ee-a9210f5eda3e-webhook-cert") pod "maas-controller-6fb77cfddc-gr68b" (UID: "1d749fe8-8683-441c-b4ee-a9210f5eda3e") : secret "maas-controller-webhook-cert" not found
Jul 23 10:02:57.844275 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.844231    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86975d4f4c-rwrs5"]
Jul 23 10:02:57.847276 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.847226    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:02:57.850717 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.850689    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7czv\" (UniqueName: \"kubernetes.io/projected/1d749fe8-8683-441c-b4ee-a9210f5eda3e-kube-api-access-q7czv\") pod \"maas-controller-6fb77cfddc-gr68b\" (UID: \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\") " pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:02:57.857372 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.857342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-rwrs5"]
Jul 23 10:02:57.865294 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.865239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:57.939402 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.939304    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/776c1989-6c64-4988-aa6f-cd186f7350f9-webhook-cert\") pod \"maas-controller-86975d4f4c-rwrs5\" (UID: \"776c1989-6c64-4988-aa6f-cd186f7350f9\") " pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:02:57.939402 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:57.939367    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2lr5\" (UniqueName: \"kubernetes.io/projected/776c1989-6c64-4988-aa6f-cd186f7350f9-kube-api-access-d2lr5\") pod \"maas-controller-86975d4f4c-rwrs5\" (UID: \"776c1989-6c64-4988-aa6f-cd186f7350f9\") " pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:02:58.040684 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.040646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/776c1989-6c64-4988-aa6f-cd186f7350f9-webhook-cert\") pod \"maas-controller-86975d4f4c-rwrs5\" (UID: \"776c1989-6c64-4988-aa6f-cd186f7350f9\") " pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:02:58.040887 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.040701    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2lr5\" (UniqueName: \"kubernetes.io/projected/776c1989-6c64-4988-aa6f-cd186f7350f9-kube-api-access-d2lr5\") pod \"maas-controller-86975d4f4c-rwrs5\" (UID: \"776c1989-6c64-4988-aa6f-cd186f7350f9\") " pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:02:58.040887 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:02:58.040845    2564 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 23 10:02:58.041028 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:02:58.040925    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/776c1989-6c64-4988-aa6f-cd186f7350f9-webhook-cert podName:776c1989-6c64-4988-aa6f-cd186f7350f9 nodeName:}" failed. No retries permitted until 2026-07-23 10:02:58.540903683 +0000 UTC m=+498.444591935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/776c1989-6c64-4988-aa6f-cd186f7350f9-webhook-cert") pod "maas-controller-86975d4f4c-rwrs5" (UID: "776c1989-6c64-4988-aa6f-cd186f7350f9") : secret "maas-controller-webhook-cert" not found
Jul 23 10:02:58.051767 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.051730    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2lr5\" (UniqueName: \"kubernetes.io/projected/776c1989-6c64-4988-aa6f-cd186f7350f9-kube-api-access-d2lr5\") pod \"maas-controller-86975d4f4c-rwrs5\" (UID: \"776c1989-6c64-4988-aa6f-cd186f7350f9\") " pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:02:58.185867 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.185821    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:02:58.343368 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.343247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d749fe8-8683-441c-b4ee-a9210f5eda3e-webhook-cert\") pod \"maas-controller-6fb77cfddc-gr68b\" (UID: \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\") " pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:02:58.345905 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.345879    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d749fe8-8683-441c-b4ee-a9210f5eda3e-webhook-cert\") pod \"maas-controller-6fb77cfddc-gr68b\" (UID: \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\") " pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:02:58.544966 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.544928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/776c1989-6c64-4988-aa6f-cd186f7350f9-webhook-cert\") pod \"maas-controller-86975d4f4c-rwrs5\" (UID: \"776c1989-6c64-4988-aa6f-cd186f7350f9\") " pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:02:58.547502 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.547474    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/776c1989-6c64-4988-aa6f-cd186f7350f9-webhook-cert\") pod \"maas-controller-86975d4f4c-rwrs5\" (UID: \"776c1989-6c64-4988-aa6f-cd186f7350f9\") " pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:02:58.585013 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.584968    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:02:58.719845 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.719821    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fb77cfddc-gr68b"]
Jul 23 10:02:58.722058 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:02:58.722032    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d749fe8_8683_441c_b4ee_a9210f5eda3e.slice/crio-da0c117529dc81a8228cb8abe711d9e233bf7f03ed00d9d5d03430b513e29d4e WatchSource:0}: Error finding container da0c117529dc81a8228cb8abe711d9e233bf7f03ed00d9d5d03430b513e29d4e: Status 404 returned error can't find the container with id da0c117529dc81a8228cb8abe711d9e233bf7f03ed00d9d5d03430b513e29d4e
Jul 23 10:02:58.768412 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.768367    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:02:58.884923 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.884893    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fb77cfddc-gr68b" event={"ID":"1d749fe8-8683-441c-b4ee-a9210f5eda3e","Type":"ContainerStarted","Data":"da0c117529dc81a8228cb8abe711d9e233bf7f03ed00d9d5d03430b513e29d4e"}
Jul 23 10:02:58.907850 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:58.907826    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-rwrs5"]
Jul 23 10:02:58.910052 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:02:58.910021    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776c1989_6c64_4988_aa6f_cd186f7350f9.slice/crio-09bb5a675d84ac6c2e9dc89a23257c9da1fa4a7821cd0fc78a5f8d0509a03cce WatchSource:0}: Error finding container 09bb5a675d84ac6c2e9dc89a23257c9da1fa4a7821cd0fc78a5f8d0509a03cce: Status 404 returned error can't find the container with id 09bb5a675d84ac6c2e9dc89a23257c9da1fa4a7821cd0fc78a5f8d0509a03cce
Jul 23 10:02:59.905404 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:02:59.905361    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86975d4f4c-rwrs5" event={"ID":"776c1989-6c64-4988-aa6f-cd186f7350f9","Type":"ContainerStarted","Data":"09bb5a675d84ac6c2e9dc89a23257c9da1fa4a7821cd0fc78a5f8d0509a03cce"}
Jul 23 10:03:01.470021 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:01.469990    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:01.570632 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:01.570500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:01.916050 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:01.916012    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86975d4f4c-rwrs5" event={"ID":"776c1989-6c64-4988-aa6f-cd186f7350f9","Type":"ContainerStarted","Data":"e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3"}
Jul 23 10:03:01.916223 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:01.916105    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:03:01.917532 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:01.917506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fb77cfddc-gr68b" event={"ID":"1d749fe8-8683-441c-b4ee-a9210f5eda3e","Type":"ContainerStarted","Data":"82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1"}
Jul 23 10:03:01.917688 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:01.917562    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:03:01.937075 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:01.937021    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86975d4f4c-rwrs5" podStartSLOduration=2.527668951 podStartE2EDuration="4.937005593s" totalImagesPullingTime="2.409336642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:03:01.934637021 +0000 UTC m=+501.838325313" watchObservedRunningTime="2026-07-23 10:03:01.937005593 +0000 UTC m=+501.840693881"
Jul 23 10:03:01.952831 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:01.952774    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6fb77cfddc-gr68b" podStartSLOduration=2.364907291 podStartE2EDuration="4.952753798s" totalImagesPullingTime="2.587846507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:02:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:03:01.951638151 +0000 UTC m=+501.855326427" watchObservedRunningTime="2026-07-23 10:03:01.952753798 +0000 UTC m=+501.856442072"
Jul 23 10:03:12.924786 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:12.924750    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:03:12.925190 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:12.924836    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:03:12.985651 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:12.985611    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fb77cfddc-gr68b"]
Jul 23 10:03:12.985978 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:12.985875    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6fb77cfddc-gr68b" podUID="1d749fe8-8683-441c-b4ee-a9210f5eda3e" containerName="manager" containerID="cri-o://82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1" gracePeriod=30
Jul 23 10:03:13.233630 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.233600    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:03:13.381425 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.381380    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7czv\" (UniqueName: \"kubernetes.io/projected/1d749fe8-8683-441c-b4ee-a9210f5eda3e-kube-api-access-q7czv\") pod \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\" (UID: \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\") "
Jul 23 10:03:13.381582 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.381456    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d749fe8-8683-441c-b4ee-a9210f5eda3e-webhook-cert\") pod \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\" (UID: \"1d749fe8-8683-441c-b4ee-a9210f5eda3e\") "
Jul 23 10:03:13.383829 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.383796    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d749fe8-8683-441c-b4ee-a9210f5eda3e-kube-api-access-q7czv" (OuterVolumeSpecName: "kube-api-access-q7czv") pod "1d749fe8-8683-441c-b4ee-a9210f5eda3e" (UID: "1d749fe8-8683-441c-b4ee-a9210f5eda3e"). InnerVolumeSpecName "kube-api-access-q7czv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:03:13.383829 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.383791    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d749fe8-8683-441c-b4ee-a9210f5eda3e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1d749fe8-8683-441c-b4ee-a9210f5eda3e" (UID: "1d749fe8-8683-441c-b4ee-a9210f5eda3e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:03:13.482233 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.482139    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1d749fe8-8683-441c-b4ee-a9210f5eda3e-webhook-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:03:13.482233 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.482169    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7czv\" (UniqueName: \"kubernetes.io/projected/1d749fe8-8683-441c-b4ee-a9210f5eda3e-kube-api-access-q7czv\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:03:13.986550 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.986517    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d749fe8-8683-441c-b4ee-a9210f5eda3e" containerID="82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1" exitCode=0
Jul 23 10:03:13.986945 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.986566    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fb77cfddc-gr68b"
Jul 23 10:03:13.986945 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.986605    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fb77cfddc-gr68b" event={"ID":"1d749fe8-8683-441c-b4ee-a9210f5eda3e","Type":"ContainerDied","Data":"82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1"}
Jul 23 10:03:13.986945 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.986659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fb77cfddc-gr68b" event={"ID":"1d749fe8-8683-441c-b4ee-a9210f5eda3e","Type":"ContainerDied","Data":"da0c117529dc81a8228cb8abe711d9e233bf7f03ed00d9d5d03430b513e29d4e"}
Jul 23 10:03:13.986945 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.986689    2564 scope.go:117] "RemoveContainer" containerID="82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1"
Jul 23 10:03:13.995542 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.995524    2564 scope.go:117] "RemoveContainer" containerID="82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1"
Jul 23 10:03:13.995823 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:03:13.995806    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1\": container with ID starting with 82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1 not found: ID does not exist" containerID="82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1"
Jul 23 10:03:13.995892 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:13.995835    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1"} err="failed to get container status \"82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1\": rpc error: code = NotFound desc = could not find container \"82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1\": container with ID starting with 82e8e19c04204819aa656fea986e0af5208962d281937e65460953d60df4cbc1 not found: ID does not exist"
Jul 23 10:03:14.009271 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:14.009224    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fb77cfddc-gr68b"]
Jul 23 10:03:14.013086 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:14.013061    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6fb77cfddc-gr68b"]
Jul 23 10:03:14.610395 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:14.610358    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d749fe8-8683-441c-b4ee-a9210f5eda3e" path="/var/lib/kubelet/pods/1d749fe8-8683-441c-b4ee-a9210f5eda3e/volumes"
Jul 23 10:03:34.036090 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.036046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:34.135717 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.135685    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:34.690432 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.690383    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:34.771093 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.771052    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"]
Jul 23 10:03:34.771466 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.771450    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d749fe8-8683-441c-b4ee-a9210f5eda3e" containerName="manager"
Jul 23 10:03:34.771536 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.771468    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d749fe8-8683-441c-b4ee-a9210f5eda3e" containerName="manager"
Jul 23 10:03:34.771536 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.771531    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d749fe8-8683-441c-b4ee-a9210f5eda3e" containerName="manager"
Jul 23 10:03:34.775920 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.775899    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:34.778806 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.778784    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 10:03:34.778944 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.778843    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-x7kqx\""
Jul 23 10:03:34.784297 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.784201    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"]
Jul 23 10:03:34.863688 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.863643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjl5q\" (UniqueName: \"kubernetes.io/projected/1818b624-1135-4035-b700-ae786b281339-kube-api-access-tjl5q\") pod \"maas-api-6b975bd78-lknzh\" (UID: \"1818b624-1135-4035-b700-ae786b281339\") " pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:34.863873 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.863750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1818b624-1135-4035-b700-ae786b281339-openshift-service-ca\") pod \"maas-api-6b975bd78-lknzh\" (UID: \"1818b624-1135-4035-b700-ae786b281339\") " pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:34.863873 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.863818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1818b624-1135-4035-b700-ae786b281339-maas-api-tls\") pod \"maas-api-6b975bd78-lknzh\" (UID: \"1818b624-1135-4035-b700-ae786b281339\") " pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:34.925817 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.925783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:34.964327 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.964208    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1818b624-1135-4035-b700-ae786b281339-maas-api-tls\") pod \"maas-api-6b975bd78-lknzh\" (UID: \"1818b624-1135-4035-b700-ae786b281339\") " pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:34.964327 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.964316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjl5q\" (UniqueName: \"kubernetes.io/projected/1818b624-1135-4035-b700-ae786b281339-kube-api-access-tjl5q\") pod \"maas-api-6b975bd78-lknzh\" (UID: \"1818b624-1135-4035-b700-ae786b281339\") " pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:34.964570 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.964371    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1818b624-1135-4035-b700-ae786b281339-openshift-service-ca\") pod \"maas-api-6b975bd78-lknzh\" (UID: \"1818b624-1135-4035-b700-ae786b281339\") " pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:34.965059 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.965035    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1818b624-1135-4035-b700-ae786b281339-openshift-service-ca\") pod \"maas-api-6b975bd78-lknzh\" (UID: \"1818b624-1135-4035-b700-ae786b281339\") " pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:34.967025 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.967003    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1818b624-1135-4035-b700-ae786b281339-maas-api-tls\") pod \"maas-api-6b975bd78-lknzh\" (UID: \"1818b624-1135-4035-b700-ae786b281339\") " pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:34.975634 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:34.975601    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjl5q\" (UniqueName: \"kubernetes.io/projected/1818b624-1135-4035-b700-ae786b281339-kube-api-access-tjl5q\") pod \"maas-api-6b975bd78-lknzh\" (UID: \"1818b624-1135-4035-b700-ae786b281339\") " pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:35.089077 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.089040    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:35.133358 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.133198    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:35.225168 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.225060    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:35.226965 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.226925    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"]
Jul 23 10:03:35.236068 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.236041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"
Jul 23 10:03:35.240038 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.239963    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2m52f\""
Jul 23 10:03:35.240241 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.240041    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 10:03:35.241117 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.241091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"]
Jul 23 10:03:35.254056 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.254023    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-k67d7"]
Jul 23 10:03:35.256962 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.256937    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-k67d7"
Jul 23 10:03:35.257980 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.257958    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"]
Jul 23 10:03:35.261873 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:03:35.261825    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1818b624_1135_4035_b700_ae786b281339.slice/crio-5c60b552d2762277fb76f2c168c5b4842aaf7b52a749f088745552606674fac3 WatchSource:0}: Error finding container 5c60b552d2762277fb76f2c168c5b4842aaf7b52a749f088745552606674fac3: Status 404 returned error can't find the container with id 5c60b552d2762277fb76f2c168c5b4842aaf7b52a749f088745552606674fac3
Jul 23 10:03:35.266409 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.266373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcnr9\" (UniqueName: \"kubernetes.io/projected/4bac54c8-f964-49c5-95c7-d3b9dd3e46db-kube-api-access-mcnr9\") pod \"payload-processing-5bf47cd988-k67d7\" (UID: \"4bac54c8-f964-49c5-95c7-d3b9dd3e46db\") " pod="openshift-ingress/payload-processing-5bf47cd988-k67d7"
Jul 23 10:03:35.266409 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.266408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrvkg\" (UniqueName: \"kubernetes.io/projected/54f201f7-d767-448d-b2d2-42247b5d030c-kube-api-access-jrvkg\") pod \"payload-pre-processing-7677b774bb-t8dz5\" (UID: \"54f201f7-d767-448d-b2d2-42247b5d030c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"
Jul 23 10:03:35.266598 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.266474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54f201f7-d767-448d-b2d2-42247b5d030c-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-t8dz5\" (UID: \"54f201f7-d767-448d-b2d2-42247b5d030c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"
Jul 23 10:03:35.266598 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.266536    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bac54c8-f964-49c5-95c7-d3b9dd3e46db-plugins-config-volume\") pod \"payload-processing-5bf47cd988-k67d7\" (UID: \"4bac54c8-f964-49c5-95c7-d3b9dd3e46db\") " pod="openshift-ingress/payload-processing-5bf47cd988-k67d7"
Jul 23 10:03:35.271428 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.271399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-k67d7"]
Jul 23 10:03:35.367297 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.367237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bac54c8-f964-49c5-95c7-d3b9dd3e46db-plugins-config-volume\") pod \"payload-processing-5bf47cd988-k67d7\" (UID: \"4bac54c8-f964-49c5-95c7-d3b9dd3e46db\") " pod="openshift-ingress/payload-processing-5bf47cd988-k67d7"
Jul 23 10:03:35.367506 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.367337    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcnr9\" (UniqueName: \"kubernetes.io/projected/4bac54c8-f964-49c5-95c7-d3b9dd3e46db-kube-api-access-mcnr9\") pod \"payload-processing-5bf47cd988-k67d7\" (UID: \"4bac54c8-f964-49c5-95c7-d3b9dd3e46db\") " pod="openshift-ingress/payload-processing-5bf47cd988-k67d7"
Jul 23 10:03:35.367506 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.367361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrvkg\" (UniqueName: \"kubernetes.io/projected/54f201f7-d767-448d-b2d2-42247b5d030c-kube-api-access-jrvkg\") pod \"payload-pre-processing-7677b774bb-t8dz5\" (UID: \"54f201f7-d767-448d-b2d2-42247b5d030c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"
Jul 23 10:03:35.367506 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.367405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54f201f7-d767-448d-b2d2-42247b5d030c-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-t8dz5\" (UID: \"54f201f7-d767-448d-b2d2-42247b5d030c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"
Jul 23 10:03:35.368074 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.368049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bac54c8-f964-49c5-95c7-d3b9dd3e46db-plugins-config-volume\") pod \"payload-processing-5bf47cd988-k67d7\" (UID: \"4bac54c8-f964-49c5-95c7-d3b9dd3e46db\") " pod="openshift-ingress/payload-processing-5bf47cd988-k67d7"
Jul 23 10:03:35.368167 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.368109    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54f201f7-d767-448d-b2d2-42247b5d030c-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-t8dz5\" (UID: \"54f201f7-d767-448d-b2d2-42247b5d030c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"
Jul 23 10:03:35.376183 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.376150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcnr9\" (UniqueName: \"kubernetes.io/projected/4bac54c8-f964-49c5-95c7-d3b9dd3e46db-kube-api-access-mcnr9\") pod \"payload-processing-5bf47cd988-k67d7\" (UID: \"4bac54c8-f964-49c5-95c7-d3b9dd3e46db\") " pod="openshift-ingress/payload-processing-5bf47cd988-k67d7"
Jul 23 10:03:35.376322 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.376205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrvkg\" (UniqueName: \"kubernetes.io/projected/54f201f7-d767-448d-b2d2-42247b5d030c-kube-api-access-jrvkg\") pod \"payload-pre-processing-7677b774bb-t8dz5\" (UID: \"54f201f7-d767-448d-b2d2-42247b5d030c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"
Jul 23 10:03:35.548659 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.548574    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"
Jul 23 10:03:35.579336 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.579290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-k67d7"
Jul 23 10:03:35.716089 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.716057    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"]
Jul 23 10:03:35.718269 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:03:35.718215    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f201f7_d767_448d_b2d2_42247b5d030c.slice/crio-623e7707fa5c981af53b2820494fc5cbe04594784282643570b17baaba4b9838 WatchSource:0}: Error finding container 623e7707fa5c981af53b2820494fc5cbe04594784282643570b17baaba4b9838: Status 404 returned error can't find the container with id 623e7707fa5c981af53b2820494fc5cbe04594784282643570b17baaba4b9838
Jul 23 10:03:35.746629 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:35.746597    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-k67d7"]
Jul 23 10:03:35.749755 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:03:35.749726    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bac54c8_f964_49c5_95c7_d3b9dd3e46db.slice/crio-0da87395a6f7180f078336b752324ed765ba1642d58b75a78fb3428b57a0d4b1 WatchSource:0}: Error finding container 0da87395a6f7180f078336b752324ed765ba1642d58b75a78fb3428b57a0d4b1: Status 404 returned error can't find the container with id 0da87395a6f7180f078336b752324ed765ba1642d58b75a78fb3428b57a0d4b1
Jul 23 10:03:36.097998 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:36.097955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-k67d7" event={"ID":"4bac54c8-f964-49c5-95c7-d3b9dd3e46db","Type":"ContainerStarted","Data":"0da87395a6f7180f078336b752324ed765ba1642d58b75a78fb3428b57a0d4b1"}
Jul 23 10:03:36.099461 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:36.099426    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5" event={"ID":"54f201f7-d767-448d-b2d2-42247b5d030c","Type":"ContainerStarted","Data":"623e7707fa5c981af53b2820494fc5cbe04594784282643570b17baaba4b9838"}
Jul 23 10:03:36.100889 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:36.100854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh" event={"ID":"1818b624-1135-4035-b700-ae786b281339","Type":"ContainerStarted","Data":"5c60b552d2762277fb76f2c168c5b4842aaf7b52a749f088745552606674fac3"}
Jul 23 10:03:39.119746 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:39.119704    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5" event={"ID":"54f201f7-d767-448d-b2d2-42247b5d030c","Type":"ContainerStarted","Data":"5f29475e29d1e0e8b2a4cf0f01329fa191d573e1b56d083d97e9a0e3028d942b"}
Jul 23 10:03:39.120223 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:39.119774    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"
Jul 23 10:03:39.121362 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:39.121335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh" event={"ID":"1818b624-1135-4035-b700-ae786b281339","Type":"ContainerStarted","Data":"e6a082beff7954bd5d7ff65fd7a08815e4d56ba305af787a45aee0bc1c4a33db"}
Jul 23 10:03:39.121484 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:39.121386    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:39.122891 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:39.122870    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-k67d7" event={"ID":"4bac54c8-f964-49c5-95c7-d3b9dd3e46db","Type":"ContainerStarted","Data":"35d3661df3028c3b41637d035a0634232859ce808a7bbc5b991f0f67671a6694"}
Jul 23 10:03:39.123018 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:39.122919    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-k67d7"
Jul 23 10:03:39.142276 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:39.137235    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5" podStartSLOduration=1.501960102 podStartE2EDuration="4.137213265s" totalImagesPullingTime="2.635253163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:03:39.134467705 +0000 UTC m=+539.038155980" watchObservedRunningTime="2026-07-23 10:03:39.137213265 +0000 UTC m=+539.040901536"
Jul 23 10:03:39.157051 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:39.156989    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-k67d7" podStartSLOduration=1.559589203 podStartE2EDuration="4.156972432s" totalImagesPullingTime="2.597383229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:03:39.155919093 +0000 UTC m=+539.059607377" watchObservedRunningTime="2026-07-23 10:03:39.156972432 +0000 UTC m=+539.060660706"
Jul 23 10:03:39.173378 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:39.173325    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh" podStartSLOduration=2.145232846 podStartE2EDuration="5.173306534s" totalImagesPullingTime="3.028073688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:03:39.172128757 +0000 UTC m=+539.075817032" watchObservedRunningTime="2026-07-23 10:03:39.173306534 +0000 UTC m=+539.076994808"
Jul 23 10:03:45.135384 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:45.135352    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b975bd78-lknzh"
Jul 23 10:03:45.302238 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:45.302205    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:45.406864 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:45.406783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:46.177025 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:46.176996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:46.273343 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:46.273311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:03:50.131818 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:50.131788    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-k67d7"
Jul 23 10:03:50.132286 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:03:50.131876    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-t8dz5"
Jul 23 10:04:10.590954 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.590916    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"]
Jul 23 10:04:10.604055 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.604009    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"]
Jul 23 10:04:10.606809 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.606773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.609753 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.609729    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 10:04:10.611171 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.611137    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qxbzn\""
Jul 23 10:04:10.611171 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.611155    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 23 10:04:10.611417 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.611179    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 10:04:10.618215 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.618190    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:04:10.708670 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.708636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.708856 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.708688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.708856 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.708724    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.708856 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.708756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.708856 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.708778    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad2a7322-5bdd-4ace-9644-7820feb1f78b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.708856 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.708831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zc7t\" (UniqueName: \"kubernetes.io/projected/ad2a7322-5bdd-4ace-9644-7820feb1f78b-kube-api-access-6zc7t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.809625 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.809587    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.809903 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.809634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad2a7322-5bdd-4ace-9644-7820feb1f78b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.809903 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.809672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zc7t\" (UniqueName: \"kubernetes.io/projected/ad2a7322-5bdd-4ace-9644-7820feb1f78b-kube-api-access-6zc7t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.809903 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.809712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.809903 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.809743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.809903 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.809762    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.810184 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.810087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.810184 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.810122    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.810367 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.810197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.812111 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.812087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad2a7322-5bdd-4ace-9644-7820feb1f78b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.812432 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.812410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad2a7322-5bdd-4ace-9644-7820feb1f78b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.817631 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.817605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zc7t\" (UniqueName: \"kubernetes.io/projected/ad2a7322-5bdd-4ace-9644-7820feb1f78b-kube-api-access-6zc7t\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb\" (UID: \"ad2a7322-5bdd-4ace-9644-7820feb1f78b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:10.918565 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:10.918533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:11.100248 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:11.100177    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"]
Jul 23 10:04:11.102612 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:04:11.102582    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad2a7322_5bdd_4ace_9644_7820feb1f78b.slice/crio-2ef7e67143b1c15fa8c27bf87c962212cfd2ed45f09fa62f09f8764bd6f11dce WatchSource:0}: Error finding container 2ef7e67143b1c15fa8c27bf87c962212cfd2ed45f09fa62f09f8764bd6f11dce: Status 404 returned error can't find the container with id 2ef7e67143b1c15fa8c27bf87c962212cfd2ed45f09fa62f09f8764bd6f11dce
Jul 23 10:04:11.288235 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:11.288134    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb" event={"ID":"ad2a7322-5bdd-4ace-9644-7820feb1f78b","Type":"ContainerStarted","Data":"2ef7e67143b1c15fa8c27bf87c962212cfd2ed45f09fa62f09f8764bd6f11dce"}
Jul 23 10:04:13.299740 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:13.299700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb" event={"ID":"ad2a7322-5bdd-4ace-9644-7820feb1f78b","Type":"ContainerStarted","Data":"da7f964130fdc18c51ca6458a2e120dce9fc5ba3262b34cff6e9f6719988333c"}
Jul 23 10:04:16.703631 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:16.703586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:04:20.919226 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:20.919172    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:20.919649 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:20.919314    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:20.932479 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:20.932445    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:20.949658 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:20.949606    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb" podStartSLOduration=9.749359769 podStartE2EDuration="10.949590107s" totalImagesPullingTime="1.200230338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:04:13.316650595 +0000 UTC m=+573.220338868" watchObservedRunningTime="2026-07-23 10:04:20.949590107 +0000 UTC m=+580.853278380"
Jul 23 10:04:21.352186 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:21.352095    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb"
Jul 23 10:04:27.702974 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:27.702934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:04:39.473103 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.473059    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"]
Jul 23 10:04:39.475941 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.475916    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.478753 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.478724    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 23 10:04:39.486095 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.486061    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"]
Jul 23 10:04:39.504786 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.504753    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:04:39.570352 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.570316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.570352 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.570358    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.570702 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.570467    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x27v\" (UniqueName: \"kubernetes.io/projected/10d0ed10-da49-47c4-a391-c004fdca3f9b-kube-api-access-2x27v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.570702 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.570507    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10d0ed10-da49-47c4-a391-c004fdca3f9b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.570702 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.570625    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.570702 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.570655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.671946 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.671895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.671946 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.671945    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.672207 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.671994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.672207 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.672015    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.672207 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.672073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x27v\" (UniqueName: \"kubernetes.io/projected/10d0ed10-da49-47c4-a391-c004fdca3f9b-kube-api-access-2x27v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.672207 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.672103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10d0ed10-da49-47c4-a391-c004fdca3f9b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.672600 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.672397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.672600 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.672430    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.672741 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.672717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.674772 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.674736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10d0ed10-da49-47c4-a391-c004fdca3f9b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.674946 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.674919    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10d0ed10-da49-47c4-a391-c004fdca3f9b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.681122 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.681087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x27v\" (UniqueName: \"kubernetes.io/projected/10d0ed10-da49-47c4-a391-c004fdca3f9b-kube-api-access-2x27v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd\" (UID: \"10d0ed10-da49-47c4-a391-c004fdca3f9b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.788041 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.787936    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:39.935943 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:39.935858    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"]
Jul 23 10:04:39.938661 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:04:39.938618    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d0ed10_da49_47c4_a391_c004fdca3f9b.slice/crio-533d31fc7c21fdd8b4e6eb48dab067e52e6a47356070da3b7da60238159e9048 WatchSource:0}: Error finding container 533d31fc7c21fdd8b4e6eb48dab067e52e6a47356070da3b7da60238159e9048: Status 404 returned error can't find the container with id 533d31fc7c21fdd8b4e6eb48dab067e52e6a47356070da3b7da60238159e9048
Jul 23 10:04:40.440552 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:40.440452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd" event={"ID":"10d0ed10-da49-47c4-a391-c004fdca3f9b","Type":"ContainerStarted","Data":"ce2dd1bf72c28112f1ec9feda0e47661fcd0429a3570de1fbca4482777c626cd"}
Jul 23 10:04:40.440552 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:40.440546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd" event={"ID":"10d0ed10-da49-47c4-a391-c004fdca3f9b","Type":"ContainerStarted","Data":"533d31fc7c21fdd8b4e6eb48dab067e52e6a47356070da3b7da60238159e9048"}
Jul 23 10:04:40.459617 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:40.459558    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd" podStartSLOduration=1.212797087 podStartE2EDuration="1.459539511s" totalImagesPullingTime="246.742424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:04:40.457670048 +0000 UTC m=+600.361358322" watchObservedRunningTime="2026-07-23 10:04:40.459539511 +0000 UTC m=+600.363227784"
Jul 23 10:04:40.536036 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:40.536005    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:04:40.536927 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:40.536723    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:04:49.788849 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:49.788803    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:49.791468 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:49.788883    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:49.801899 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:49.801865    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:04:50.498207 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:04:50.498175    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd"
Jul 23 10:05:06.781306 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.781181    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"]
Jul 23 10:05:06.784055 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.784031    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.786989 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.786964    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 23 10:05:06.795223 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.795192    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"]
Jul 23 10:05:06.829392 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.829349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngbjc\" (UniqueName: \"kubernetes.io/projected/64200b18-0a1f-4286-bf6b-330552978930-kube-api-access-ngbjc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.829392 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.829397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.829640 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.829462    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64200b18-0a1f-4286-bf6b-330552978930-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.829640 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.829506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.829640 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.829548    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.829640 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.829569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.854570 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.854528    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:05:06.930325 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.930240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64200b18-0a1f-4286-bf6b-330552978930-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.930500 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.930338    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.930500 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.930379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.930500 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.930410    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.930500 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.930483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngbjc\" (UniqueName: \"kubernetes.io/projected/64200b18-0a1f-4286-bf6b-330552978930-kube-api-access-ngbjc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.930695 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.930520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.930841 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.930816    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.930940 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.930851    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.930940 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.930866    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.932838 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.932815    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64200b18-0a1f-4286-bf6b-330552978930-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.932997 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.932981    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64200b18-0a1f-4286-bf6b-330552978930-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:06.938883 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:06.938856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngbjc\" (UniqueName: \"kubernetes.io/projected/64200b18-0a1f-4286-bf6b-330552978930-kube-api-access-ngbjc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w8j6h\" (UID: \"64200b18-0a1f-4286-bf6b-330552978930\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:07.096179 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:07.096077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:07.240569 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:07.240546    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"]
Jul 23 10:05:07.243592 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:05:07.243561    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64200b18_0a1f_4286_bf6b_330552978930.slice/crio-4c5b5a4dd4a55c7a2376e3734b9f8dc4920efe4d4cf7367b598a5f9cc4553e58 WatchSource:0}: Error finding container 4c5b5a4dd4a55c7a2376e3734b9f8dc4920efe4d4cf7367b598a5f9cc4553e58: Status 404 returned error can't find the container with id 4c5b5a4dd4a55c7a2376e3734b9f8dc4920efe4d4cf7367b598a5f9cc4553e58
Jul 23 10:05:07.244919 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:07.244901    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 10:05:07.579035 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:07.578993    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h" event={"ID":"64200b18-0a1f-4286-bf6b-330552978930","Type":"ContainerStarted","Data":"9bb4dc4f8bc5757f6332f086ab404cc5100bc9771ca865c60866fefc6aa7159b"}
Jul 23 10:05:07.579222 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:07.579055    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h" event={"ID":"64200b18-0a1f-4286-bf6b-330552978930","Type":"ContainerStarted","Data":"4c5b5a4dd4a55c7a2376e3734b9f8dc4920efe4d4cf7367b598a5f9cc4553e58"}
Jul 23 10:05:07.596889 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:07.596831    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h" podStartSLOduration=1.350220873 podStartE2EDuration="1.59681163s" totalImagesPullingTime="246.590757ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:05:07.594649527 +0000 UTC m=+627.498337802" watchObservedRunningTime="2026-07-23 10:05:07.59681163 +0000 UTC m=+627.500499954"
Jul 23 10:05:13.070584 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.070536    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"]
Jul 23 10:05:13.074127 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.074102    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.077432 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.077405    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 23 10:05:13.085908 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.085877    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"]
Jul 23 10:05:13.091785 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.091753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7287fca-e47f-4818-b616-1544d89adc5c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.091942 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.091798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wktvg\" (UniqueName: \"kubernetes.io/projected/e7287fca-e47f-4818-b616-1544d89adc5c-kube-api-access-wktvg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.091942 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.091862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.092061 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.091932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.092061 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.091985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.092061 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.092002    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.124367 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.124330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:05:13.192877 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.192844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7287fca-e47f-4818-b616-1544d89adc5c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.193091 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.192889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wktvg\" (UniqueName: \"kubernetes.io/projected/e7287fca-e47f-4818-b616-1544d89adc5c-kube-api-access-wktvg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.193091 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.192927    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.193091 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.192955    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.193248 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.193122    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.193248 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.193155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.193504 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.193482    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.193557 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.193514    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.193633 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.193612    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.195505 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.195481    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7287fca-e47f-4818-b616-1544d89adc5c-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.195773 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.195751    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7287fca-e47f-4818-b616-1544d89adc5c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.204241 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.204215    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wktvg\" (UniqueName: \"kubernetes.io/projected/e7287fca-e47f-4818-b616-1544d89adc5c-kube-api-access-wktvg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-4czgc\" (UID: \"e7287fca-e47f-4818-b616-1544d89adc5c\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.386344 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.386307    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:13.544178 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.544138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"]
Jul 23 10:05:13.546939 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:05:13.546898    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7287fca_e47f_4818_b616_1544d89adc5c.slice/crio-096bf4458bbee2932bec469aec0bd9da027ea1f02b6e7ea2528c6542db06e3a9 WatchSource:0}: Error finding container 096bf4458bbee2932bec469aec0bd9da027ea1f02b6e7ea2528c6542db06e3a9: Status 404 returned error can't find the container with id 096bf4458bbee2932bec469aec0bd9da027ea1f02b6e7ea2528c6542db06e3a9
Jul 23 10:05:13.613453 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:13.613419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc" event={"ID":"e7287fca-e47f-4818-b616-1544d89adc5c","Type":"ContainerStarted","Data":"096bf4458bbee2932bec469aec0bd9da027ea1f02b6e7ea2528c6542db06e3a9"}
Jul 23 10:05:14.619342 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:14.619303    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc" event={"ID":"e7287fca-e47f-4818-b616-1544d89adc5c","Type":"ContainerStarted","Data":"b63d243dba554f38353d6c0a1ee454841324cbd3056efd0f04c0ebc55a2a042d"}
Jul 23 10:05:14.636469 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:14.636409    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc" podStartSLOduration=1.450464003 podStartE2EDuration="1.636393785s" totalImagesPullingTime="185.929782ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:05:14.636032966 +0000 UTC m=+634.539721255" watchObservedRunningTime="2026-07-23 10:05:14.636393785 +0000 UTC m=+634.540082058"
Jul 23 10:05:17.097098 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:17.097059    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:17.097638 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:17.097160    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:17.110696 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:17.110668    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:17.648135 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:17.648099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w8j6h"
Jul 23 10:05:23.387585 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:23.387538    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:23.388057 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:23.387606    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:23.400581 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:23.400549    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:23.678901 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:23.678811    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-4czgc"
Jul 23 10:05:28.415371 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:28.415337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:05:54.653188 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:54.653144    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-647997d7b4-c9zx8"]
Jul 23 10:05:54.653867 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:54.653424    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-647997d7b4-c9zx8" podUID="32fd7e4e-8704-4288-bd75-998bef7491e8" containerName="authorino" containerID="cri-o://b5bd9a6d07bab7a70cba3dd229e70d3b17d46c086a07832255d27ef5a2cc5791" gracePeriod=30
Jul 23 10:05:54.820870 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:54.820837    2564 generic.go:356] "Generic (PLEG): container finished" podID="32fd7e4e-8704-4288-bd75-998bef7491e8" containerID="b5bd9a6d07bab7a70cba3dd229e70d3b17d46c086a07832255d27ef5a2cc5791" exitCode=0
Jul 23 10:05:54.821046 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:54.820913    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647997d7b4-c9zx8" event={"ID":"32fd7e4e-8704-4288-bd75-998bef7491e8","Type":"ContainerDied","Data":"b5bd9a6d07bab7a70cba3dd229e70d3b17d46c086a07832255d27ef5a2cc5791"}
Jul 23 10:05:54.916059 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:54.915998    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647997d7b4-c9zx8"
Jul 23 10:05:54.989234 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:54.989197    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skbk7\" (UniqueName: \"kubernetes.io/projected/32fd7e4e-8704-4288-bd75-998bef7491e8-kube-api-access-skbk7\") pod \"32fd7e4e-8704-4288-bd75-998bef7491e8\" (UID: \"32fd7e4e-8704-4288-bd75-998bef7491e8\") "
Jul 23 10:05:54.989448 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:54.989289    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32fd7e4e-8704-4288-bd75-998bef7491e8-tls-cert\") pod \"32fd7e4e-8704-4288-bd75-998bef7491e8\" (UID: \"32fd7e4e-8704-4288-bd75-998bef7491e8\") "
Jul 23 10:05:54.991478 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:54.991440    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32fd7e4e-8704-4288-bd75-998bef7491e8-kube-api-access-skbk7" (OuterVolumeSpecName: "kube-api-access-skbk7") pod "32fd7e4e-8704-4288-bd75-998bef7491e8" (UID: "32fd7e4e-8704-4288-bd75-998bef7491e8"). InnerVolumeSpecName "kube-api-access-skbk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:05:55.000295 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:55.000266    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32fd7e4e-8704-4288-bd75-998bef7491e8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "32fd7e4e-8704-4288-bd75-998bef7491e8" (UID: "32fd7e4e-8704-4288-bd75-998bef7491e8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:05:55.090191 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:55.090151    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skbk7\" (UniqueName: \"kubernetes.io/projected/32fd7e4e-8704-4288-bd75-998bef7491e8-kube-api-access-skbk7\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:05:55.090191 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:55.090183    2564 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32fd7e4e-8704-4288-bd75-998bef7491e8-tls-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:05:55.202689 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:55.202606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:05:55.301097 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:55.301059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:05:55.828238 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:55.828213    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-647997d7b4-c9zx8"
Jul 23 10:05:55.828719 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:55.828279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-647997d7b4-c9zx8" event={"ID":"32fd7e4e-8704-4288-bd75-998bef7491e8","Type":"ContainerDied","Data":"fade6ab66b0a28812eba763787449a751a33f0aa599fbb5610de7a94953e6fdc"}
Jul 23 10:05:55.828719 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:55.828342    2564 scope.go:117] "RemoveContainer" containerID="b5bd9a6d07bab7a70cba3dd229e70d3b17d46c086a07832255d27ef5a2cc5791"
Jul 23 10:05:55.856591 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:55.856562    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-647997d7b4-c9zx8"]
Jul 23 10:05:55.863059 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:55.863029    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-647997d7b4-c9zx8"]
Jul 23 10:05:56.359852 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:56.359807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:05:56.457034 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:56.456996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:05:56.611011 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:05:56.610935    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32fd7e4e-8704-4288-bd75-998bef7491e8" path="/var/lib/kubelet/pods/32fd7e4e-8704-4288-bd75-998bef7491e8/volumes"
Jul 23 10:06:24.456732 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:24.456700    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:06:44.290338 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:44.290299    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-rwrs5"]
Jul 23 10:06:44.290825 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:44.290533    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-86975d4f4c-rwrs5" podUID="776c1989-6c64-4988-aa6f-cd186f7350f9" containerName="manager" containerID="cri-o://e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3" gracePeriod=30
Jul 23 10:06:44.558692 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:44.558665    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:06:44.638743 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:44.638702    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/776c1989-6c64-4988-aa6f-cd186f7350f9-webhook-cert\") pod \"776c1989-6c64-4988-aa6f-cd186f7350f9\" (UID: \"776c1989-6c64-4988-aa6f-cd186f7350f9\") "
Jul 23 10:06:44.638950 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:44.638752    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2lr5\" (UniqueName: \"kubernetes.io/projected/776c1989-6c64-4988-aa6f-cd186f7350f9-kube-api-access-d2lr5\") pod \"776c1989-6c64-4988-aa6f-cd186f7350f9\" (UID: \"776c1989-6c64-4988-aa6f-cd186f7350f9\") "
Jul 23 10:06:44.641054 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:44.641020    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/776c1989-6c64-4988-aa6f-cd186f7350f9-kube-api-access-d2lr5" (OuterVolumeSpecName: "kube-api-access-d2lr5") pod "776c1989-6c64-4988-aa6f-cd186f7350f9" (UID: "776c1989-6c64-4988-aa6f-cd186f7350f9"). InnerVolumeSpecName "kube-api-access-d2lr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:06:44.641174 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:44.641028    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/776c1989-6c64-4988-aa6f-cd186f7350f9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "776c1989-6c64-4988-aa6f-cd186f7350f9" (UID: "776c1989-6c64-4988-aa6f-cd186f7350f9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:06:44.740025 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:44.739982    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/776c1989-6c64-4988-aa6f-cd186f7350f9-webhook-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:06:44.740025 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:44.740011    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2lr5\" (UniqueName: \"kubernetes.io/projected/776c1989-6c64-4988-aa6f-cd186f7350f9-kube-api-access-d2lr5\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:06:45.073744 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:45.073704    2564 generic.go:356] "Generic (PLEG): container finished" podID="776c1989-6c64-4988-aa6f-cd186f7350f9" containerID="e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3" exitCode=0
Jul 23 10:06:45.073744 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:45.073746    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86975d4f4c-rwrs5"
Jul 23 10:06:45.073953 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:45.073787    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86975d4f4c-rwrs5" event={"ID":"776c1989-6c64-4988-aa6f-cd186f7350f9","Type":"ContainerDied","Data":"e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3"}
Jul 23 10:06:45.073953 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:45.073841    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86975d4f4c-rwrs5" event={"ID":"776c1989-6c64-4988-aa6f-cd186f7350f9","Type":"ContainerDied","Data":"09bb5a675d84ac6c2e9dc89a23257c9da1fa4a7821cd0fc78a5f8d0509a03cce"}
Jul 23 10:06:45.073953 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:45.073868    2564 scope.go:117] "RemoveContainer" containerID="e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3"
Jul 23 10:06:45.083219 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:45.083190    2564 scope.go:117] "RemoveContainer" containerID="e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3"
Jul 23 10:06:45.083552 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:06:45.083535    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3\": container with ID starting with e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3 not found: ID does not exist" containerID="e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3"
Jul 23 10:06:45.083614 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:45.083560    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3"} err="failed to get container status \"e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3\": rpc error: code = NotFound desc = could not find container \"e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3\": container with ID starting with e1ed2a17e0d9345d6264d28793d327cb44c6a00d5151722d0b4dc20256c7b7d3 not found: ID does not exist"
Jul 23 10:06:45.094812 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:45.094783    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-rwrs5"]
Jul 23 10:06:45.096450 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:45.096432    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-rwrs5"]
Jul 23 10:06:46.610867 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:46.610833    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="776c1989-6c64-4988-aa6f-cd186f7350f9" path="/var/lib/kubelet/pods/776c1989-6c64-4988-aa6f-cd186f7350f9/volumes"
Jul 23 10:06:51.348392 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:06:51.348356    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:07:20.383948 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:20.383917    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:07:35.349299 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:35.349241    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:07:45.960674 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.960641    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86975d4f4c-g2zfp"]
Jul 23 10:07:45.961053 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.961039    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="776c1989-6c64-4988-aa6f-cd186f7350f9" containerName="manager"
Jul 23 10:07:45.961053 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.961050    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="776c1989-6c64-4988-aa6f-cd186f7350f9" containerName="manager"
Jul 23 10:07:45.961133 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.961066    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32fd7e4e-8704-4288-bd75-998bef7491e8" containerName="authorino"
Jul 23 10:07:45.961133 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.961072    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="32fd7e4e-8704-4288-bd75-998bef7491e8" containerName="authorino"
Jul 23 10:07:45.961133 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.961124    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="776c1989-6c64-4988-aa6f-cd186f7350f9" containerName="manager"
Jul 23 10:07:45.961133 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.961133    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="32fd7e4e-8704-4288-bd75-998bef7491e8" containerName="authorino"
Jul 23 10:07:45.964960 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.964942    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:07:45.967941 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.967918    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 10:07:45.969106 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.969085    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 10:07:45.969106 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.969094    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jkv8t\""
Jul 23 10:07:45.974474 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:45.974447    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-g2zfp"]
Jul 23 10:07:46.130919 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:46.130880    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d34027b7-bc1d-456d-9d3c-ede92c22b389-webhook-cert\") pod \"maas-controller-86975d4f4c-g2zfp\" (UID: \"d34027b7-bc1d-456d-9d3c-ede92c22b389\") " pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:07:46.131106 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:46.130975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn6cz\" (UniqueName: \"kubernetes.io/projected/d34027b7-bc1d-456d-9d3c-ede92c22b389-kube-api-access-zn6cz\") pod \"maas-controller-86975d4f4c-g2zfp\" (UID: \"d34027b7-bc1d-456d-9d3c-ede92c22b389\") " pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:07:46.231602 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:46.231494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d34027b7-bc1d-456d-9d3c-ede92c22b389-webhook-cert\") pod \"maas-controller-86975d4f4c-g2zfp\" (UID: \"d34027b7-bc1d-456d-9d3c-ede92c22b389\") " pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:07:46.231602 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:46.231579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn6cz\" (UniqueName: \"kubernetes.io/projected/d34027b7-bc1d-456d-9d3c-ede92c22b389-kube-api-access-zn6cz\") pod \"maas-controller-86975d4f4c-g2zfp\" (UID: \"d34027b7-bc1d-456d-9d3c-ede92c22b389\") " pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:07:46.234196 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:46.234170    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d34027b7-bc1d-456d-9d3c-ede92c22b389-webhook-cert\") pod \"maas-controller-86975d4f4c-g2zfp\" (UID: \"d34027b7-bc1d-456d-9d3c-ede92c22b389\") " pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:07:46.262369 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:46.262339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn6cz\" (UniqueName: \"kubernetes.io/projected/d34027b7-bc1d-456d-9d3c-ede92c22b389-kube-api-access-zn6cz\") pod \"maas-controller-86975d4f4c-g2zfp\" (UID: \"d34027b7-bc1d-456d-9d3c-ede92c22b389\") " pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:07:46.276338 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:46.276311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:07:46.418003 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:46.417977    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-g2zfp"]
Jul 23 10:07:46.419749 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:07:46.419724    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34027b7_bc1d_456d_9d3c_ede92c22b389.slice/crio-832a1caaaceba0d9bbcb03b2bad28ee08590a369b67b66b74969bdf37d98f7c1 WatchSource:0}: Error finding container 832a1caaaceba0d9bbcb03b2bad28ee08590a369b67b66b74969bdf37d98f7c1: Status 404 returned error can't find the container with id 832a1caaaceba0d9bbcb03b2bad28ee08590a369b67b66b74969bdf37d98f7c1
Jul 23 10:07:47.387607 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:47.387562    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86975d4f4c-g2zfp" event={"ID":"d34027b7-bc1d-456d-9d3c-ede92c22b389","Type":"ContainerStarted","Data":"2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d"}
Jul 23 10:07:47.388025 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:47.387752    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:07:47.388025 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:47.387799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86975d4f4c-g2zfp" event={"ID":"d34027b7-bc1d-456d-9d3c-ede92c22b389","Type":"ContainerStarted","Data":"832a1caaaceba0d9bbcb03b2bad28ee08590a369b67b66b74969bdf37d98f7c1"}
Jul 23 10:07:47.445119 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:47.445066    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86975d4f4c-g2zfp" podStartSLOduration=2.046261076 podStartE2EDuration="2.445050051s" totalImagesPullingTime="398.788975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:07:47.44238482 +0000 UTC m=+787.346073093" watchObservedRunningTime="2026-07-23 10:07:47.445050051 +0000 UTC m=+787.348738382"
Jul 23 10:07:55.920248 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:55.920186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:07:58.394859 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:07:58.394823    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:08:02.947816 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:02.947726    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:03.047057 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.047019    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-g2zfp"]
Jul 23 10:08:03.047242 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.047213    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-86975d4f4c-g2zfp" podUID="d34027b7-bc1d-456d-9d3c-ede92c22b389" containerName="manager" containerID="cri-o://2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d" gracePeriod=30
Jul 23 10:08:03.306840 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.306811    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:08:03.465704 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.465670    2564 generic.go:356] "Generic (PLEG): container finished" podID="d34027b7-bc1d-456d-9d3c-ede92c22b389" containerID="2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d" exitCode=0
Jul 23 10:08:03.465917 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.465721    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86975d4f4c-g2zfp"
Jul 23 10:08:03.465917 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.465725    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86975d4f4c-g2zfp" event={"ID":"d34027b7-bc1d-456d-9d3c-ede92c22b389","Type":"ContainerDied","Data":"2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d"}
Jul 23 10:08:03.465917 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.465847    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86975d4f4c-g2zfp" event={"ID":"d34027b7-bc1d-456d-9d3c-ede92c22b389","Type":"ContainerDied","Data":"832a1caaaceba0d9bbcb03b2bad28ee08590a369b67b66b74969bdf37d98f7c1"}
Jul 23 10:08:03.465917 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.465876    2564 scope.go:117] "RemoveContainer" containerID="2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d"
Jul 23 10:08:03.474642 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.474604    2564 scope.go:117] "RemoveContainer" containerID="2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d"
Jul 23 10:08:03.474888 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:08:03.474868    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d\": container with ID starting with 2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d not found: ID does not exist" containerID="2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d"
Jul 23 10:08:03.474946 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.474899    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d"} err="failed to get container status \"2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d\": rpc error: code = NotFound desc = could not find container \"2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d\": container with ID starting with 2ef43508f72378337e64ccdd23c9824b1cfd6eb888bd7787cab58309f2c4897d not found: ID does not exist"
Jul 23 10:08:03.489551 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.489520    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d34027b7-bc1d-456d-9d3c-ede92c22b389-webhook-cert\") pod \"d34027b7-bc1d-456d-9d3c-ede92c22b389\" (UID: \"d34027b7-bc1d-456d-9d3c-ede92c22b389\") "
Jul 23 10:08:03.489661 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.489640    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn6cz\" (UniqueName: \"kubernetes.io/projected/d34027b7-bc1d-456d-9d3c-ede92c22b389-kube-api-access-zn6cz\") pod \"d34027b7-bc1d-456d-9d3c-ede92c22b389\" (UID: \"d34027b7-bc1d-456d-9d3c-ede92c22b389\") "
Jul 23 10:08:03.491723 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.491694    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34027b7-bc1d-456d-9d3c-ede92c22b389-kube-api-access-zn6cz" (OuterVolumeSpecName: "kube-api-access-zn6cz") pod "d34027b7-bc1d-456d-9d3c-ede92c22b389" (UID: "d34027b7-bc1d-456d-9d3c-ede92c22b389"). InnerVolumeSpecName "kube-api-access-zn6cz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:08:03.491837 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.491726    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34027b7-bc1d-456d-9d3c-ede92c22b389-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d34027b7-bc1d-456d-9d3c-ede92c22b389" (UID: "d34027b7-bc1d-456d-9d3c-ede92c22b389"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:08:03.591181 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.591143    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn6cz\" (UniqueName: \"kubernetes.io/projected/d34027b7-bc1d-456d-9d3c-ede92c22b389-kube-api-access-zn6cz\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:08:03.591181 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.591176    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d34027b7-bc1d-456d-9d3c-ede92c22b389-webhook-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:08:03.788234 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.788201    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-g2zfp"]
Jul 23 10:08:03.792658 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:03.792624    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-g2zfp"]
Jul 23 10:08:04.471458 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.471416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:04.578948 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.578904    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86975d4f4c-cnwjz"]
Jul 23 10:08:04.579344 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.579330    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34027b7-bc1d-456d-9d3c-ede92c22b389" containerName="manager"
Jul 23 10:08:04.579344 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.579345    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34027b7-bc1d-456d-9d3c-ede92c22b389" containerName="manager"
Jul 23 10:08:04.579444 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.579412    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34027b7-bc1d-456d-9d3c-ede92c22b389" containerName="manager"
Jul 23 10:08:04.582469 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.582447    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86975d4f4c-cnwjz"
Jul 23 10:08:04.587669 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.587650    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 10:08:04.587669 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.587651    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 10:08:04.587832 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.587653    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jkv8t\""
Jul 23 10:08:04.591983 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.591948    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-cnwjz"]
Jul 23 10:08:04.600760 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.600730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd2sd\" (UniqueName: \"kubernetes.io/projected/dad07cc9-124c-473c-90b3-9c7596489290-kube-api-access-sd2sd\") pod \"maas-controller-86975d4f4c-cnwjz\" (UID: \"dad07cc9-124c-473c-90b3-9c7596489290\") " pod="opendatahub/maas-controller-86975d4f4c-cnwjz"
Jul 23 10:08:04.600912 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.600772    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dad07cc9-124c-473c-90b3-9c7596489290-webhook-cert\") pod \"maas-controller-86975d4f4c-cnwjz\" (UID: \"dad07cc9-124c-473c-90b3-9c7596489290\") " pod="opendatahub/maas-controller-86975d4f4c-cnwjz"
Jul 23 10:08:04.612613 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.612580    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d34027b7-bc1d-456d-9d3c-ede92c22b389" path="/var/lib/kubelet/pods/d34027b7-bc1d-456d-9d3c-ede92c22b389/volumes"
Jul 23 10:08:04.701233 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.701177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd2sd\" (UniqueName: \"kubernetes.io/projected/dad07cc9-124c-473c-90b3-9c7596489290-kube-api-access-sd2sd\") pod \"maas-controller-86975d4f4c-cnwjz\" (UID: \"dad07cc9-124c-473c-90b3-9c7596489290\") " pod="opendatahub/maas-controller-86975d4f4c-cnwjz"
Jul 23 10:08:04.701233 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.701237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dad07cc9-124c-473c-90b3-9c7596489290-webhook-cert\") pod \"maas-controller-86975d4f4c-cnwjz\" (UID: \"dad07cc9-124c-473c-90b3-9c7596489290\") " pod="opendatahub/maas-controller-86975d4f4c-cnwjz"
Jul 23 10:08:04.703870 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.703844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dad07cc9-124c-473c-90b3-9c7596489290-webhook-cert\") pod \"maas-controller-86975d4f4c-cnwjz\" (UID: \"dad07cc9-124c-473c-90b3-9c7596489290\") " pod="opendatahub/maas-controller-86975d4f4c-cnwjz"
Jul 23 10:08:04.710670 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.710636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd2sd\" (UniqueName: \"kubernetes.io/projected/dad07cc9-124c-473c-90b3-9c7596489290-kube-api-access-sd2sd\") pod \"maas-controller-86975d4f4c-cnwjz\" (UID: \"dad07cc9-124c-473c-90b3-9c7596489290\") " pod="opendatahub/maas-controller-86975d4f4c-cnwjz"
Jul 23 10:08:04.894427 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:04.894393    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86975d4f4c-cnwjz"
Jul 23 10:08:05.037232 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:05.037209    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86975d4f4c-cnwjz"]
Jul 23 10:08:05.039359 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:08:05.039329    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad07cc9_124c_473c_90b3_9c7596489290.slice/crio-918625afb5950078e74aa20a5af381e76f7fa712d3a7d6638e0d663f9ceb0e2c WatchSource:0}: Error finding container 918625afb5950078e74aa20a5af381e76f7fa712d3a7d6638e0d663f9ceb0e2c: Status 404 returned error can't find the container with id 918625afb5950078e74aa20a5af381e76f7fa712d3a7d6638e0d663f9ceb0e2c
Jul 23 10:08:05.477544 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:05.477506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86975d4f4c-cnwjz" event={"ID":"dad07cc9-124c-473c-90b3-9c7596489290","Type":"ContainerStarted","Data":"918625afb5950078e74aa20a5af381e76f7fa712d3a7d6638e0d663f9ceb0e2c"}
Jul 23 10:08:06.483761 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:06.483727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86975d4f4c-cnwjz" event={"ID":"dad07cc9-124c-473c-90b3-9c7596489290","Type":"ContainerStarted","Data":"e0f49bc0a68d4aa73bbff221a0dcb667eb2bc05be6d4089435252018436520f3"}
Jul 23 10:08:06.484151 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:06.483841    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86975d4f4c-cnwjz"
Jul 23 10:08:06.504160 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:06.504108    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86975d4f4c-cnwjz" podStartSLOduration=1.678820774 podStartE2EDuration="2.504089254s" totalImagesPullingTime="825.26848ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:08:06.503581983 +0000 UTC m=+806.407270257" watchObservedRunningTime="2026-07-23 10:08:06.504089254 +0000 UTC m=+806.407777527"
Jul 23 10:08:17.490670 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:17.490637    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86975d4f4c-cnwjz"
Jul 23 10:08:30.855966 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:30.855933    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:30.918079 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:30.918044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:40.820550 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:40.820506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:40.946446 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:40.946413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:41.064097 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:41.064063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:48.105080 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:48.105037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:48.225194 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:48.225163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:48.339389 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:48.339360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:48.485625 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:48.485593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:54.248882 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:54.248843    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:08:54.348337 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:08:54.348302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:09:40.573882 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:09:40.573852    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:09:40.579150 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:09:40.579127    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:12:17.461884 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:17.461852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:12:51.917735 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:51.917699    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"]
Jul 23 10:12:51.918667 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:51.918614    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw" podUID="189ab051-bd3c-427c-b3ba-d6761d7753f8" containerName="manager" containerID="cri-o://ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a" gracePeriod=10
Jul 23 10:12:55.084921 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.084894    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:12:55.156449 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.156421    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxmhc\" (UniqueName: \"kubernetes.io/projected/189ab051-bd3c-427c-b3ba-d6761d7753f8-kube-api-access-gxmhc\") pod \"189ab051-bd3c-427c-b3ba-d6761d7753f8\" (UID: \"189ab051-bd3c-427c-b3ba-d6761d7753f8\") "
Jul 23 10:12:55.156601 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.156534    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/189ab051-bd3c-427c-b3ba-d6761d7753f8-extensions-socket-volume\") pod \"189ab051-bd3c-427c-b3ba-d6761d7753f8\" (UID: \"189ab051-bd3c-427c-b3ba-d6761d7753f8\") "
Jul 23 10:12:55.156891 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.156865    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/189ab051-bd3c-427c-b3ba-d6761d7753f8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "189ab051-bd3c-427c-b3ba-d6761d7753f8" (UID: "189ab051-bd3c-427c-b3ba-d6761d7753f8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:12:55.158494 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.158465    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/189ab051-bd3c-427c-b3ba-d6761d7753f8-kube-api-access-gxmhc" (OuterVolumeSpecName: "kube-api-access-gxmhc") pod "189ab051-bd3c-427c-b3ba-d6761d7753f8" (UID: "189ab051-bd3c-427c-b3ba-d6761d7753f8"). InnerVolumeSpecName "kube-api-access-gxmhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:12:55.257963 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.257878    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/189ab051-bd3c-427c-b3ba-d6761d7753f8-extensions-socket-volume\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:12:55.257963 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.257908    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxmhc\" (UniqueName: \"kubernetes.io/projected/189ab051-bd3c-427c-b3ba-d6761d7753f8-kube-api-access-gxmhc\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:12:55.901197 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.901160    2564 generic.go:356] "Generic (PLEG): container finished" podID="189ab051-bd3c-427c-b3ba-d6761d7753f8" containerID="ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a" exitCode=0
Jul 23 10:12:55.901407 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.901205    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"
Jul 23 10:12:55.901407 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.901211    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw" event={"ID":"189ab051-bd3c-427c-b3ba-d6761d7753f8","Type":"ContainerDied","Data":"ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a"}
Jul 23 10:12:55.901407 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.901282    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw" event={"ID":"189ab051-bd3c-427c-b3ba-d6761d7753f8","Type":"ContainerDied","Data":"c89a92eb4d3bc5bb274c33314fee33a0bda5e8faeb0c5816c5c2179f6425964b"}
Jul 23 10:12:55.901407 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.901312    2564 scope.go:117] "RemoveContainer" containerID="ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a"
Jul 23 10:12:55.912339 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.912320    2564 scope.go:117] "RemoveContainer" containerID="ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a"
Jul 23 10:12:55.912579 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:12:55.912560    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a\": container with ID starting with ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a not found: ID does not exist" containerID="ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a"
Jul 23 10:12:55.912621 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.912588    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a"} err="failed to get container status \"ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a\": rpc error: code = NotFound desc = could not find container \"ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a\": container with ID starting with ce9f7a3e741b39b9a5c9a528a2b62a27c535676b48f4b07db591a6c980acc50a not found: ID does not exist"
Jul 23 10:12:55.923784 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.923764    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"]
Jul 23 10:12:55.927768 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:55.927742    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2jchw"]
Jul 23 10:12:56.615823 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:12:56.615781    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="189ab051-bd3c-427c-b3ba-d6761d7753f8" path="/var/lib/kubelet/pods/189ab051-bd3c-427c-b3ba-d6761d7753f8/volumes"
Jul 23 10:13:53.078306 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.078275    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"]
Jul 23 10:13:53.078692 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.078641    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="189ab051-bd3c-427c-b3ba-d6761d7753f8" containerName="manager"
Jul 23 10:13:53.078692 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.078653    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="189ab051-bd3c-427c-b3ba-d6761d7753f8" containerName="manager"
Jul 23 10:13:53.078767 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.078727    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="189ab051-bd3c-427c-b3ba-d6761d7753f8" containerName="manager"
Jul 23 10:13:53.082988 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.082969    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"
Jul 23 10:13:53.087547 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.087527    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7jndm\""
Jul 23 10:13:53.112962 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.112933    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"]
Jul 23 10:13:53.182785 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.182753    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5354fadc-4089-4074-9f4b-d1ca26af1b91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z9lcx\" (UID: \"5354fadc-4089-4074-9f4b-d1ca26af1b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"
Jul 23 10:13:53.182973 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.182794    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bdlp\" (UniqueName: \"kubernetes.io/projected/5354fadc-4089-4074-9f4b-d1ca26af1b91-kube-api-access-2bdlp\") pod \"kuadrant-operator-controller-manager-86878c769f-z9lcx\" (UID: \"5354fadc-4089-4074-9f4b-d1ca26af1b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"
Jul 23 10:13:53.283821 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.283786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5354fadc-4089-4074-9f4b-d1ca26af1b91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z9lcx\" (UID: \"5354fadc-4089-4074-9f4b-d1ca26af1b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"
Jul 23 10:13:53.283821 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.283822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bdlp\" (UniqueName: \"kubernetes.io/projected/5354fadc-4089-4074-9f4b-d1ca26af1b91-kube-api-access-2bdlp\") pod \"kuadrant-operator-controller-manager-86878c769f-z9lcx\" (UID: \"5354fadc-4089-4074-9f4b-d1ca26af1b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"
Jul 23 10:13:53.284215 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.284190    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5354fadc-4089-4074-9f4b-d1ca26af1b91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-z9lcx\" (UID: \"5354fadc-4089-4074-9f4b-d1ca26af1b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"
Jul 23 10:13:53.297728 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.297701    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bdlp\" (UniqueName: \"kubernetes.io/projected/5354fadc-4089-4074-9f4b-d1ca26af1b91-kube-api-access-2bdlp\") pod \"kuadrant-operator-controller-manager-86878c769f-z9lcx\" (UID: \"5354fadc-4089-4074-9f4b-d1ca26af1b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"
Jul 23 10:13:53.392812 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.392774    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"
Jul 23 10:13:53.545427 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:53.545381    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"]
Jul 23 10:13:53.548029 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:13:53.548006    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5354fadc_4089_4074_9f4b_d1ca26af1b91.slice/crio-aafd5a01dde813da7d3d93df94ec89ad09cdee34645aedbe06cf45ef86786cec WatchSource:0}: Error finding container aafd5a01dde813da7d3d93df94ec89ad09cdee34645aedbe06cf45ef86786cec: Status 404 returned error can't find the container with id aafd5a01dde813da7d3d93df94ec89ad09cdee34645aedbe06cf45ef86786cec
Jul 23 10:13:54.184648 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:54.184609    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx" event={"ID":"5354fadc-4089-4074-9f4b-d1ca26af1b91","Type":"ContainerStarted","Data":"025bdf59e063ac44d832354bf447880c70394be0f289d12700285ba9a743fa10"}
Jul 23 10:13:54.185018 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:54.184689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx" event={"ID":"5354fadc-4089-4074-9f4b-d1ca26af1b91","Type":"ContainerStarted","Data":"aafd5a01dde813da7d3d93df94ec89ad09cdee34645aedbe06cf45ef86786cec"}
Jul 23 10:13:54.185018 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:54.184718    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"
Jul 23 10:13:54.205315 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:13:54.205244    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx" podStartSLOduration=1.20523078 podStartE2EDuration="1.20523078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:13:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:13:54.203460921 +0000 UTC m=+1154.107149196" watchObservedRunningTime="2026-07-23 10:13:54.20523078 +0000 UTC m=+1154.108919118"
Jul 23 10:14:05.192278 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:14:05.192178    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-z9lcx"
Jul 23 10:14:40.605960 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:14:40.605931    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:14:40.615755 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:14:40.615726    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:15:09.930045 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:15:09.930005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:16:33.860726 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:16:33.860694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:16:46.212885 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:16:46.212837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:17:01.689129 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.689043    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"]
Jul 23 10:17:01.693492 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.693471    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.696312 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.696286    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-74f8816a-kserve-self-signed-certs\""
Jul 23 10:17:01.706343 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.705537    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"]
Jul 23 10:17:01.727870 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.727833    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:17:01.774562 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.774526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-tmp-dir\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.774562 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.774562    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc7j2\" (UniqueName: \"kubernetes.io/projected/326c907a-0fce-433c-9baf-f09986322998-kube-api-access-tc7j2\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.774758 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.774592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-home\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.774758 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.774688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/326c907a-0fce-433c-9baf-f09986322998-tls-certs\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.774758 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.774750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-dshm\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.774858 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.774778    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-model-cache\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.875771 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.875733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-dshm\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.875965 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.875784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-model-cache\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.875965 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.875903    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-tmp-dir\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.875965 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.875938    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc7j2\" (UniqueName: \"kubernetes.io/projected/326c907a-0fce-433c-9baf-f09986322998-kube-api-access-tc7j2\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.876145 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.876041    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-home\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.876145 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.876110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/326c907a-0fce-433c-9baf-f09986322998-tls-certs\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.876145 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.876143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-model-cache\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.876324 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.876235    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-tmp-dir\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.876432 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.876415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-home\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.878240 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.878219    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-dshm\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.878593 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.878573    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/326c907a-0fce-433c-9baf-f09986322998-tls-certs\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:01.885178 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:01.885157    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc7j2\" (UniqueName: \"kubernetes.io/projected/326c907a-0fce-433c-9baf-f09986322998-kube-api-access-tc7j2\") pod \"e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") " pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:02.004579 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:02.004498    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:02.147862 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:02.147836    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"]
Jul 23 10:17:02.150236 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:17:02.150210    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod326c907a_0fce_433c_9baf_f09986322998.slice/crio-26702acf3c8fc75c0769c2b243342c25c278cee70b336c1f1080cc6f9f1bdcc4 WatchSource:0}: Error finding container 26702acf3c8fc75c0769c2b243342c25c278cee70b336c1f1080cc6f9f1bdcc4: Status 404 returned error can't find the container with id 26702acf3c8fc75c0769c2b243342c25c278cee70b336c1f1080cc6f9f1bdcc4
Jul 23 10:17:02.271305 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:02.271197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:17:02.368688 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:02.368653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:17:03.111197 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:03.111161    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps" event={"ID":"326c907a-0fce-433c-9baf-f09986322998","Type":"ContainerStarted","Data":"fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122"}
Jul 23 10:17:03.111197 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:03.111199    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps" event={"ID":"326c907a-0fce-433c-9baf-f09986322998","Type":"ContainerStarted","Data":"26702acf3c8fc75c0769c2b243342c25c278cee70b336c1f1080cc6f9f1bdcc4"}
Jul 23 10:17:03.130319 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:03.130247    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps" podStartSLOduration=2.130232607 podStartE2EDuration="2.130232607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:17:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:17:03.128614874 +0000 UTC m=+1343.032303165" watchObservedRunningTime="2026-07-23 10:17:03.130232607 +0000 UTC m=+1343.033920880"
Jul 23 10:17:12.005574 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:12.005538    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:12.006089 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:12.005825    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:12.018566 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:12.018539    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:12.175778 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:12.175753    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:18.428039 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:18.428001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:17:19.973200 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:19.973161    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"]
Jul 23 10:17:19.997899 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:19.997868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:17:34.994084 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:34.994025    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps" podUID="326c907a-0fce-433c-9baf-f09986322998" containerName="main" containerID="cri-o://fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122" gracePeriod=45
Jul 23 10:17:35.250425 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.250370    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:35.278810 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.278779    2564 generic.go:356] "Generic (PLEG): container finished" podID="326c907a-0fce-433c-9baf-f09986322998" containerID="fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122" exitCode=0
Jul 23 10:17:35.278968 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.278830    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"
Jul 23 10:17:35.278968 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.278843    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps" event={"ID":"326c907a-0fce-433c-9baf-f09986322998","Type":"ContainerDied","Data":"fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122"}
Jul 23 10:17:35.278968 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.278881    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps" event={"ID":"326c907a-0fce-433c-9baf-f09986322998","Type":"ContainerDied","Data":"26702acf3c8fc75c0769c2b243342c25c278cee70b336c1f1080cc6f9f1bdcc4"}
Jul 23 10:17:35.278968 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.278905    2564 scope.go:117] "RemoveContainer" containerID="fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122"
Jul 23 10:17:35.289563 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.289544    2564 scope.go:117] "RemoveContainer" containerID="fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122"
Jul 23 10:17:35.289848 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:17:35.289826    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122\": container with ID starting with fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122 not found: ID does not exist" containerID="fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122"
Jul 23 10:17:35.289891 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.289856    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122"} err="failed to get container status \"fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122\": rpc error: code = NotFound desc = could not find container \"fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122\": container with ID starting with fca2f49b552b517e6c07fe46c3cd96856aae9dc0e1a35932bb2d7c0f67513122 not found: ID does not exist"
Jul 23 10:17:35.382965 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.382936    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-dshm\") pod \"326c907a-0fce-433c-9baf-f09986322998\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") "
Jul 23 10:17:35.382965 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.382975    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-model-cache\") pod \"326c907a-0fce-433c-9baf-f09986322998\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") "
Jul 23 10:17:35.383220 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.383021    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/326c907a-0fce-433c-9baf-f09986322998-tls-certs\") pod \"326c907a-0fce-433c-9baf-f09986322998\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") "
Jul 23 10:17:35.383220 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.383054    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-tmp-dir\") pod \"326c907a-0fce-433c-9baf-f09986322998\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") "
Jul 23 10:17:35.383220 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.383105    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tc7j2\" (UniqueName: \"kubernetes.io/projected/326c907a-0fce-433c-9baf-f09986322998-kube-api-access-tc7j2\") pod \"326c907a-0fce-433c-9baf-f09986322998\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") "
Jul 23 10:17:35.383220 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.383129    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-home\") pod \"326c907a-0fce-433c-9baf-f09986322998\" (UID: \"326c907a-0fce-433c-9baf-f09986322998\") "
Jul 23 10:17:35.383406 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.383336    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-model-cache" (OuterVolumeSpecName: "model-cache") pod "326c907a-0fce-433c-9baf-f09986322998" (UID: "326c907a-0fce-433c-9baf-f09986322998"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:17:35.383406 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.383351    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "326c907a-0fce-433c-9baf-f09986322998" (UID: "326c907a-0fce-433c-9baf-f09986322998"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:17:35.383512 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.383474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-home" (OuterVolumeSpecName: "home") pod "326c907a-0fce-433c-9baf-f09986322998" (UID: "326c907a-0fce-433c-9baf-f09986322998"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:17:35.383560 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.383531    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-model-cache\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:17:35.383560 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.383543    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-tmp-dir\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:17:35.385577 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.385545    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-dshm" (OuterVolumeSpecName: "dshm") pod "326c907a-0fce-433c-9baf-f09986322998" (UID: "326c907a-0fce-433c-9baf-f09986322998"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:17:35.385577 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.385548    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/326c907a-0fce-433c-9baf-f09986322998-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "326c907a-0fce-433c-9baf-f09986322998" (UID: "326c907a-0fce-433c-9baf-f09986322998"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:17:35.385729 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.385646    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/326c907a-0fce-433c-9baf-f09986322998-kube-api-access-tc7j2" (OuterVolumeSpecName: "kube-api-access-tc7j2") pod "326c907a-0fce-433c-9baf-f09986322998" (UID: "326c907a-0fce-433c-9baf-f09986322998"). InnerVolumeSpecName "kube-api-access-tc7j2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:17:35.484402 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.484363    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-dshm\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:17:35.484402 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.484394    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/326c907a-0fce-433c-9baf-f09986322998-tls-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:17:35.484402 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.484405    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tc7j2\" (UniqueName: \"kubernetes.io/projected/326c907a-0fce-433c-9baf-f09986322998-kube-api-access-tc7j2\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:17:35.484636 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.484414    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/326c907a-0fce-433c-9baf-f09986322998-home\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:17:35.605385 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.603975    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"]
Jul 23 10:17:35.610243 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:35.610216    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-74f8816a-kserve-57b749f77f-mk5ps"]
Jul 23 10:17:36.611133 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:17:36.611096    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="326c907a-0fce-433c-9baf-f09986322998" path="/var/lib/kubelet/pods/326c907a-0fce-433c-9baf-f09986322998/volumes"
Jul 23 10:19:40.651832 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:19:40.651803    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:19:40.652701 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:19:40.652686    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:20:25.044806 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:20:25.044776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:20:47.697237 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:20:47.697207    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:20:50.803803 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:20:50.803766    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:20:50.900115 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:20:50.900087    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:20:51.242488 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:20:51.242451    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:20:57.168981 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:20:57.168947    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:20:57.228532 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:20:57.228501    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:20:57.403981 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:20:57.403950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:20:57.717178 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:20:57.717143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:20:58.267900 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:20:58.267866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:00.236011 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.235970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:00.337764 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.337729    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"]
Jul 23 10:21:00.338396 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.338374    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="326c907a-0fce-433c-9baf-f09986322998" containerName="main"
Jul 23 10:21:00.338486 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.338400    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="326c907a-0fce-433c-9baf-f09986322998" containerName="main"
Jul 23 10:21:00.338546 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.338495    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="326c907a-0fce-433c-9baf-f09986322998" containerName="main"
Jul 23 10:21:00.339469 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.339442    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:00.341906 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.341885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:00.344910 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.344888    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fc7ad5db-serving-cert\""
Jul 23 10:21:00.351796 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.351773    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"]
Jul 23 10:21:00.430751 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.430705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:00.438921 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.438888    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b120e3f-81db-4f72-8f48-6c52797b60a7-maas-api-tls\") pod \"maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:00.439075 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.438972    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59lc5\" (UniqueName: \"kubernetes.io/projected/4b120e3f-81db-4f72-8f48-6c52797b60a7-kube-api-access-59lc5\") pod \"maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:00.439075 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.439016    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b120e3f-81db-4f72-8f48-6c52797b60a7-openshift-service-ca\") pod \"maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:00.540439 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.540353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59lc5\" (UniqueName: \"kubernetes.io/projected/4b120e3f-81db-4f72-8f48-6c52797b60a7-kube-api-access-59lc5\") pod \"maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:00.540439 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.540399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b120e3f-81db-4f72-8f48-6c52797b60a7-openshift-service-ca\") pod \"maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:00.540733 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.540458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b120e3f-81db-4f72-8f48-6c52797b60a7-maas-api-tls\") pod \"maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:00.540733 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:21:00.540599    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-serving-cert: secret "maas-api-e2e-ait-fc7ad5db-serving-cert" not found
Jul 23 10:21:00.540733 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:21:00.540664    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b120e3f-81db-4f72-8f48-6c52797b60a7-maas-api-tls podName:4b120e3f-81db-4f72-8f48-6c52797b60a7 nodeName:}" failed. No retries permitted until 2026-07-23 10:21:01.040644855 +0000 UTC m=+1580.944333113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4b120e3f-81db-4f72-8f48-6c52797b60a7-maas-api-tls") pod "maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9" (UID: "4b120e3f-81db-4f72-8f48-6c52797b60a7") : secret "maas-api-e2e-ait-fc7ad5db-serving-cert" not found
Jul 23 10:21:00.541167 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.541143    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b120e3f-81db-4f72-8f48-6c52797b60a7-openshift-service-ca\") pod \"maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:00.556594 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.556566    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59lc5\" (UniqueName: \"kubernetes.io/projected/4b120e3f-81db-4f72-8f48-6c52797b60a7-kube-api-access-59lc5\") pod \"maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:00.896209 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.896171    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:00.997117 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:00.997076    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:01.046642 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:01.046612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b120e3f-81db-4f72-8f48-6c52797b60a7-maas-api-tls\") pod \"maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:01.049137 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:01.049119    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b120e3f-81db-4f72-8f48-6c52797b60a7-maas-api-tls\") pod \"maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:01.097948 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:01.097915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:01.254895 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:01.254817    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:01.403870 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:01.403848    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"]
Jul 23 10:21:01.405908 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:21:01.405885    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b120e3f_81db_4f72_8f48_6c52797b60a7.slice/crio-40e8b013b37e1f91a0a73987ef05312571c26325d96360940be47b52a8a490d0 WatchSource:0}: Error finding container 40e8b013b37e1f91a0a73987ef05312571c26325d96360940be47b52a8a490d0: Status 404 returned error can't find the container with id 40e8b013b37e1f91a0a73987ef05312571c26325d96360940be47b52a8a490d0
Jul 23 10:21:01.407190 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:01.407172    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 10:21:02.294858 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:02.294776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9" event={"ID":"4b120e3f-81db-4f72-8f48-6c52797b60a7","Type":"ContainerStarted","Data":"67e051e4286e9fc4f853e964d46dffb46717c00783bf8fb3d75a9d3cf8dda3ac"}
Jul 23 10:21:02.294858 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:02.294828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9" event={"ID":"4b120e3f-81db-4f72-8f48-6c52797b60a7","Type":"ContainerStarted","Data":"40e8b013b37e1f91a0a73987ef05312571c26325d96360940be47b52a8a490d0"}
Jul 23 10:21:02.294858 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:02.294852    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:02.324518 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:02.324472    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9" podStartSLOduration=1.7883623210000001 podStartE2EDuration="2.32445642s" totalImagesPullingTime="536.094099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:21:02.322673749 +0000 UTC m=+1582.226362032" watchObservedRunningTime="2026-07-23 10:21:02.32445642 +0000 UTC m=+1582.228144694"
Jul 23 10:21:08.305696 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:08.305665    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:36.226806 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.226738    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"]
Jul 23 10:21:36.227444 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.227027    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9" podUID="4b120e3f-81db-4f72-8f48-6c52797b60a7" containerName="maas-api" containerID="cri-o://67e051e4286e9fc4f853e964d46dffb46717c00783bf8fb3d75a9d3cf8dda3ac" gracePeriod=30
Jul 23 10:21:36.247103 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.247077    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:36.465154 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.465125    2564 generic.go:356] "Generic (PLEG): container finished" podID="4b120e3f-81db-4f72-8f48-6c52797b60a7" containerID="67e051e4286e9fc4f853e964d46dffb46717c00783bf8fb3d75a9d3cf8dda3ac" exitCode=0
Jul 23 10:21:36.465289 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.465178    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9" event={"ID":"4b120e3f-81db-4f72-8f48-6c52797b60a7","Type":"ContainerDied","Data":"67e051e4286e9fc4f853e964d46dffb46717c00783bf8fb3d75a9d3cf8dda3ac"}
Jul 23 10:21:36.483809 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.483743    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:36.588616 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.588576    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59lc5\" (UniqueName: \"kubernetes.io/projected/4b120e3f-81db-4f72-8f48-6c52797b60a7-kube-api-access-59lc5\") pod \"4b120e3f-81db-4f72-8f48-6c52797b60a7\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") "
Jul 23 10:21:36.588616 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.588632    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b120e3f-81db-4f72-8f48-6c52797b60a7-openshift-service-ca\") pod \"4b120e3f-81db-4f72-8f48-6c52797b60a7\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") "
Jul 23 10:21:36.588890 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.588734    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b120e3f-81db-4f72-8f48-6c52797b60a7-maas-api-tls\") pod \"4b120e3f-81db-4f72-8f48-6c52797b60a7\" (UID: \"4b120e3f-81db-4f72-8f48-6c52797b60a7\") "
Jul 23 10:21:36.589016 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.588993    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b120e3f-81db-4f72-8f48-6c52797b60a7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4b120e3f-81db-4f72-8f48-6c52797b60a7" (UID: "4b120e3f-81db-4f72-8f48-6c52797b60a7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:21:36.591063 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.591039    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b120e3f-81db-4f72-8f48-6c52797b60a7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4b120e3f-81db-4f72-8f48-6c52797b60a7" (UID: "4b120e3f-81db-4f72-8f48-6c52797b60a7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:21:36.591167 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.591040    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b120e3f-81db-4f72-8f48-6c52797b60a7-kube-api-access-59lc5" (OuterVolumeSpecName: "kube-api-access-59lc5") pod "4b120e3f-81db-4f72-8f48-6c52797b60a7" (UID: "4b120e3f-81db-4f72-8f48-6c52797b60a7"). InnerVolumeSpecName "kube-api-access-59lc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:21:36.689905 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.689870    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b120e3f-81db-4f72-8f48-6c52797b60a7-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:21:36.689905 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.689902    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4b120e3f-81db-4f72-8f48-6c52797b60a7-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:21:36.690109 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:36.689914    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59lc5\" (UniqueName: \"kubernetes.io/projected/4b120e3f-81db-4f72-8f48-6c52797b60a7-kube-api-access-59lc5\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:21:37.471016 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:37.470979    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"
Jul 23 10:21:37.471016 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:37.470997    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9" event={"ID":"4b120e3f-81db-4f72-8f48-6c52797b60a7","Type":"ContainerDied","Data":"40e8b013b37e1f91a0a73987ef05312571c26325d96360940be47b52a8a490d0"}
Jul 23 10:21:37.471506 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:37.471055    2564 scope.go:117] "RemoveContainer" containerID="67e051e4286e9fc4f853e964d46dffb46717c00783bf8fb3d75a9d3cf8dda3ac"
Jul 23 10:21:37.490693 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:37.490667    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"]
Jul 23 10:21:37.494039 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:37.494020    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fc7ad5db-5b87f6bf47-pslm9"]
Jul 23 10:21:38.610325 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:38.610288    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b120e3f-81db-4f72-8f48-6c52797b60a7" path="/var/lib/kubelet/pods/4b120e3f-81db-4f72-8f48-6c52797b60a7/volumes"
Jul 23 10:21:40.853114 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:40.853081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:41.003081 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:41.002987    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:41.246148 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:41.246115    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:41.502970 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:41.502910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:41.599206 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:41.599174    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:41.707162 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:41.707133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:42.064174 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:42.064144    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:42.274507 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:42.274479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:44.503283 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.503217    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:44.579785 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.579754    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"]
Jul 23 10:21:44.580164 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.580152    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b120e3f-81db-4f72-8f48-6c52797b60a7" containerName="maas-api"
Jul 23 10:21:44.580218 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.580166    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b120e3f-81db-4f72-8f48-6c52797b60a7" containerName="maas-api"
Jul 23 10:21:44.580274 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.580238    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b120e3f-81db-4f72-8f48-6c52797b60a7" containerName="maas-api"
Jul 23 10:21:44.584752 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.584728    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:44.587608 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.587585    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c3044c8a-serving-cert\""
Jul 23 10:21:44.593130 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.593104    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"]
Jul 23 10:21:44.610832 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.610783    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:44.663450 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.663416    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fbb7650-b921-48a4-932a-9977cbfb0c7e-maas-api-tls\") pod \"maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:44.663740 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.663711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fbb7650-b921-48a4-932a-9977cbfb0c7e-openshift-service-ca\") pod \"maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:44.663824 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.663806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf45w\" (UniqueName: \"kubernetes.io/projected/7fbb7650-b921-48a4-932a-9977cbfb0c7e-kube-api-access-zf45w\") pod \"maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:44.764871 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.764780    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fbb7650-b921-48a4-932a-9977cbfb0c7e-openshift-service-ca\") pod \"maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:44.764871 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.764830    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf45w\" (UniqueName: \"kubernetes.io/projected/7fbb7650-b921-48a4-932a-9977cbfb0c7e-kube-api-access-zf45w\") pod \"maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:44.764871 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.764866    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fbb7650-b921-48a4-932a-9977cbfb0c7e-maas-api-tls\") pod \"maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:44.765091 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:21:44.764982    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-serving-cert: secret "maas-api-e2e-migrate-c3044c8a-serving-cert" not found
Jul 23 10:21:44.765091 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:21:44.765044    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fbb7650-b921-48a4-932a-9977cbfb0c7e-maas-api-tls podName:7fbb7650-b921-48a4-932a-9977cbfb0c7e nodeName:}" failed. No retries permitted until 2026-07-23 10:21:45.265025167 +0000 UTC m=+1625.168713421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7fbb7650-b921-48a4-932a-9977cbfb0c7e-maas-api-tls") pod "maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2" (UID: "7fbb7650-b921-48a4-932a-9977cbfb0c7e") : secret "maas-api-e2e-migrate-c3044c8a-serving-cert" not found
Jul 23 10:21:44.765575 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.765558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fbb7650-b921-48a4-932a-9977cbfb0c7e-openshift-service-ca\") pod \"maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:44.773640 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:44.773615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf45w\" (UniqueName: \"kubernetes.io/projected/7fbb7650-b921-48a4-932a-9977cbfb0c7e-kube-api-access-zf45w\") pod \"maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:45.084543 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:45.084459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:45.188106 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:45.188072    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:45.269821 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:45.269785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fbb7650-b921-48a4-932a-9977cbfb0c7e-maas-api-tls\") pod \"maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:45.272431 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:45.272397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fbb7650-b921-48a4-932a-9977cbfb0c7e-maas-api-tls\") pod \"maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:45.499571 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:45.499540    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:45.642741 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:45.642708    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"]
Jul 23 10:21:45.650317 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:21:45.650291    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fbb7650_b921_48a4_932a_9977cbfb0c7e.slice/crio-d09cf65a188a64dca37ab6e7279c59b37286c5a55a6df0c01e4ba19e80bcd417 WatchSource:0}: Error finding container d09cf65a188a64dca37ab6e7279c59b37286c5a55a6df0c01e4ba19e80bcd417: Status 404 returned error can't find the container with id d09cf65a188a64dca37ab6e7279c59b37286c5a55a6df0c01e4ba19e80bcd417
Jul 23 10:21:46.518777 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:46.518739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2" event={"ID":"7fbb7650-b921-48a4-932a-9977cbfb0c7e","Type":"ContainerStarted","Data":"5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d"}
Jul 23 10:21:46.518952 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:46.518788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2" event={"ID":"7fbb7650-b921-48a4-932a-9977cbfb0c7e","Type":"ContainerStarted","Data":"d09cf65a188a64dca37ab6e7279c59b37286c5a55a6df0c01e4ba19e80bcd417"}
Jul 23 10:21:46.518952 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:46.518895    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:21:46.535330 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:46.535286    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2" podStartSLOduration=2.146987963 podStartE2EDuration="2.535245629s" totalImagesPullingTime="388.257666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:21:46.534577725 +0000 UTC m=+1626.438266002" watchObservedRunningTime="2026-07-23 10:21:46.535245629 +0000 UTC m=+1626.438933903"
Jul 23 10:21:51.839066 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:51.839033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:51.939655 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:51.939623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:21:52.530304 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:21:52.530248    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:22:19.855493 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:19.855447    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"]
Jul 23 10:22:19.860347 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:19.855727    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2" podUID="7fbb7650-b921-48a4-932a-9977cbfb0c7e" containerName="maas-api" containerID="cri-o://5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d" gracePeriod=30
Jul 23 10:22:19.888054 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:19.888030    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:22:20.111298 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.111236    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:22:20.190070 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.190035    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fbb7650-b921-48a4-932a-9977cbfb0c7e-openshift-service-ca\") pod \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") "
Jul 23 10:22:20.190241 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.190093    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf45w\" (UniqueName: \"kubernetes.io/projected/7fbb7650-b921-48a4-932a-9977cbfb0c7e-kube-api-access-zf45w\") pod \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") "
Jul 23 10:22:20.190241 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.190125    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fbb7650-b921-48a4-932a-9977cbfb0c7e-maas-api-tls\") pod \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\" (UID: \"7fbb7650-b921-48a4-932a-9977cbfb0c7e\") "
Jul 23 10:22:20.190510 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.190477    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fbb7650-b921-48a4-932a-9977cbfb0c7e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7fbb7650-b921-48a4-932a-9977cbfb0c7e" (UID: "7fbb7650-b921-48a4-932a-9977cbfb0c7e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:22:20.192378 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.192346    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fbb7650-b921-48a4-932a-9977cbfb0c7e-kube-api-access-zf45w" (OuterVolumeSpecName: "kube-api-access-zf45w") pod "7fbb7650-b921-48a4-932a-9977cbfb0c7e" (UID: "7fbb7650-b921-48a4-932a-9977cbfb0c7e"). InnerVolumeSpecName "kube-api-access-zf45w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:22:20.192378 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.192353    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7fbb7650-b921-48a4-932a-9977cbfb0c7e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7fbb7650-b921-48a4-932a-9977cbfb0c7e" (UID: "7fbb7650-b921-48a4-932a-9977cbfb0c7e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:22:20.291597 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.291561    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7fbb7650-b921-48a4-932a-9977cbfb0c7e-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:22:20.291597 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.291591    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf45w\" (UniqueName: \"kubernetes.io/projected/7fbb7650-b921-48a4-932a-9977cbfb0c7e-kube-api-access-zf45w\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:22:20.291597 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.291602    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7fbb7650-b921-48a4-932a-9977cbfb0c7e-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:22:20.680618 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.680585    2564 generic.go:356] "Generic (PLEG): container finished" podID="7fbb7650-b921-48a4-932a-9977cbfb0c7e" containerID="5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d" exitCode=0
Jul 23 10:22:20.680827 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.680646    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"
Jul 23 10:22:20.680827 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.680689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2" event={"ID":"7fbb7650-b921-48a4-932a-9977cbfb0c7e","Type":"ContainerDied","Data":"5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d"}
Jul 23 10:22:20.680827 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.680741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2" event={"ID":"7fbb7650-b921-48a4-932a-9977cbfb0c7e","Type":"ContainerDied","Data":"d09cf65a188a64dca37ab6e7279c59b37286c5a55a6df0c01e4ba19e80bcd417"}
Jul 23 10:22:20.680827 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.680764    2564 scope.go:117] "RemoveContainer" containerID="5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d"
Jul 23 10:22:20.689830 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.689812    2564 scope.go:117] "RemoveContainer" containerID="5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d"
Jul 23 10:22:20.690067 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:22:20.690049    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d\": container with ID starting with 5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d not found: ID does not exist" containerID="5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d"
Jul 23 10:22:20.690133 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.690077    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d"} err="failed to get container status \"5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d\": rpc error: code = NotFound desc = could not find container \"5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d\": container with ID starting with 5e30905906e6ce08c80516e9b740d0b713baa0005e677d97d9f13e8b2d48437d not found: ID does not exist"
Jul 23 10:22:20.696637 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.696614    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"]
Jul 23 10:22:20.700630 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:20.700605    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c3044c8a-554646c6b4-d4wc2"]
Jul 23 10:22:22.610760 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:22.610728    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fbb7650-b921-48a4-932a-9977cbfb0c7e" path="/var/lib/kubelet/pods/7fbb7650-b921-48a4-932a-9977cbfb0c7e/volumes"
Jul 23 10:22:24.589308 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:24.589244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:22:26.013709 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:26.013677    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:22:27.623236 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.623200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:22:27.705136 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.705105    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"]
Jul 23 10:22:27.705522 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.705507    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fbb7650-b921-48a4-932a-9977cbfb0c7e" containerName="maas-api"
Jul 23 10:22:27.705522 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.705522    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fbb7650-b921-48a4-932a-9977cbfb0c7e" containerName="maas-api"
Jul 23 10:22:27.705631 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.705588    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fbb7650-b921-48a4-932a-9977cbfb0c7e" containerName="maas-api"
Jul 23 10:22:27.710103 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.710083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:27.713321 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.713300    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-07b9c24b-serving-cert\""
Jul 23 10:22:27.718609 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.718584    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:22:27.721693 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.721669    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"]
Jul 23 10:22:27.765393 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.765363    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f2d522-a4f8-470d-8340-bd6e67b2d66d-openshift-service-ca\") pod \"maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:27.765568 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.765409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f2d522-a4f8-470d-8340-bd6e67b2d66d-maas-api-tls\") pod \"maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:27.765568 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.765472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncz4r\" (UniqueName: \"kubernetes.io/projected/38f2d522-a4f8-470d-8340-bd6e67b2d66d-kube-api-access-ncz4r\") pod \"maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:27.814885 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.814856    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:22:27.866236 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.866205    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f2d522-a4f8-470d-8340-bd6e67b2d66d-openshift-service-ca\") pod \"maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:27.866393 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.866279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f2d522-a4f8-470d-8340-bd6e67b2d66d-maas-api-tls\") pod \"maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:27.866393 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.866325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncz4r\" (UniqueName: \"kubernetes.io/projected/38f2d522-a4f8-470d-8340-bd6e67b2d66d-kube-api-access-ncz4r\") pod \"maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:27.866481 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:22:27.866433    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-serving-cert: secret "maas-api-e2e-ait-07b9c24b-serving-cert" not found
Jul 23 10:22:27.866515 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:22:27.866508    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38f2d522-a4f8-470d-8340-bd6e67b2d66d-maas-api-tls podName:38f2d522-a4f8-470d-8340-bd6e67b2d66d nodeName:}" failed. No retries permitted until 2026-07-23 10:22:28.366488695 +0000 UTC m=+1668.270176950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/38f2d522-a4f8-470d-8340-bd6e67b2d66d-maas-api-tls") pod "maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd" (UID: "38f2d522-a4f8-470d-8340-bd6e67b2d66d") : secret "maas-api-e2e-ait-07b9c24b-serving-cert" not found
Jul 23 10:22:27.866991 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.866972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f2d522-a4f8-470d-8340-bd6e67b2d66d-openshift-service-ca\") pod \"maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:27.876448 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:27.876394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncz4r\" (UniqueName: \"kubernetes.io/projected/38f2d522-a4f8-470d-8340-bd6e67b2d66d-kube-api-access-ncz4r\") pod \"maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:28.122041 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:28.122010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:22:28.371173 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:28.371138    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f2d522-a4f8-470d-8340-bd6e67b2d66d-maas-api-tls\") pod \"maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:28.373668 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:28.373637    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f2d522-a4f8-470d-8340-bd6e67b2d66d-maas-api-tls\") pod \"maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:28.424653 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:28.424621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:22:28.557833 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:28.557807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:22:28.623335 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:28.623226    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:28.780056 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:28.780022    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"]
Jul 23 10:22:28.783440 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:22:28.783408    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38f2d522_a4f8_470d_8340_bd6e67b2d66d.slice/crio-c32879b90d50d8e09ba21cb2e4059ee27cb4cb9c0fdd332bfe4fea4b49f33761 WatchSource:0}: Error finding container c32879b90d50d8e09ba21cb2e4059ee27cb4cb9c0fdd332bfe4fea4b49f33761: Status 404 returned error can't find the container with id c32879b90d50d8e09ba21cb2e4059ee27cb4cb9c0fdd332bfe4fea4b49f33761
Jul 23 10:22:29.733017 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:29.732972    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd" event={"ID":"38f2d522-a4f8-470d-8340-bd6e67b2d66d","Type":"ContainerStarted","Data":"d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16"}
Jul 23 10:22:29.733017 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:29.733024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd" event={"ID":"38f2d522-a4f8-470d-8340-bd6e67b2d66d","Type":"ContainerStarted","Data":"c32879b90d50d8e09ba21cb2e4059ee27cb4cb9c0fdd332bfe4fea4b49f33761"}
Jul 23 10:22:29.733595 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:29.733056    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:22:29.765827 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:29.765769    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd" podStartSLOduration=2.354644859 podStartE2EDuration="2.765752128s" totalImagesPullingTime="411.107269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:22:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:22:29.762854403 +0000 UTC m=+1669.666542677" watchObservedRunningTime="2026-07-23 10:22:29.765752128 +0000 UTC m=+1669.669440402"
Jul 23 10:22:35.742446 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:22:35.742419    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:23:03.836763 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:03.836518    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"]
Jul 23 10:23:03.837289 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:03.836960    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd" podUID="38f2d522-a4f8-470d-8340-bd6e67b2d66d" containerName="maas-api" containerID="cri-o://d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16" gracePeriod=30
Jul 23 10:23:03.864613 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:03.864587    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:04.093457 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.093388    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:23:04.188143 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.188116    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f2d522-a4f8-470d-8340-bd6e67b2d66d-maas-api-tls\") pod \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") "
Jul 23 10:23:04.188337 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.188158    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncz4r\" (UniqueName: \"kubernetes.io/projected/38f2d522-a4f8-470d-8340-bd6e67b2d66d-kube-api-access-ncz4r\") pod \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") "
Jul 23 10:23:04.188337 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.188176    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f2d522-a4f8-470d-8340-bd6e67b2d66d-openshift-service-ca\") pod \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\" (UID: \"38f2d522-a4f8-470d-8340-bd6e67b2d66d\") "
Jul 23 10:23:04.188542 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.188517    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38f2d522-a4f8-470d-8340-bd6e67b2d66d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "38f2d522-a4f8-470d-8340-bd6e67b2d66d" (UID: "38f2d522-a4f8-470d-8340-bd6e67b2d66d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:23:04.190406 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.190387    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/38f2d522-a4f8-470d-8340-bd6e67b2d66d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "38f2d522-a4f8-470d-8340-bd6e67b2d66d" (UID: "38f2d522-a4f8-470d-8340-bd6e67b2d66d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:23:04.190509 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.190490    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38f2d522-a4f8-470d-8340-bd6e67b2d66d-kube-api-access-ncz4r" (OuterVolumeSpecName: "kube-api-access-ncz4r") pod "38f2d522-a4f8-470d-8340-bd6e67b2d66d" (UID: "38f2d522-a4f8-470d-8340-bd6e67b2d66d"). InnerVolumeSpecName "kube-api-access-ncz4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:23:04.289010 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.288978    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncz4r\" (UniqueName: \"kubernetes.io/projected/38f2d522-a4f8-470d-8340-bd6e67b2d66d-kube-api-access-ncz4r\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:23:04.289010 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.289003    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/38f2d522-a4f8-470d-8340-bd6e67b2d66d-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:23:04.289010 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.289013    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/38f2d522-a4f8-470d-8340-bd6e67b2d66d-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:23:04.916453 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.916421    2564 generic.go:356] "Generic (PLEG): container finished" podID="38f2d522-a4f8-470d-8340-bd6e67b2d66d" containerID="d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16" exitCode=0
Jul 23 10:23:04.916937 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.916470    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"
Jul 23 10:23:04.916937 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.916502    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd" event={"ID":"38f2d522-a4f8-470d-8340-bd6e67b2d66d","Type":"ContainerDied","Data":"d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16"}
Jul 23 10:23:04.916937 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.916553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd" event={"ID":"38f2d522-a4f8-470d-8340-bd6e67b2d66d","Type":"ContainerDied","Data":"c32879b90d50d8e09ba21cb2e4059ee27cb4cb9c0fdd332bfe4fea4b49f33761"}
Jul 23 10:23:04.916937 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.916576    2564 scope.go:117] "RemoveContainer" containerID="d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16"
Jul 23 10:23:04.928487 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.928392    2564 scope.go:117] "RemoveContainer" containerID="d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16"
Jul 23 10:23:04.929009 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:23:04.928987    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16\": container with ID starting with d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16 not found: ID does not exist" containerID="d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16"
Jul 23 10:23:04.929095 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.929022    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16"} err="failed to get container status \"d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16\": rpc error: code = NotFound desc = could not find container \"d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16\": container with ID starting with d7711a5677f6151df2050c23a4760ef3c7f10ce4e51d967a0c0b2ca8f13eef16 not found: ID does not exist"
Jul 23 10:23:04.935346 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.935324    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"]
Jul 23 10:23:04.936994 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:04.936977    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-07b9c24b-589fd84d6b-gvsgd"]
Jul 23 10:23:06.610150 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:06.610120    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38f2d522-a4f8-470d-8340-bd6e67b2d66d" path="/var/lib/kubelet/pods/38f2d522-a4f8-470d-8340-bd6e67b2d66d/volumes"
Jul 23 10:23:08.556615 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:08.556583    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:10.107597 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:10.107568    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:10.207435 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:10.207381    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:10.270639 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:10.270605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:10.570054 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:10.569997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:10.668060 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:10.668025    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:12.856604 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.856560    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:12.936709 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.936668    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"]
Jul 23 10:23:12.937361 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.937336    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38f2d522-a4f8-470d-8340-bd6e67b2d66d" containerName="maas-api"
Jul 23 10:23:12.937361 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.937362    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="38f2d522-a4f8-470d-8340-bd6e67b2d66d" containerName="maas-api"
Jul 23 10:23:12.937511 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.937473    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="38f2d522-a4f8-470d-8340-bd6e67b2d66d" containerName="maas-api"
Jul 23 10:23:12.938300 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.938277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:12.940851 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.940834    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:12.943641 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.943615    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-2ee93e9e-serving-cert\""
Jul 23 10:23:12.950087 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.950037    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"]
Jul 23 10:23:12.969327 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.969295    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rk5w\" (UniqueName: \"kubernetes.io/projected/b0c8bef3-55af-4e16-a12a-979e41726028-kube-api-access-7rk5w\") pod \"maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:12.969508 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.969365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c8bef3-55af-4e16-a12a-979e41726028-maas-api-tls\") pod \"maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:12.969508 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:12.969419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c8bef3-55af-4e16-a12a-979e41726028-openshift-service-ca\") pod \"maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:13.070636 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.070603    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c8bef3-55af-4e16-a12a-979e41726028-openshift-service-ca\") pod \"maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:13.070815 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.070668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rk5w\" (UniqueName: \"kubernetes.io/projected/b0c8bef3-55af-4e16-a12a-979e41726028-kube-api-access-7rk5w\") pod \"maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:13.070815 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.070707    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c8bef3-55af-4e16-a12a-979e41726028-maas-api-tls\") pod \"maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:13.071339 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.071320    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c8bef3-55af-4e16-a12a-979e41726028-openshift-service-ca\") pod \"maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:13.073205 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.073182    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c8bef3-55af-4e16-a12a-979e41726028-maas-api-tls\") pod \"maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:13.089250 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.089223    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rk5w\" (UniqueName: \"kubernetes.io/projected/b0c8bef3-55af-4e16-a12a-979e41726028-kube-api-access-7rk5w\") pod \"maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:13.254100 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.254073    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:13.398454 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.398432    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"]
Jul 23 10:23:13.401607 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:23:13.401578    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c8bef3_55af_4e16_a12a_979e41726028.slice/crio-afd00cfb9962d0ecafa4c439fe68b3a0f94e4b1393a4dd36dae2b455c19a7243 WatchSource:0}: Error finding container afd00cfb9962d0ecafa4c439fe68b3a0f94e4b1393a4dd36dae2b455c19a7243: Status 404 returned error can't find the container with id afd00cfb9962d0ecafa4c439fe68b3a0f94e4b1393a4dd36dae2b455c19a7243
Jul 23 10:23:13.401818 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.401797    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:13.499079 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.499047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:13.600325 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.600213    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:13.966825 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.966793    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx" event={"ID":"b0c8bef3-55af-4e16-a12a-979e41726028","Type":"ContainerStarted","Data":"591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498"}
Jul 23 10:23:13.967213 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.966850    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx" event={"ID":"b0c8bef3-55af-4e16-a12a-979e41726028","Type":"ContainerStarted","Data":"afd00cfb9962d0ecafa4c439fe68b3a0f94e4b1393a4dd36dae2b455c19a7243"}
Jul 23 10:23:13.967213 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.966878    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:13.986500 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:13.986455    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx" podStartSLOduration=1.5581735700000001 podStartE2EDuration="1.986440054s" totalImagesPullingTime="428.266484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:23:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:23:13.985077063 +0000 UTC m=+1713.888765337" watchObservedRunningTime="2026-07-23 10:23:13.986440054 +0000 UTC m=+1713.890128328"
Jul 23 10:23:19.977608 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:19.977581    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:27.171756 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:27.171716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:27.269658 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:27.269627    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:35.268466 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:35.268431    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:35.373221 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:35.373184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:48.364962 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.364916    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"]
Jul 23 10:23:48.365581 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.365156    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx" podUID="b0c8bef3-55af-4e16-a12a-979e41726028" containerName="maas-api" containerID="cri-o://591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498" gracePeriod=30
Jul 23 10:23:48.410972 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.410910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:48.622825 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.622756    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:48.707321 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.707248    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c8bef3-55af-4e16-a12a-979e41726028-maas-api-tls\") pod \"b0c8bef3-55af-4e16-a12a-979e41726028\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") "
Jul 23 10:23:48.707321 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.707327    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c8bef3-55af-4e16-a12a-979e41726028-openshift-service-ca\") pod \"b0c8bef3-55af-4e16-a12a-979e41726028\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") "
Jul 23 10:23:48.707534 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.707352    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rk5w\" (UniqueName: \"kubernetes.io/projected/b0c8bef3-55af-4e16-a12a-979e41726028-kube-api-access-7rk5w\") pod \"b0c8bef3-55af-4e16-a12a-979e41726028\" (UID: \"b0c8bef3-55af-4e16-a12a-979e41726028\") "
Jul 23 10:23:48.707905 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.707652    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0c8bef3-55af-4e16-a12a-979e41726028-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0c8bef3-55af-4e16-a12a-979e41726028" (UID: "b0c8bef3-55af-4e16-a12a-979e41726028"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:23:48.707905 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.707768    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0c8bef3-55af-4e16-a12a-979e41726028-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:23:48.709520 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.709499    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0c8bef3-55af-4e16-a12a-979e41726028-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0c8bef3-55af-4e16-a12a-979e41726028" (UID: "b0c8bef3-55af-4e16-a12a-979e41726028"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:23:48.709622 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.709535    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c8bef3-55af-4e16-a12a-979e41726028-kube-api-access-7rk5w" (OuterVolumeSpecName: "kube-api-access-7rk5w") pod "b0c8bef3-55af-4e16-a12a-979e41726028" (UID: "b0c8bef3-55af-4e16-a12a-979e41726028"). InnerVolumeSpecName "kube-api-access-7rk5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:23:48.809168 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.809132    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0c8bef3-55af-4e16-a12a-979e41726028-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:23:48.809168 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:48.809163    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rk5w\" (UniqueName: \"kubernetes.io/projected/b0c8bef3-55af-4e16-a12a-979e41726028-kube-api-access-7rk5w\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:23:49.138800 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:49.138765    2564 generic.go:356] "Generic (PLEG): container finished" podID="b0c8bef3-55af-4e16-a12a-979e41726028" containerID="591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498" exitCode=0
Jul 23 10:23:49.138993 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:49.138815    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"
Jul 23 10:23:49.138993 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:49.138856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx" event={"ID":"b0c8bef3-55af-4e16-a12a-979e41726028","Type":"ContainerDied","Data":"591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498"}
Jul 23 10:23:49.138993 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:49.138912    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx" event={"ID":"b0c8bef3-55af-4e16-a12a-979e41726028","Type":"ContainerDied","Data":"afd00cfb9962d0ecafa4c439fe68b3a0f94e4b1393a4dd36dae2b455c19a7243"}
Jul 23 10:23:49.138993 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:49.138949    2564 scope.go:117] "RemoveContainer" containerID="591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498"
Jul 23 10:23:49.148418 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:49.148398    2564 scope.go:117] "RemoveContainer" containerID="591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498"
Jul 23 10:23:49.148652 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:23:49.148634    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498\": container with ID starting with 591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498 not found: ID does not exist" containerID="591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498"
Jul 23 10:23:49.148702 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:49.148661    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498"} err="failed to get container status \"591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498\": rpc error: code = NotFound desc = could not find container \"591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498\": container with ID starting with 591263b51af9008d6bebc67ecdfdfe11ddcc2f8eeba5810ba966f65932983498 not found: ID does not exist"
Jul 23 10:23:49.161123 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:49.161098    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"]
Jul 23 10:23:49.165059 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:49.165040    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2ee93e9e-7656f966cf-bz6zx"]
Jul 23 10:23:50.611748 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:50.611713    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0c8bef3-55af-4e16-a12a-979e41726028" path="/var/lib/kubelet/pods/b0c8bef3-55af-4e16-a12a-979e41726028/volumes"
Jul 23 10:23:52.891512 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:52.891479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:53.048226 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:53.048192    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:53.284730 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:53.284651    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:53.825044 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:53.825008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:53.925791 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:53.925760    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:54.027412 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:54.027379    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:23:55.519833 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:23:55.519789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:01.943423 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:01.943386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:02.046996 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:02.046931    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:02.143912 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:02.143881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:02.242423 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:02.242345    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:07.767376 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:07.767340    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:33.790738 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:33.790704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:40.088544 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:40.088506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:40.191473 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:40.191431    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:40.336563 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:40.336526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:40.681092 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:40.681061    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:24:40.682522 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:40.682502    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:24:54.381942 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:54.381906    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:24:56.227268 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:24:56.227220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:01.939220 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:01.939186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:01.997836 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:01.997813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:02.071671 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:02.071637    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:02.171091 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:02.171062    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:03.384105 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:03.384075    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:03.448069 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:03.448039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:12.689348 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:12.689305    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:13.510358 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:13.510330    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:20.374392 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:20.374350    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:20.480367 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:20.480335    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:20.574960 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:20.574922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:20.678411 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:20.678375    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:21.523692 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:21.523642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:21.622863 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:21.622819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:23.396859 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:23.396825    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:29.342157 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:29.342122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:29.442893 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:29.442862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:30.014082 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:30.014047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:35.785066 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:35.785032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:35.839478 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:35.839427    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:36.013742 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:36.013715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:36.423851 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:36.423804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:36.554707 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:36.554666    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:39.322504 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.322471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:39.407690 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.407653    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"]
Jul 23 10:25:39.408276 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.408245    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0c8bef3-55af-4e16-a12a-979e41726028" containerName="maas-api"
Jul 23 10:25:39.408331 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.408279    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0c8bef3-55af-4e16-a12a-979e41726028" containerName="maas-api"
Jul 23 10:25:39.408384 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.408374    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0c8bef3-55af-4e16-a12a-979e41726028" containerName="maas-api"
Jul 23 10:25:39.409709 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.409679    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:39.412097 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.412077    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:39.414943 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.414913    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b328edc3-serving-cert\""
Jul 23 10:25:39.422041 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.422018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"]
Jul 23 10:25:39.493493 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.493461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:39.525383 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.525356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be217fab-85d6-4818-90ea-b099d16e4941-openshift-service-ca\") pod \"maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:39.525536 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.525401    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnmcr\" (UniqueName: \"kubernetes.io/projected/be217fab-85d6-4818-90ea-b099d16e4941-kube-api-access-lnmcr\") pod \"maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:39.525592 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.525532    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be217fab-85d6-4818-90ea-b099d16e4941-maas-api-tls\") pod \"maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:39.626040 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.625946    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnmcr\" (UniqueName: \"kubernetes.io/projected/be217fab-85d6-4818-90ea-b099d16e4941-kube-api-access-lnmcr\") pod \"maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:39.626224 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.626073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be217fab-85d6-4818-90ea-b099d16e4941-maas-api-tls\") pod \"maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:39.626224 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.626117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be217fab-85d6-4818-90ea-b099d16e4941-openshift-service-ca\") pod \"maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:39.626406 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:25:39.626224    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-serving-cert: secret "maas-api-e2e-mt-b328edc3-serving-cert" not found
Jul 23 10:25:39.626406 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:25:39.626320    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be217fab-85d6-4818-90ea-b099d16e4941-maas-api-tls podName:be217fab-85d6-4818-90ea-b099d16e4941 nodeName:}" failed. No retries permitted until 2026-07-23 10:25:40.126304387 +0000 UTC m=+1860.029992639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/be217fab-85d6-4818-90ea-b099d16e4941-maas-api-tls") pod "maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq" (UID: "be217fab-85d6-4818-90ea-b099d16e4941") : secret "maas-api-e2e-mt-b328edc3-serving-cert" not found
Jul 23 10:25:39.626817 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.626794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be217fab-85d6-4818-90ea-b099d16e4941-openshift-service-ca\") pod \"maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:39.638912 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.638887    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnmcr\" (UniqueName: \"kubernetes.io/projected/be217fab-85d6-4818-90ea-b099d16e4941-kube-api-access-lnmcr\") pod \"maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:39.797654 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:39.797625    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:40.130420 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:40.130388    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be217fab-85d6-4818-90ea-b099d16e4941-maas-api-tls\") pod \"maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:40.133103 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:40.133075    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be217fab-85d6-4818-90ea-b099d16e4941-maas-api-tls\") pod \"maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:40.140076 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:40.140042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:40.235695 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:40.235664    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:40.324174 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:40.324136    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:40.501213 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:40.501184    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"]
Jul 23 10:25:40.679330 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:40.679218    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq" event={"ID":"be217fab-85d6-4818-90ea-b099d16e4941","Type":"ContainerStarted","Data":"49d837fd8a0bd12ae2975cc3cf127e34e1528ab7c850993f7f9da199e9367d65"}
Jul 23 10:25:41.686056 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:41.685965    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq" event={"ID":"be217fab-85d6-4818-90ea-b099d16e4941","Type":"ContainerStarted","Data":"e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a"}
Jul 23 10:25:41.686533 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:41.686107    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:41.704239 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:41.704190    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq" podStartSLOduration=1.795053035 podStartE2EDuration="2.704175804s" totalImagesPullingTime="909.122769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:25:41.702913311 +0000 UTC m=+1861.606601585" watchObservedRunningTime="2026-07-23 10:25:41.704175804 +0000 UTC m=+1861.607864078"
Jul 23 10:25:43.768381 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:43.768351    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:44.437726 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:44.437695    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:44.535639 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:44.535606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:44.882077 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:44.882047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:47.695864 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:47.695837    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:25:50.663913 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:50.663881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:25:50.763989 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:25:50.763958    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:01.399427 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.399301    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"]
Jul 23 10:26:01.400510 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.400181    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq" podUID="be217fab-85d6-4818-90ea-b099d16e4941" containerName="maas-api" containerID="cri-o://e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a" gracePeriod=30
Jul 23 10:26:01.433748 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.433722    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:01.653036 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.652973    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:26:01.730968 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.730936    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnmcr\" (UniqueName: \"kubernetes.io/projected/be217fab-85d6-4818-90ea-b099d16e4941-kube-api-access-lnmcr\") pod \"be217fab-85d6-4818-90ea-b099d16e4941\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") "
Jul 23 10:26:01.731153 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.730980    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be217fab-85d6-4818-90ea-b099d16e4941-openshift-service-ca\") pod \"be217fab-85d6-4818-90ea-b099d16e4941\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") "
Jul 23 10:26:01.731153 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.731028    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be217fab-85d6-4818-90ea-b099d16e4941-maas-api-tls\") pod \"be217fab-85d6-4818-90ea-b099d16e4941\" (UID: \"be217fab-85d6-4818-90ea-b099d16e4941\") "
Jul 23 10:26:01.731410 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.731380    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be217fab-85d6-4818-90ea-b099d16e4941-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "be217fab-85d6-4818-90ea-b099d16e4941" (UID: "be217fab-85d6-4818-90ea-b099d16e4941"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:26:01.733249 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.733220    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be217fab-85d6-4818-90ea-b099d16e4941-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "be217fab-85d6-4818-90ea-b099d16e4941" (UID: "be217fab-85d6-4818-90ea-b099d16e4941"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:26:01.733359 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.733329    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be217fab-85d6-4818-90ea-b099d16e4941-kube-api-access-lnmcr" (OuterVolumeSpecName: "kube-api-access-lnmcr") pod "be217fab-85d6-4818-90ea-b099d16e4941" (UID: "be217fab-85d6-4818-90ea-b099d16e4941"). InnerVolumeSpecName "kube-api-access-lnmcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:26:01.781769 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.781734    2564 generic.go:356] "Generic (PLEG): container finished" podID="be217fab-85d6-4818-90ea-b099d16e4941" containerID="e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a" exitCode=0
Jul 23 10:26:01.781941 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.781782    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"
Jul 23 10:26:01.781941 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.781826    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq" event={"ID":"be217fab-85d6-4818-90ea-b099d16e4941","Type":"ContainerDied","Data":"e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a"}
Jul 23 10:26:01.781941 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.781878    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq" event={"ID":"be217fab-85d6-4818-90ea-b099d16e4941","Type":"ContainerDied","Data":"49d837fd8a0bd12ae2975cc3cf127e34e1528ab7c850993f7f9da199e9367d65"}
Jul 23 10:26:01.781941 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.781900    2564 scope.go:117] "RemoveContainer" containerID="e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a"
Jul 23 10:26:01.791357 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.791335    2564 scope.go:117] "RemoveContainer" containerID="e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a"
Jul 23 10:26:01.791614 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:26:01.791594    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a\": container with ID starting with e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a not found: ID does not exist" containerID="e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a"
Jul 23 10:26:01.791684 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.791627    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a"} err="failed to get container status \"e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a\": rpc error: code = NotFound desc = could not find container \"e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a\": container with ID starting with e3d97071e0534e39215e5295f85806f2a6cd1e5d00cf62b724723d5f2717a72a not found: ID does not exist"
Jul 23 10:26:01.802799 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.802776    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"]
Jul 23 10:26:01.807097 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.807074    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b328edc3-7d5f79bb58-hdknq"]
Jul 23 10:26:01.832418 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.832389    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnmcr\" (UniqueName: \"kubernetes.io/projected/be217fab-85d6-4818-90ea-b099d16e4941-kube-api-access-lnmcr\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:26:01.832418 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.832412    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be217fab-85d6-4818-90ea-b099d16e4941-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:26:01.832418 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:01.832422    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be217fab-85d6-4818-90ea-b099d16e4941-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:26:02.610627 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:02.610597    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be217fab-85d6-4818-90ea-b099d16e4941" path="/var/lib/kubelet/pods/be217fab-85d6-4818-90ea-b099d16e4941/volumes"
Jul 23 10:26:06.095362 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:06.095325    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:06.494779 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:06.494747    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:12.304631 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:12.304600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:12.372890 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:12.372860    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:12.596395 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:12.596312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:12.842077 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:12.842046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:12.965956 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:12.965921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:13.067829 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:13.067795    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:13.176605 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:13.176563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:19.018040 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:19.018010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:19.127030 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:19.126982    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:19.217201 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:19.217135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:19.394673 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:19.394644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:25.015180 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:25.015152    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:25.073970 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:25.073945    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:31.913569 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:31.913535    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:32.223328 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:32.223185    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:32.701660 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:32.701633    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:35.512321 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.512287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:35.606986 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.606951    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:35.607604 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.607580    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"]
Jul 23 10:26:35.607969 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.607956    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be217fab-85d6-4818-90ea-b099d16e4941" containerName="maas-api"
Jul 23 10:26:35.608011 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.607971    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="be217fab-85d6-4818-90ea-b099d16e4941" containerName="maas-api"
Jul 23 10:26:35.608048 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.608038    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="be217fab-85d6-4818-90ea-b099d16e4941" containerName="maas-api"
Jul 23 10:26:35.611243 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.611218    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:35.614506 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.614489    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8941949f-serving-cert\""
Jul 23 10:26:35.627064 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.627042    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"]
Jul 23 10:26:35.693815 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.693779    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:35.750149 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.750118    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f862l\" (UniqueName: \"kubernetes.io/projected/934da34b-75a0-4ca8-914d-f57d39c50965-kube-api-access-f862l\") pod \"maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:35.750353 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.750179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/934da34b-75a0-4ca8-914d-f57d39c50965-maas-api-tls\") pod \"maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:35.750353 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.750238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/934da34b-75a0-4ca8-914d-f57d39c50965-openshift-service-ca\") pod \"maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:35.851289 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.851181    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f862l\" (UniqueName: \"kubernetes.io/projected/934da34b-75a0-4ca8-914d-f57d39c50965-kube-api-access-f862l\") pod \"maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:35.851289 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.851238    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/934da34b-75a0-4ca8-914d-f57d39c50965-maas-api-tls\") pod \"maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:35.851460 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.851321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/934da34b-75a0-4ca8-914d-f57d39c50965-openshift-service-ca\") pod \"maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:35.851937 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.851918    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/934da34b-75a0-4ca8-914d-f57d39c50965-openshift-service-ca\") pod \"maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:35.853630 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.853607    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/934da34b-75a0-4ca8-914d-f57d39c50965-maas-api-tls\") pod \"maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:35.865609 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.865584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f862l\" (UniqueName: \"kubernetes.io/projected/934da34b-75a0-4ca8-914d-f57d39c50965-kube-api-access-f862l\") pod \"maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:35.896363 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.896333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:35.920827 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:35.920806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:36.069595 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:36.069569    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"]
Jul 23 10:26:36.071612 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:26:36.071577    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod934da34b_75a0_4ca8_914d_f57d39c50965.slice/crio-730141733a1273b13d8296f03c3d53c5bd0f75885f555c268ab2dac4db962973 WatchSource:0}: Error finding container 730141733a1273b13d8296f03c3d53c5bd0f75885f555c268ab2dac4db962973: Status 404 returned error can't find the container with id 730141733a1273b13d8296f03c3d53c5bd0f75885f555c268ab2dac4db962973
Jul 23 10:26:36.073062 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:36.073044    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 10:26:36.201124 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:36.201097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:36.307590 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:36.307558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:36.962937 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:36.962892    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4" event={"ID":"934da34b-75a0-4ca8-914d-f57d39c50965","Type":"ContainerStarted","Data":"46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858"}
Jul 23 10:26:36.963365 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:36.962954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4" event={"ID":"934da34b-75a0-4ca8-914d-f57d39c50965","Type":"ContainerStarted","Data":"730141733a1273b13d8296f03c3d53c5bd0f75885f555c268ab2dac4db962973"}
Jul 23 10:26:36.963365 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:36.962981    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:40.017854 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:40.017823    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:26:42.973558 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:42.973527    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:26:42.998728 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:42.998668    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4" podStartSLOduration=7.630405894 podStartE2EDuration="7.99864959s" totalImagesPullingTime="368.243696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:26:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:26:36.984818005 +0000 UTC m=+1916.888506280" watchObservedRunningTime="2026-07-23 10:26:42.99864959 +0000 UTC m=+1922.902337865"
Jul 23 10:26:49.801490 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:26:49.801455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:27:14.677650 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:14.677609    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:27:14.777783 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:14.777750    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:27:28.896552 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:28.896519    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"]
Jul 23 10:27:28.899072 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:28.896740    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4" podUID="934da34b-75a0-4ca8-914d-f57d39c50965" containerName="maas-api" containerID="cri-o://46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858" gracePeriod=30
Jul 23 10:27:28.942727 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:28.942696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:27:29.152021 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.151963    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:27:29.229353 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.229315    2564 generic.go:356] "Generic (PLEG): container finished" podID="934da34b-75a0-4ca8-914d-f57d39c50965" containerID="46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858" exitCode=0
Jul 23 10:27:29.229537 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.229359    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"
Jul 23 10:27:29.229537 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.229394    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4" event={"ID":"934da34b-75a0-4ca8-914d-f57d39c50965","Type":"ContainerDied","Data":"46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858"}
Jul 23 10:27:29.229537 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.229452    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4" event={"ID":"934da34b-75a0-4ca8-914d-f57d39c50965","Type":"ContainerDied","Data":"730141733a1273b13d8296f03c3d53c5bd0f75885f555c268ab2dac4db962973"}
Jul 23 10:27:29.229537 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.229475    2564 scope.go:117] "RemoveContainer" containerID="46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858"
Jul 23 10:27:29.238421 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.238402    2564 scope.go:117] "RemoveContainer" containerID="46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858"
Jul 23 10:27:29.238674 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:27:29.238641    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858\": container with ID starting with 46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858 not found: ID does not exist" containerID="46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858"
Jul 23 10:27:29.238759 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.238671    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858"} err="failed to get container status \"46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858\": rpc error: code = NotFound desc = could not find container \"46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858\": container with ID starting with 46841c209ae01a68b458d4c8966b4cb3a8e9e2091c7010ab930a0aa125a6a858 not found: ID does not exist"
Jul 23 10:27:29.244923 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.244906    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f862l\" (UniqueName: \"kubernetes.io/projected/934da34b-75a0-4ca8-914d-f57d39c50965-kube-api-access-f862l\") pod \"934da34b-75a0-4ca8-914d-f57d39c50965\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") "
Jul 23 10:27:29.244995 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.244953    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/934da34b-75a0-4ca8-914d-f57d39c50965-maas-api-tls\") pod \"934da34b-75a0-4ca8-914d-f57d39c50965\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") "
Jul 23 10:27:29.245034 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.245009    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/934da34b-75a0-4ca8-914d-f57d39c50965-openshift-service-ca\") pod \"934da34b-75a0-4ca8-914d-f57d39c50965\" (UID: \"934da34b-75a0-4ca8-914d-f57d39c50965\") "
Jul 23 10:27:29.245415 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.245393    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/934da34b-75a0-4ca8-914d-f57d39c50965-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "934da34b-75a0-4ca8-914d-f57d39c50965" (UID: "934da34b-75a0-4ca8-914d-f57d39c50965"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:27:29.247037 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.247010    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/934da34b-75a0-4ca8-914d-f57d39c50965-kube-api-access-f862l" (OuterVolumeSpecName: "kube-api-access-f862l") pod "934da34b-75a0-4ca8-914d-f57d39c50965" (UID: "934da34b-75a0-4ca8-914d-f57d39c50965"). InnerVolumeSpecName "kube-api-access-f862l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:27:29.247130 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.247105    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/934da34b-75a0-4ca8-914d-f57d39c50965-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "934da34b-75a0-4ca8-914d-f57d39c50965" (UID: "934da34b-75a0-4ca8-914d-f57d39c50965"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:27:29.345984 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.345945    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/934da34b-75a0-4ca8-914d-f57d39c50965-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:27:29.345984 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.345976    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f862l\" (UniqueName: \"kubernetes.io/projected/934da34b-75a0-4ca8-914d-f57d39c50965-kube-api-access-f862l\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:27:29.345984 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.345987    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/934da34b-75a0-4ca8-914d-f57d39c50965-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:27:29.555274 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.555229    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"]
Jul 23 10:27:29.561461 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:29.561434    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8941949f-c5dc6bb58-vksn4"]
Jul 23 10:27:30.611288 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:30.611221    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="934da34b-75a0-4ca8-914d-f57d39c50965" path="/var/lib/kubelet/pods/934da34b-75a0-4ca8-914d-f57d39c50965/volumes"
Jul 23 10:27:33.625050 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:33.625002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:27:35.981715 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:35.981683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:27:41.105720 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:27:41.105623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:17.463893 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:17.463861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:18.226849 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:18.226815    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:24.037272 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:24.037233    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:24.111239 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:24.111209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:24.378623 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:24.378595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:24.579930 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:24.579895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:25.635666 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:25.635637    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:25.732567 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:25.732526    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:25.832038 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:25.832009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:26.593542 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:26.593495    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:26.690426 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:26.690395    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:26.790801 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:26.790765    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:27.942757 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:27.942719    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:28.041479 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:28.041449    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:28.225446 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:28.225361    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:34.447066 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:34.447033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:34.510763 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:34.510734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:35.127936 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:35.127904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:41.212709 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:41.212676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:41.325480 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:41.325445    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:41.415335 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:41.415301    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:51.994346 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:51.994306    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:28:52.313917 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:28:52.313837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:13.283015 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:13.282931    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:19.260312 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:19.260274    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:19.360716 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:19.360678    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:19.624359 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:19.624267    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:19.961102 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:19.961066    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:20.147126 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:20.147093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:23.383034 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.383002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:23.475635 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.475594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:23.595460 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.595430    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"]
Jul 23 10:29:23.595832 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.595820    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="934da34b-75a0-4ca8-914d-f57d39c50965" containerName="maas-api"
Jul 23 10:29:23.595875 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.595835    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="934da34b-75a0-4ca8-914d-f57d39c50965" containerName="maas-api"
Jul 23 10:29:23.595911 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.595897    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="934da34b-75a0-4ca8-914d-f57d39c50965" containerName="maas-api"
Jul 23 10:29:23.598984 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.598962    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:23.601891 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.601867    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-d95f36-serving-cert\""
Jul 23 10:29:23.611169 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.611143    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"]
Jul 23 10:29:23.637305 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.637220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:23.696201 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.696169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26ebde42-07a3-4bae-b232-1081738e71e4-maas-api-tls\") pod \"maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:23.696465 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.696436    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ebde42-07a3-4bae-b232-1081738e71e4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:23.696529 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.696483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kzcl\" (UniqueName: \"kubernetes.io/projected/26ebde42-07a3-4bae-b232-1081738e71e4-kube-api-access-8kzcl\") pod \"maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:23.797633 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.797594    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ebde42-07a3-4bae-b232-1081738e71e4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:23.797814 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.797641    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kzcl\" (UniqueName: \"kubernetes.io/projected/26ebde42-07a3-4bae-b232-1081738e71e4-kube-api-access-8kzcl\") pod \"maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:23.797814 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.797717    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26ebde42-07a3-4bae-b232-1081738e71e4-maas-api-tls\") pod \"maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:23.797898 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:29:23.797840    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-serving-cert: secret "maas-api-e2e-inf-a-d95f36-serving-cert" not found
Jul 23 10:29:23.797935 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:29:23.797899    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26ebde42-07a3-4bae-b232-1081738e71e4-maas-api-tls podName:26ebde42-07a3-4bae-b232-1081738e71e4 nodeName:}" failed. No retries permitted until 2026-07-23 10:29:24.297878541 +0000 UTC m=+2084.201566795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/26ebde42-07a3-4bae-b232-1081738e71e4-maas-api-tls") pod "maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7" (UID: "26ebde42-07a3-4bae-b232-1081738e71e4") : secret "maas-api-e2e-inf-a-d95f36-serving-cert" not found
Jul 23 10:29:23.798205 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.798186    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ebde42-07a3-4bae-b232-1081738e71e4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:23.809979 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:23.809955    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kzcl\" (UniqueName: \"kubernetes.io/projected/26ebde42-07a3-4bae-b232-1081738e71e4-kube-api-access-8kzcl\") pod \"maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:24.007202 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:24.007116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:24.136452 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:24.136404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:24.238576 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:24.238544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:24.302517 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:24.302441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26ebde42-07a3-4bae-b232-1081738e71e4-maas-api-tls\") pod \"maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:24.305000 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:24.304975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26ebde42-07a3-4bae-b232-1081738e71e4-maas-api-tls\") pod \"maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:24.513382 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:24.513352    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:24.862173 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:24.862148    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"]
Jul 23 10:29:24.864975 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:29:24.864938    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ebde42_07a3_4bae_b232_1081738e71e4.slice/crio-9388405e339a24e3a12777750b5cfd9b7f3555cfbc8f4fc9e838d6e85f4cd6fe WatchSource:0}: Error finding container 9388405e339a24e3a12777750b5cfd9b7f3555cfbc8f4fc9e838d6e85f4cd6fe: Status 404 returned error can't find the container with id 9388405e339a24e3a12777750b5cfd9b7f3555cfbc8f4fc9e838d6e85f4cd6fe
Jul 23 10:29:25.788113 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:25.788079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7" event={"ID":"26ebde42-07a3-4bae-b232-1081738e71e4","Type":"ContainerStarted","Data":"77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a"}
Jul 23 10:29:25.788529 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:25.788131    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7" event={"ID":"26ebde42-07a3-4bae-b232-1081738e71e4","Type":"ContainerStarted","Data":"9388405e339a24e3a12777750b5cfd9b7f3555cfbc8f4fc9e838d6e85f4cd6fe"}
Jul 23 10:29:25.788529 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:25.788213    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:25.805056 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:25.805011    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7" podStartSLOduration=2.384410526 podStartE2EDuration="2.804992527s" totalImagesPullingTime="420.582001ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:29:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:29:25.804708522 +0000 UTC m=+2085.708396797" watchObservedRunningTime="2026-07-23 10:29:25.804992527 +0000 UTC m=+2085.708680829"
Jul 23 10:29:27.902758 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:27.902725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:28.212448 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:28.212366    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:28.516734 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:28.516644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:28.779650 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:28.779553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:31.393346 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.393307    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:31.490313 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.490225    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:31.541855 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.541815    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"]
Jul 23 10:29:31.546239 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.546214    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:31.548736 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.548712    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6fb9c7-serving-cert\""
Jul 23 10:29:31.557582 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.557561    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"]
Jul 23 10:29:31.577113 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.577088    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:31.668691 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.668604    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:31.668691 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.668653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-maas-api-tls\") pod \"maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:31.668691 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.668686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6pw6\" (UniqueName: \"kubernetes.io/projected/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-kube-api-access-j6pw6\") pod \"maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:31.678146 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.678123    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:31.769430 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.769394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:31.769625 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.769450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-maas-api-tls\") pod \"maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:31.769625 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.769561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6pw6\" (UniqueName: \"kubernetes.io/projected/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-kube-api-access-j6pw6\") pod \"maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:31.770151 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.770133    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:31.772138 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.772117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-maas-api-tls\") pod \"maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:31.778159 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.778140    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6pw6\" (UniqueName: \"kubernetes.io/projected/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-kube-api-access-j6pw6\") pod \"maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:31.800039 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.800013    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:29:31.858997 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:31.858966    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:32.002536 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:32.002512    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"]
Jul 23 10:29:32.004926 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:29:32.004885    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f2bf635_8b4f_442d_9b0c_cb2fc2d7f591.slice/crio-cd9df2bd4c51007f20e1e323b2b9ac906efdce0fdcab617e3a090217ef7cdf04 WatchSource:0}: Error finding container cd9df2bd4c51007f20e1e323b2b9ac906efdce0fdcab617e3a090217ef7cdf04: Status 404 returned error can't find the container with id cd9df2bd4c51007f20e1e323b2b9ac906efdce0fdcab617e3a090217ef7cdf04
Jul 23 10:29:32.049802 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:32.049757    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:32.149071 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:32.149042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:32.824478 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:32.824393    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9" event={"ID":"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591","Type":"ContainerStarted","Data":"be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2"}
Jul 23 10:29:32.824913 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:32.824489    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9" event={"ID":"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591","Type":"ContainerStarted","Data":"cd9df2bd4c51007f20e1e323b2b9ac906efdce0fdcab617e3a090217ef7cdf04"}
Jul 23 10:29:32.824913 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:32.824522    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:32.843367 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:32.843315    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9" podStartSLOduration=1.4506172099999999 podStartE2EDuration="1.843298634s" totalImagesPullingTime="392.681424ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:29:32.841056847 +0000 UTC m=+2092.744745135" watchObservedRunningTime="2026-07-23 10:29:32.843298634 +0000 UTC m=+2092.746986907"
Jul 23 10:29:35.960639 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:35.960600    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:38.835984 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:38.835949    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:29:40.710147 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:40.710124    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:29:40.712132 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:40.712109    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:29:43.590134 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:43.590092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:44.884444 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:44.884414    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:44.983849 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:44.983822    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:52.961396 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:52.961360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:29:53.059935 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:29:53.059905    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:30:20.845363 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:30:20.845325    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:30:33.660304 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:30:33.660212    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:30:33.728915 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:30:33.728881    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:01.314852 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:01.314819    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:02.310074 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:02.310044    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:03.084071 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:03.084032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:03.176070 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:03.176038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:12.975339 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:12.975303    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"]
Jul 23 10:31:12.975733 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:12.975567    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7" podUID="26ebde42-07a3-4bae-b232-1081738e71e4" containerName="maas-api" containerID="cri-o://77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a" gracePeriod=30
Jul 23 10:31:13.013155 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.013130    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:13.226662 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.226593    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:31:13.305408 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.305383    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26ebde42-07a3-4bae-b232-1081738e71e4-maas-api-tls\") pod \"26ebde42-07a3-4bae-b232-1081738e71e4\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") "
Jul 23 10:31:13.305603 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.305415    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ebde42-07a3-4bae-b232-1081738e71e4-openshift-service-ca\") pod \"26ebde42-07a3-4bae-b232-1081738e71e4\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") "
Jul 23 10:31:13.305603 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.305457    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kzcl\" (UniqueName: \"kubernetes.io/projected/26ebde42-07a3-4bae-b232-1081738e71e4-kube-api-access-8kzcl\") pod \"26ebde42-07a3-4bae-b232-1081738e71e4\" (UID: \"26ebde42-07a3-4bae-b232-1081738e71e4\") "
Jul 23 10:31:13.305841 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.305812    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26ebde42-07a3-4bae-b232-1081738e71e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26ebde42-07a3-4bae-b232-1081738e71e4" (UID: "26ebde42-07a3-4bae-b232-1081738e71e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:31:13.307734 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.307707    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26ebde42-07a3-4bae-b232-1081738e71e4-kube-api-access-8kzcl" (OuterVolumeSpecName: "kube-api-access-8kzcl") pod "26ebde42-07a3-4bae-b232-1081738e71e4" (UID: "26ebde42-07a3-4bae-b232-1081738e71e4"). InnerVolumeSpecName "kube-api-access-8kzcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:31:13.307867 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.307728    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26ebde42-07a3-4bae-b232-1081738e71e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26ebde42-07a3-4bae-b232-1081738e71e4" (UID: "26ebde42-07a3-4bae-b232-1081738e71e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:31:13.313028 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.313004    2564 generic.go:356] "Generic (PLEG): container finished" podID="26ebde42-07a3-4bae-b232-1081738e71e4" containerID="77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a" exitCode=0
Jul 23 10:31:13.313145 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.313046    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"
Jul 23 10:31:13.313145 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.313050    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7" event={"ID":"26ebde42-07a3-4bae-b232-1081738e71e4","Type":"ContainerDied","Data":"77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a"}
Jul 23 10:31:13.313145 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.313107    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7" event={"ID":"26ebde42-07a3-4bae-b232-1081738e71e4","Type":"ContainerDied","Data":"9388405e339a24e3a12777750b5cfd9b7f3555cfbc8f4fc9e838d6e85f4cd6fe"}
Jul 23 10:31:13.313145 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.313142    2564 scope.go:117] "RemoveContainer" containerID="77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a"
Jul 23 10:31:13.327154 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.327128    2564 scope.go:117] "RemoveContainer" containerID="77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a"
Jul 23 10:31:13.327478 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:31:13.327458    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a\": container with ID starting with 77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a not found: ID does not exist" containerID="77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a"
Jul 23 10:31:13.327553 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.327486    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a"} err="failed to get container status \"77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a\": rpc error: code = NotFound desc = could not find container \"77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a\": container with ID starting with 77760cd4bcbca703eeeecd1b45527091343b5a1bf299c75ee3d77030e701615a not found: ID does not exist"
Jul 23 10:31:13.345652 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.345625    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"]
Jul 23 10:31:13.349520 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.349498    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-d95f36-67f6b7b8df-dhst7"]
Jul 23 10:31:13.407028 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.406999    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kzcl\" (UniqueName: \"kubernetes.io/projected/26ebde42-07a3-4bae-b232-1081738e71e4-kube-api-access-8kzcl\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:31:13.407028 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.407022    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26ebde42-07a3-4bae-b232-1081738e71e4-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:31:13.407028 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:13.407032    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26ebde42-07a3-4bae-b232-1081738e71e4-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:31:14.611319 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:14.611286    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26ebde42-07a3-4bae-b232-1081738e71e4" path="/var/lib/kubelet/pods/26ebde42-07a3-4bae-b232-1081738e71e4/volumes"
Jul 23 10:31:17.499697 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:17.499665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:17.930660 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:17.930616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:23.982981 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:23.982950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:24.085991 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:24.085956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:24.215942 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:24.215916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:24.458062 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:24.458028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:25.204570 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:25.204538    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:25.300739 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:25.300704    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:34.949862 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:34.949819    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"]
Jul 23 10:31:34.950556 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:34.950029    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9" podUID="8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591" containerName="maas-api" containerID="cri-o://be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2" gracePeriod=30
Jul 23 10:31:34.991344 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:34.989273    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:35.203831 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.203779    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:31:35.305417 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.305380    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-maas-api-tls\") pod \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") "
Jul 23 10:31:35.305590 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.305459    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6pw6\" (UniqueName: \"kubernetes.io/projected/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-kube-api-access-j6pw6\") pod \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") "
Jul 23 10:31:35.305590 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.305504    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-openshift-service-ca\") pod \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\" (UID: \"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591\") "
Jul 23 10:31:35.305854 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.305829    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591" (UID: "8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:31:35.307705 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.307677    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-kube-api-access-j6pw6" (OuterVolumeSpecName: "kube-api-access-j6pw6") pod "8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591" (UID: "8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591"). InnerVolumeSpecName "kube-api-access-j6pw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:31:35.307763 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.307713    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591" (UID: "8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:31:35.406910 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.406869    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6pw6\" (UniqueName: \"kubernetes.io/projected/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-kube-api-access-j6pw6\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:31:35.406910 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.406903    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:31:35.406910 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.406913    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:31:35.432079 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.432045    2564 generic.go:356] "Generic (PLEG): container finished" podID="8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591" containerID="be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2" exitCode=0
Jul 23 10:31:35.432244 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.432101    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"
Jul 23 10:31:35.432244 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.432121    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9" event={"ID":"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591","Type":"ContainerDied","Data":"be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2"}
Jul 23 10:31:35.432244 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.432191    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9" event={"ID":"8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591","Type":"ContainerDied","Data":"cd9df2bd4c51007f20e1e323b2b9ac906efdce0fdcab617e3a090217ef7cdf04"}
Jul 23 10:31:35.432244 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.432220    2564 scope.go:117] "RemoveContainer" containerID="be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2"
Jul 23 10:31:35.440822 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.440804    2564 scope.go:117] "RemoveContainer" containerID="be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2"
Jul 23 10:31:35.441086 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:31:35.441065    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2\": container with ID starting with be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2 not found: ID does not exist" containerID="be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2"
Jul 23 10:31:35.441178 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.441093    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2"} err="failed to get container status \"be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2\": rpc error: code = NotFound desc = could not find container \"be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2\": container with ID starting with be61f57a5b79453284daff2df12ed8d187fd20737054d66fdaa703a4f30afea2 not found: ID does not exist"
Jul 23 10:31:35.457271 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.457202    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"]
Jul 23 10:31:35.460176 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:35.460153    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6fb9c7-58dbf9db96-dzmk9"]
Jul 23 10:31:36.609973 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:36.609940    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591" path="/var/lib/kubelet/pods/8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591/volumes"
Jul 23 10:31:39.674501 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:39.674471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:40.108791 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:40.108700    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:45.866388 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:45.866352    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:46.688101 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:46.688063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:46.780756 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:46.780719    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:47.112078 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:47.111991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:47.931537 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:47.931494    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:48.617917 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:48.617887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:50.162314 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.162244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:50.237380 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.237339    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"]
Jul 23 10:31:50.237988 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.237960    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591" containerName="maas-api"
Jul 23 10:31:50.237988 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.237987    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591" containerName="maas-api"
Jul 23 10:31:50.238094 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.238029    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26ebde42-07a3-4bae-b232-1081738e71e4" containerName="maas-api"
Jul 23 10:31:50.238094 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.238038    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="26ebde42-07a3-4bae-b232-1081738e71e4" containerName="maas-api"
Jul 23 10:31:50.238167 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.238143    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="26ebde42-07a3-4bae-b232-1081738e71e4" containerName="maas-api"
Jul 23 10:31:50.238167 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.238157    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f2bf635-8b4f-442d-9b0c-cb2fc2d7f591" containerName="maas-api"
Jul 23 10:31:50.241681 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.241658    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.244299 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.244243    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b4fbcc-serving-cert\""
Jul 23 10:31:50.253106 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.253064    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"]
Jul 23 10:31:50.257536 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.257511    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:50.332403 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.332364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:50.352163 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.352135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a580c051-3467-4b2f-b5ec-677dab970599-maas-api-tls\") pod \"maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.352339 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.352168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a580c051-3467-4b2f-b5ec-677dab970599-openshift-service-ca\") pod \"maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.352339 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.352189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv25x\" (UniqueName: \"kubernetes.io/projected/a580c051-3467-4b2f-b5ec-677dab970599-kube-api-access-qv25x\") pod \"maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.449068 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.448991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:50.453242 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.453209    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a580c051-3467-4b2f-b5ec-677dab970599-maas-api-tls\") pod \"maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.453353 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.453283    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a580c051-3467-4b2f-b5ec-677dab970599-openshift-service-ca\") pod \"maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.453353 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.453313    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv25x\" (UniqueName: \"kubernetes.io/projected/a580c051-3467-4b2f-b5ec-677dab970599-kube-api-access-qv25x\") pod \"maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.453900 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.453876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a580c051-3467-4b2f-b5ec-677dab970599-openshift-service-ca\") pod \"maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.455793 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.455776    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a580c051-3467-4b2f-b5ec-677dab970599-maas-api-tls\") pod \"maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.462135 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.462113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv25x\" (UniqueName: \"kubernetes.io/projected/a580c051-3467-4b2f-b5ec-677dab970599-kube-api-access-qv25x\") pod \"maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.554175 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.554147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:50.707669 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.707644    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"]
Jul 23 10:31:50.709927 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:31:50.709895    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda580c051_3467_4b2f_b5ec_677dab970599.slice/crio-b7e76d07b50b54f37ea4a62087bfa7f098164f44e5ec901e68ece19d87ec76c2 WatchSource:0}: Error finding container b7e76d07b50b54f37ea4a62087bfa7f098164f44e5ec901e68ece19d87ec76c2: Status 404 returned error can't find the container with id b7e76d07b50b54f37ea4a62087bfa7f098164f44e5ec901e68ece19d87ec76c2
Jul 23 10:31:50.711350 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.711326    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 10:31:50.728982 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.728956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:50.830899 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:50.830860    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:51.516961 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:51.516924    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn" event={"ID":"a580c051-3467-4b2f-b5ec-677dab970599","Type":"ContainerStarted","Data":"45285e7d10d377780c2b4fc0def31eced22a6b87ed55e8deb72ebe9b1547e301"}
Jul 23 10:31:51.517339 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:51.516985    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn" event={"ID":"a580c051-3467-4b2f-b5ec-677dab970599","Type":"ContainerStarted","Data":"b7e76d07b50b54f37ea4a62087bfa7f098164f44e5ec901e68ece19d87ec76c2"}
Jul 23 10:31:51.517339 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:51.517090    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:51.540846 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:51.540737    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn" podStartSLOduration=0.965133056 podStartE2EDuration="1.540715737s" totalImagesPullingTime="575.582681ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:31:51.536580273 +0000 UTC m=+2231.440268548" watchObservedRunningTime="2026-07-23 10:31:51.540715737 +0000 UTC m=+2231.444404011"
Jul 23 10:31:54.764710 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:54.764674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:55.145353 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:55.145321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:55.469903 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:55.469812    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:55.839310 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:55.839209    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:57.527817 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:57.527775    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:31:58.239156 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.239103    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:58.314697 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.314661    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"]
Jul 23 10:31:58.317530 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.317500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:58.319171 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.319147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.322014 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.321998    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-2df747-serving-cert\""
Jul 23 10:31:58.330966 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.330944    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"]
Jul 23 10:31:58.386680 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.386644    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:58.425868 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.425832    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttr6d\" (UniqueName: \"kubernetes.io/projected/33b94d56-f93d-450a-9358-e34e0a93cedb-kube-api-access-ttr6d\") pod \"maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.426059 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.425897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b94d56-f93d-450a-9358-e34e0a93cedb-openshift-service-ca\") pod \"maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.426059 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.425954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b94d56-f93d-450a-9358-e34e0a93cedb-maas-api-tls\") pod \"maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.525166 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.525082    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:58.527239 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.527213    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttr6d\" (UniqueName: \"kubernetes.io/projected/33b94d56-f93d-450a-9358-e34e0a93cedb-kube-api-access-ttr6d\") pod \"maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.527377 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.527277    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b94d56-f93d-450a-9358-e34e0a93cedb-openshift-service-ca\") pod \"maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.527377 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.527310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b94d56-f93d-450a-9358-e34e0a93cedb-maas-api-tls\") pod \"maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.527950 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.527926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b94d56-f93d-450a-9358-e34e0a93cedb-openshift-service-ca\") pod \"maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.529718 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.529698    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b94d56-f93d-450a-9358-e34e0a93cedb-maas-api-tls\") pod \"maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.538839 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.538812    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttr6d\" (UniqueName: \"kubernetes.io/projected/33b94d56-f93d-450a-9358-e34e0a93cedb-kube-api-access-ttr6d\") pod \"maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.634434 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.634396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:31:58.773650 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:58.773622    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"]
Jul 23 10:31:58.775466 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:31:58.775393    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b94d56_f93d_450a_9358_e34e0a93cedb.slice/crio-595caca883752f562691c23f80dfd2422e5913f399cb487d19be9a1077f98c82 WatchSource:0}: Error finding container 595caca883752f562691c23f80dfd2422e5913f399cb487d19be9a1077f98c82: Status 404 returned error can't find the container with id 595caca883752f562691c23f80dfd2422e5913f399cb487d19be9a1077f98c82
Jul 23 10:31:59.033076 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:59.032991    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:59.132708 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:59.132674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:31:59.564238 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:31:59.564201    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj" event={"ID":"33b94d56-f93d-450a-9358-e34e0a93cedb","Type":"ContainerStarted","Data":"595caca883752f562691c23f80dfd2422e5913f399cb487d19be9a1077f98c82"}
Jul 23 10:32:01.576059 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:01.575968    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj" event={"ID":"33b94d56-f93d-450a-9358-e34e0a93cedb","Type":"ContainerStarted","Data":"365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc"}
Jul 23 10:32:01.576468 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:01.576060    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:32:01.594368 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:01.594322    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj" podStartSLOduration=1.81146093 podStartE2EDuration="3.594306697s" totalImagesPullingTime="1.782845767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:32:01.592288984 +0000 UTC m=+2241.495977441" watchObservedRunningTime="2026-07-23 10:32:01.594306697 +0000 UTC m=+2241.497994976"
Jul 23 10:32:03.548643 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:03.548606    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:07.587878 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:07.587854    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:32:11.357588 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:11.357558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:11.457921 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:11.457876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:19.802785 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:19.802753    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:19.903392 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:19.903357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:21.350215 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:21.350179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:21.463530 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:21.463490    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:26.577411 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:26.577382    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"]
Jul 23 10:32:26.577966 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:26.577710    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn" podUID="a580c051-3467-4b2f-b5ec-677dab970599" containerName="maas-api" containerID="cri-o://45285e7d10d377780c2b4fc0def31eced22a6b87ed55e8deb72ebe9b1547e301" gracePeriod=30
Jul 23 10:32:26.602151 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:26.602122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:26.704873 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:26.704844    2564 generic.go:356] "Generic (PLEG): container finished" podID="a580c051-3467-4b2f-b5ec-677dab970599" containerID="45285e7d10d377780c2b4fc0def31eced22a6b87ed55e8deb72ebe9b1547e301" exitCode=0
Jul 23 10:32:26.705011 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:26.704887    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn" event={"ID":"a580c051-3467-4b2f-b5ec-677dab970599","Type":"ContainerDied","Data":"45285e7d10d377780c2b4fc0def31eced22a6b87ed55e8deb72ebe9b1547e301"}
Jul 23 10:32:26.818419 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:26.818398    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:32:27.000627 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.000599    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a580c051-3467-4b2f-b5ec-677dab970599-maas-api-tls\") pod \"a580c051-3467-4b2f-b5ec-677dab970599\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") "
Jul 23 10:32:27.000804 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.000682    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv25x\" (UniqueName: \"kubernetes.io/projected/a580c051-3467-4b2f-b5ec-677dab970599-kube-api-access-qv25x\") pod \"a580c051-3467-4b2f-b5ec-677dab970599\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") "
Jul 23 10:32:27.000804 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.000701    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a580c051-3467-4b2f-b5ec-677dab970599-openshift-service-ca\") pod \"a580c051-3467-4b2f-b5ec-677dab970599\" (UID: \"a580c051-3467-4b2f-b5ec-677dab970599\") "
Jul 23 10:32:27.001136 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.001104    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a580c051-3467-4b2f-b5ec-677dab970599-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a580c051-3467-4b2f-b5ec-677dab970599" (UID: "a580c051-3467-4b2f-b5ec-677dab970599"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:32:27.002756 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.002736    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a580c051-3467-4b2f-b5ec-677dab970599-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a580c051-3467-4b2f-b5ec-677dab970599" (UID: "a580c051-3467-4b2f-b5ec-677dab970599"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:32:27.002881 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.002858    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a580c051-3467-4b2f-b5ec-677dab970599-kube-api-access-qv25x" (OuterVolumeSpecName: "kube-api-access-qv25x") pod "a580c051-3467-4b2f-b5ec-677dab970599" (UID: "a580c051-3467-4b2f-b5ec-677dab970599"). InnerVolumeSpecName "kube-api-access-qv25x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:32:27.102057 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.102021    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv25x\" (UniqueName: \"kubernetes.io/projected/a580c051-3467-4b2f-b5ec-677dab970599-kube-api-access-qv25x\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:32:27.102057 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.102056    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a580c051-3467-4b2f-b5ec-677dab970599-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:32:27.102239 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.102070    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a580c051-3467-4b2f-b5ec-677dab970599-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:32:27.710996 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.710960    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"
Jul 23 10:32:27.710996 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.710967    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn" event={"ID":"a580c051-3467-4b2f-b5ec-677dab970599","Type":"ContainerDied","Data":"b7e76d07b50b54f37ea4a62087bfa7f098164f44e5ec901e68ece19d87ec76c2"}
Jul 23 10:32:27.711509 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.711034    2564 scope.go:117] "RemoveContainer" containerID="45285e7d10d377780c2b4fc0def31eced22a6b87ed55e8deb72ebe9b1547e301"
Jul 23 10:32:27.732351 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.732320    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"]
Jul 23 10:32:27.737115 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:27.737088    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b4fbcc-857f7d6457-qgmtn"]
Jul 23 10:32:28.610694 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:28.610657    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a580c051-3467-4b2f-b5ec-677dab970599" path="/var/lib/kubelet/pods/a580c051-3467-4b2f-b5ec-677dab970599/volumes"
Jul 23 10:32:30.914415 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:30.914382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:32.282309 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:32.282278    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:37.289635 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:37.289603    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:37.390288 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:37.390245    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:37.557066 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:37.556977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:37.776226 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:37.776197    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:38.401084 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:38.401048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:38.500762 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:38.500731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:53.431753 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.431716    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"]
Jul 23 10:32:53.432585 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.432527    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj" podUID="33b94d56-f93d-450a-9358-e34e0a93cedb" containerName="maas-api" containerID="cri-o://365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc" gracePeriod=30
Jul 23 10:32:53.467803 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.467778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:53.686917 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.686862    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:32:53.754376 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.754347    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b94d56-f93d-450a-9358-e34e0a93cedb-maas-api-tls\") pod \"33b94d56-f93d-450a-9358-e34e0a93cedb\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") "
Jul 23 10:32:53.754545 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.754450    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b94d56-f93d-450a-9358-e34e0a93cedb-openshift-service-ca\") pod \"33b94d56-f93d-450a-9358-e34e0a93cedb\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") "
Jul 23 10:32:53.754545 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.754497    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttr6d\" (UniqueName: \"kubernetes.io/projected/33b94d56-f93d-450a-9358-e34e0a93cedb-kube-api-access-ttr6d\") pod \"33b94d56-f93d-450a-9358-e34e0a93cedb\" (UID: \"33b94d56-f93d-450a-9358-e34e0a93cedb\") "
Jul 23 10:32:53.754769 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.754739    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33b94d56-f93d-450a-9358-e34e0a93cedb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "33b94d56-f93d-450a-9358-e34e0a93cedb" (UID: "33b94d56-f93d-450a-9358-e34e0a93cedb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:32:53.756674 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.756651    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b94d56-f93d-450a-9358-e34e0a93cedb-kube-api-access-ttr6d" (OuterVolumeSpecName: "kube-api-access-ttr6d") pod "33b94d56-f93d-450a-9358-e34e0a93cedb" (UID: "33b94d56-f93d-450a-9358-e34e0a93cedb"). InnerVolumeSpecName "kube-api-access-ttr6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:32:53.756749 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.756677    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33b94d56-f93d-450a-9358-e34e0a93cedb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "33b94d56-f93d-450a-9358-e34e0a93cedb" (UID: "33b94d56-f93d-450a-9358-e34e0a93cedb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:32:53.855209 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.855167    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b94d56-f93d-450a-9358-e34e0a93cedb-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:32:53.855209 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.855193    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttr6d\" (UniqueName: \"kubernetes.io/projected/33b94d56-f93d-450a-9358-e34e0a93cedb-kube-api-access-ttr6d\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:32:53.855209 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.855208    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b94d56-f93d-450a-9358-e34e0a93cedb-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:32:53.855481 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.855340    2564 generic.go:356] "Generic (PLEG): container finished" podID="33b94d56-f93d-450a-9358-e34e0a93cedb" containerID="365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc" exitCode=0
Jul 23 10:32:53.855481 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.855381    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"
Jul 23 10:32:53.855481 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.855436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj" event={"ID":"33b94d56-f93d-450a-9358-e34e0a93cedb","Type":"ContainerDied","Data":"365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc"}
Jul 23 10:32:53.855640 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.855494    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj" event={"ID":"33b94d56-f93d-450a-9358-e34e0a93cedb","Type":"ContainerDied","Data":"595caca883752f562691c23f80dfd2422e5913f399cb487d19be9a1077f98c82"}
Jul 23 10:32:53.855640 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.855527    2564 scope.go:117] "RemoveContainer" containerID="365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc"
Jul 23 10:32:53.865910 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.865893    2564 scope.go:117] "RemoveContainer" containerID="365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc"
Jul 23 10:32:53.866183 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:32:53.866163    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc\": container with ID starting with 365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc not found: ID does not exist" containerID="365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc"
Jul 23 10:32:53.866229 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.866194    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc"} err="failed to get container status \"365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc\": rpc error: code = NotFound desc = could not find container \"365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc\": container with ID starting with 365bf857a0307e108f4a3e2626a061008d020d26ae877b1d1027f49da3839dfc not found: ID does not exist"
Jul 23 10:32:53.879838 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.879818    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"]
Jul 23 10:32:53.887768 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:53.887748    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2df747-74cd8fbdf8-s9ljj"]
Jul 23 10:32:54.610040 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:54.610007    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33b94d56-f93d-450a-9358-e34e0a93cedb" path="/var/lib/kubelet/pods/33b94d56-f93d-450a-9358-e34e0a93cedb/volumes"
Jul 23 10:32:57.987561 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:57.987531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:32:58.393688 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:32:58.393654    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:04.069247 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:04.069211    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:04.169365 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:04.169338    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:04.344083 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:04.344004    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:04.565565 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:04.565537    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:04.914576 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:04.914547    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:05.258748 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:05.258641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:05.358759 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:05.358725    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:07.318633 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:07.318601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:07.450566 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:07.450539    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:08.686770 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.686741    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:08.692551 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.692527    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"]
Jul 23 10:33:08.692913 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.692900    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b94d56-f93d-450a-9358-e34e0a93cedb" containerName="maas-api"
Jul 23 10:33:08.692962 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.692915    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b94d56-f93d-450a-9358-e34e0a93cedb" containerName="maas-api"
Jul 23 10:33:08.692962 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.692935    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a580c051-3467-4b2f-b5ec-677dab970599" containerName="maas-api"
Jul 23 10:33:08.692962 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.692940    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a580c051-3467-4b2f-b5ec-677dab970599" containerName="maas-api"
Jul 23 10:33:08.693070 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.692993    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b94d56-f93d-450a-9358-e34e0a93cedb" containerName="maas-api"
Jul 23 10:33:08.693070 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.693002    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a580c051-3467-4b2f-b5ec-677dab970599" containerName="maas-api"
Jul 23 10:33:08.697560 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.697533    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:08.700240 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.700223    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-d0ac3e-serving-cert\""
Jul 23 10:33:08.710217 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.710198    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"]
Jul 23 10:33:08.780669 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.780636    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:08.797944 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.797914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmzwv\" (UniqueName: \"kubernetes.io/projected/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-kube-api-access-kmzwv\") pod \"maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:08.798101 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.798015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-maas-api-tls\") pod \"maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:08.798101 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.798048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:08.879852 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.879816    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:08.899032 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.899001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-maas-api-tls\") pod \"maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:08.899032 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.899031    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:08.899238 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.899088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmzwv\" (UniqueName: \"kubernetes.io/projected/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-kube-api-access-kmzwv\") pod \"maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:08.899750 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.899725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:08.901522 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.901505    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-maas-api-tls\") pod \"maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:08.908888 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:08.908857    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmzwv\" (UniqueName: \"kubernetes.io/projected/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-kube-api-access-kmzwv\") pod \"maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:09.009843 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:09.009769    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:09.162118 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:09.162093    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"]
Jul 23 10:33:09.164327 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:33:09.164288    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf570b038_63a9_4ba6_84e6_f1fa6dcddb5d.slice/crio-e4761cd9050a468f6f0c37371a070ba8070f1d6537806abc5076dff3952d8633 WatchSource:0}: Error finding container e4761cd9050a468f6f0c37371a070ba8070f1d6537806abc5076dff3952d8633: Status 404 returned error can't find the container with id e4761cd9050a468f6f0c37371a070ba8070f1d6537806abc5076dff3952d8633
Jul 23 10:33:09.185379 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:09.185347    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:09.286890 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:09.286805    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:09.933599 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:09.933561    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd" event={"ID":"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d","Type":"ContainerStarted","Data":"b025f63edf0dae29b6a08753b5fb97fda17f16762e424466b87b6c37d87375f2"}
Jul 23 10:33:09.934058 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:09.933615    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd" event={"ID":"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d","Type":"ContainerStarted","Data":"e4761cd9050a468f6f0c37371a070ba8070f1d6537806abc5076dff3952d8633"}
Jul 23 10:33:09.934058 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:09.933685    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:09.955649 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:09.955598    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd" podStartSLOduration=1.5903468790000002 podStartE2EDuration="1.955579567s" totalImagesPullingTime="365.232688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:33:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:33:09.953461066 +0000 UTC m=+2309.857149341" watchObservedRunningTime="2026-07-23 10:33:09.955579567 +0000 UTC m=+2309.859267892"
Jul 23 10:33:13.158872 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:13.158838    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:13.505837 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:13.505758    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:13.887549 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:13.887512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:14.332484 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:14.332399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:15.944759 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:15.944731    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:33:16.646827 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.646789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:16.721549 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.721519    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"]
Jul 23 10:33:16.725700 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.725677    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:16.729077 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.729050    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-bc0d57-serving-cert\""
Jul 23 10:33:16.742352 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.742327    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"]
Jul 23 10:33:16.766181 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.766153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:16.767584 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.767561    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hps5r\" (UniqueName: \"kubernetes.io/projected/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-kube-api-access-hps5r\") pod \"maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:16.767706 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.767591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:16.767759 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.767735    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:16.868292 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.868237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:16.868456 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.868339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hps5r\" (UniqueName: \"kubernetes.io/projected/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-kube-api-access-hps5r\") pod \"maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:16.868456 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.868370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:16.868456 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:33:16.868430    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-serving-cert: secret "maas-api-e2e-shared-b-bc0d57-serving-cert" not found
Jul 23 10:33:16.868609 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:33:16.868502    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-maas-api-tls podName:a693aa36-247a-4ffd-ab92-bc4bcffcc20c nodeName:}" failed. No retries permitted until 2026-07-23 10:33:17.368480538 +0000 UTC m=+2317.272168795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-maas-api-tls") pod "maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4" (UID: "a693aa36-247a-4ffd-ab92-bc4bcffcc20c") : secret "maas-api-e2e-shared-b-bc0d57-serving-cert" not found
Jul 23 10:33:16.869068 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.869049    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:16.878128 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.878107    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hps5r\" (UniqueName: \"kubernetes.io/projected/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-kube-api-access-hps5r\") pod \"maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:16.911716 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:16.911642    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:17.126817 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:17.126769    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:17.373874 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:17.373786    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:17.376316 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:17.376296    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:17.384056 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:17.384022    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:17.483634 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:17.483599    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:17.640482 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:17.640452    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:17.800616 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:17.800557    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"]
Jul 23 10:33:17.802486 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:33:17.802456    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda693aa36_247a_4ffd_ab92_bc4bcffcc20c.slice/crio-b4dea5210db73db72f28a07b645b1ac53fb8680ebd69e4fc6c62fd988a1414b5 WatchSource:0}: Error finding container b4dea5210db73db72f28a07b645b1ac53fb8680ebd69e4fc6c62fd988a1414b5: Status 404 returned error can't find the container with id b4dea5210db73db72f28a07b645b1ac53fb8680ebd69e4fc6c62fd988a1414b5
Jul 23 10:33:17.976598 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:17.976515    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4" event={"ID":"a693aa36-247a-4ffd-ab92-bc4bcffcc20c","Type":"ContainerStarted","Data":"b4dea5210db73db72f28a07b645b1ac53fb8680ebd69e4fc6c62fd988a1414b5"}
Jul 23 10:33:18.983001 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:18.982968    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4" event={"ID":"a693aa36-247a-4ffd-ab92-bc4bcffcc20c","Type":"ContainerStarted","Data":"6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680"}
Jul 23 10:33:18.983459 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:18.983049    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:19.002673 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:19.002626    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4" podStartSLOduration=2.416865969 podStartE2EDuration="3.00261215s" totalImagesPullingTime="585.746181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:33:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:33:19.001433942 +0000 UTC m=+2318.905122217" watchObservedRunningTime="2026-07-23 10:33:19.00261215 +0000 UTC m=+2318.906300424"
Jul 23 10:33:21.158987 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:21.158956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:22.405705 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:22.405671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:24.994330 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:24.994298    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:33:28.831451 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:28.831420    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:28.951169 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:28.951143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:30.035562 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:30.035531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:30.974056 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:30.974024    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:33.521115 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:33.521083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:37.996856 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:37.996818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:39.015535 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:39.015496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:33:39.115907 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:33:39.115871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:34:12.130351 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:34:12.130321    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:34:28.869215 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:34:28.869177    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:34:33.966488 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:34:33.966448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:34:40.743593 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:34:40.743566    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:34:40.746799 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:34:40.746775    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:36:17.756970 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:36:17.756929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:36:18.725851 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:36:18.725817    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:36:52.816894 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:36:52.816861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:37:08.147146 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:08.147108    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:37:42.982761 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:42.982727    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:37:44.302315 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:44.302278    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:37:48.191240 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.191193    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"]
Jul 23 10:37:48.196539 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.196501    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.200597 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.200512    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d0ac3e\"/\"openshift-service-ca.crt\""
Jul 23 10:37:48.200597 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.200591    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d0ac3e\"/\"kube-root-ca.crt\""
Jul 23 10:37:48.200841 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.200591    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d0ac3e\"/\"default-dockercfg-pr2w9\""
Jul 23 10:37:48.200841 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.200779    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d0ac3e\"/\"rate-test-model-d0ac3e-kserve-self-signed-certs\""
Jul 23 10:37:48.203238 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.203210    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"]
Jul 23 10:37:48.268999 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.268953    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:37:48.309767 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.309734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-model-cache\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.309767 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.309776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d191c26-7109-4ba4-845e-58a2c031c9a7-tls-certs\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.310000 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.309816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-dshm\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.310000 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.309904    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-tmp-dir\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.310000 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.309938    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czdzm\" (UniqueName: \"kubernetes.io/projected/1d191c26-7109-4ba4-845e-58a2c031c9a7-kube-api-access-czdzm\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.310113 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.310013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-home\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.411392 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.411353    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-home\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.411392 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.411398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-model-cache\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.411711 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.411423    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d191c26-7109-4ba4-845e-58a2c031c9a7-tls-certs\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.411711 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.411461    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-dshm\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.411711 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.411494    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-tmp-dir\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.411711 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.411516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czdzm\" (UniqueName: \"kubernetes.io/projected/1d191c26-7109-4ba4-845e-58a2c031c9a7-kube-api-access-czdzm\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.411926 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.411871    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-home\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.411926 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.411878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-tmp-dir\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.412019 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.411934    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-model-cache\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.414162 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.414133    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-dshm\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.414395 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.414377    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d191c26-7109-4ba4-845e-58a2c031c9a7-tls-certs\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.420138 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.420113    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czdzm\" (UniqueName: \"kubernetes.io/projected/1d191c26-7109-4ba4-845e-58a2c031c9a7-kube-api-access-czdzm\") pod \"rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") " pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.508140 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.508054    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:48.661077 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:48.661050    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"]
Jul 23 10:37:48.663219 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:37:48.663191    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d191c26_7109_4ba4_845e_58a2c031c9a7.slice/crio-d3918fd6ce1ae42c9daa74c8f1f1c8107ced7c7e9d2ad9d0c9ebd91ec434b0c8 WatchSource:0}: Error finding container d3918fd6ce1ae42c9daa74c8f1f1c8107ced7c7e9d2ad9d0c9ebd91ec434b0c8: Status 404 returned error can't find the container with id d3918fd6ce1ae42c9daa74c8f1f1c8107ced7c7e9d2ad9d0c9ebd91ec434b0c8
Jul 23 10:37:49.309818 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:49.309783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq" event={"ID":"1d191c26-7109-4ba4-845e-58a2c031c9a7","Type":"ContainerStarted","Data":"15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc"}
Jul 23 10:37:49.309818 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:49.309833    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq" event={"ID":"1d191c26-7109-4ba4-845e-58a2c031c9a7","Type":"ContainerStarted","Data":"d3918fd6ce1ae42c9daa74c8f1f1c8107ced7c7e9d2ad9d0c9ebd91ec434b0c8"}
Jul 23 10:37:49.329449 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:49.329395    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq" podStartSLOduration=1.329376788 podStartE2EDuration="1.329376788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 10:37:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:37:49.327773913 +0000 UTC m=+2589.231462189" watchObservedRunningTime="2026-07-23 10:37:49.329376788 +0000 UTC m=+2589.233065061"
Jul 23 10:37:58.508526 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:58.508481    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:58.508959 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:58.508599    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:58.521080 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:58.521045    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:37:59.375941 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:37:59.375914    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:38:12.414610 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:12.414522    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:38:29.723082 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:29.723038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:38:29.824461 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:29.824413    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:38:30.375135 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:30.375097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:38:30.902482 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:30.902447    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:38:31.001530 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:31.001492    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:38:40.031271 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:40.031220    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:38:40.128436 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:40.128403    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:38:52.760962 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:52.760927    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"]
Jul 23 10:38:52.782931 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:52.782859    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:38:53.733734 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:38:53.733694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:05.295215 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:05.295142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:05.364070 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:05.364034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:07.782564 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:07.782518    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq" podUID="1d191c26-7109-4ba4-845e-58a2c031c9a7" containerName="main" containerID="cri-o://15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc" gracePeriod=45
Jul 23 10:39:08.049454 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.049429    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:39:08.064188 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064164    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czdzm\" (UniqueName: \"kubernetes.io/projected/1d191c26-7109-4ba4-845e-58a2c031c9a7-kube-api-access-czdzm\") pod \"1d191c26-7109-4ba4-845e-58a2c031c9a7\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") "
Jul 23 10:39:08.064330 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064210    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-home\") pod \"1d191c26-7109-4ba4-845e-58a2c031c9a7\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") "
Jul 23 10:39:08.064330 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064285    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d191c26-7109-4ba4-845e-58a2c031c9a7-tls-certs\") pod \"1d191c26-7109-4ba4-845e-58a2c031c9a7\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") "
Jul 23 10:39:08.064330 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-tmp-dir\") pod \"1d191c26-7109-4ba4-845e-58a2c031c9a7\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") "
Jul 23 10:39:08.064473 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064340    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-dshm\") pod \"1d191c26-7109-4ba4-845e-58a2c031c9a7\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") "
Jul 23 10:39:08.064473 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064409    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-model-cache\") pod \"1d191c26-7109-4ba4-845e-58a2c031c9a7\" (UID: \"1d191c26-7109-4ba4-845e-58a2c031c9a7\") "
Jul 23 10:39:08.064581 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064474    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-home" (OuterVolumeSpecName: "home") pod "1d191c26-7109-4ba4-845e-58a2c031c9a7" (UID: "1d191c26-7109-4ba4-845e-58a2c031c9a7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:08.064636 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064591    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1d191c26-7109-4ba4-845e-58a2c031c9a7" (UID: "1d191c26-7109-4ba4-845e-58a2c031c9a7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:08.064690 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064676    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d191c26-7109-4ba4-845e-58a2c031c9a7" (UID: "1d191c26-7109-4ba4-845e-58a2c031c9a7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:08.064788 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064764    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-home\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:08.064788 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064787    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-tmp-dir\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:08.064925 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.064797    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-model-cache\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:08.066614 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.066593    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d191c26-7109-4ba4-845e-58a2c031c9a7-kube-api-access-czdzm" (OuterVolumeSpecName: "kube-api-access-czdzm") pod "1d191c26-7109-4ba4-845e-58a2c031c9a7" (UID: "1d191c26-7109-4ba4-845e-58a2c031c9a7"). InnerVolumeSpecName "kube-api-access-czdzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:39:08.066703 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.066628    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-dshm" (OuterVolumeSpecName: "dshm") pod "1d191c26-7109-4ba4-845e-58a2c031c9a7" (UID: "1d191c26-7109-4ba4-845e-58a2c031c9a7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 10:39:08.066703 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.066635    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d191c26-7109-4ba4-845e-58a2c031c9a7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d191c26-7109-4ba4-845e-58a2c031c9a7" (UID: "1d191c26-7109-4ba4-845e-58a2c031c9a7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:39:08.165242 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.165208    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czdzm\" (UniqueName: \"kubernetes.io/projected/1d191c26-7109-4ba4-845e-58a2c031c9a7-kube-api-access-czdzm\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:08.165242 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.165238    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d191c26-7109-4ba4-845e-58a2c031c9a7-tls-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:08.165242 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.165246    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d191c26-7109-4ba4-845e-58a2c031c9a7-dshm\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:08.630700 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:39:08.630666    2564 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d191c26_7109_4ba4_845e_58a2c031c9a7.slice\": RecentStats: unable to find data in memory cache]"
Jul 23 10:39:08.716420 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.716389    2564 generic.go:356] "Generic (PLEG): container finished" podID="1d191c26-7109-4ba4-845e-58a2c031c9a7" containerID="15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc" exitCode=0
Jul 23 10:39:08.716584 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.716434    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"
Jul 23 10:39:08.716584 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.716478    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq" event={"ID":"1d191c26-7109-4ba4-845e-58a2c031c9a7","Type":"ContainerDied","Data":"15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc"}
Jul 23 10:39:08.716584 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.716520    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq" event={"ID":"1d191c26-7109-4ba4-845e-58a2c031c9a7","Type":"ContainerDied","Data":"d3918fd6ce1ae42c9daa74c8f1f1c8107ced7c7e9d2ad9d0c9ebd91ec434b0c8"}
Jul 23 10:39:08.716584 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.716539    2564 scope.go:117] "RemoveContainer" containerID="15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc"
Jul 23 10:39:08.729455 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.729427    2564 scope.go:117] "RemoveContainer" containerID="15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc"
Jul 23 10:39:08.729775 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:39:08.729758    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc\": container with ID starting with 15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc not found: ID does not exist" containerID="15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc"
Jul 23 10:39:08.729858 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.729784    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc"} err="failed to get container status \"15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc\": rpc error: code = NotFound desc = could not find container \"15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc\": container with ID starting with 15208ad0c5a483778ec2b76dcd8fe8b58953c5cf99a872984d543882c24a30cc not found: ID does not exist"
Jul 23 10:39:08.740867 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.740841    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"]
Jul 23 10:39:08.746034 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:08.746011    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d0ac3e/rate-test-model-d0ac3e-kserve-56d97fbb55-ptvlq"]
Jul 23 10:39:10.611472 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:10.611435    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d191c26-7109-4ba4-845e-58a2c031c9a7" path="/var/lib/kubelet/pods/1d191c26-7109-4ba4-845e-58a2c031c9a7/volumes"
Jul 23 10:39:13.677798 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:13.677756    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:13.778202 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:13.778160    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:23.588229 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.588189    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"]
Jul 23 10:39:23.588789 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.588479    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd" podUID="f570b038-63a9-4ba6-84e6-f1fa6dcddb5d" containerName="maas-api" containerID="cri-o://b025f63edf0dae29b6a08753b5fb97fda17f16762e424466b87b6c37d87375f2" gracePeriod=30
Jul 23 10:39:23.621777 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.621738    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:23.800864 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.800832    2564 generic.go:356] "Generic (PLEG): container finished" podID="f570b038-63a9-4ba6-84e6-f1fa6dcddb5d" containerID="b025f63edf0dae29b6a08753b5fb97fda17f16762e424466b87b6c37d87375f2" exitCode=0
Jul 23 10:39:23.801032 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.800910    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd" event={"ID":"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d","Type":"ContainerDied","Data":"b025f63edf0dae29b6a08753b5fb97fda17f16762e424466b87b6c37d87375f2"}
Jul 23 10:39:23.843952 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.843890    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:39:23.916088 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.916043    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmzwv\" (UniqueName: \"kubernetes.io/projected/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-kube-api-access-kmzwv\") pod \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") "
Jul 23 10:39:23.916297 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.916175    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-maas-api-tls\") pod \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") "
Jul 23 10:39:23.916297 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.916197    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-openshift-service-ca\") pod \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\" (UID: \"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d\") "
Jul 23 10:39:23.916668 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.916630    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f570b038-63a9-4ba6-84e6-f1fa6dcddb5d" (UID: "f570b038-63a9-4ba6-84e6-f1fa6dcddb5d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:39:23.918299 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.918249    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-kube-api-access-kmzwv" (OuterVolumeSpecName: "kube-api-access-kmzwv") pod "f570b038-63a9-4ba6-84e6-f1fa6dcddb5d" (UID: "f570b038-63a9-4ba6-84e6-f1fa6dcddb5d"). InnerVolumeSpecName "kube-api-access-kmzwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:39:23.918391 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:23.918365    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f570b038-63a9-4ba6-84e6-f1fa6dcddb5d" (UID: "f570b038-63a9-4ba6-84e6-f1fa6dcddb5d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:39:24.017677 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:24.017628    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:24.017677 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:24.017671    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:24.017677 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:24.017683    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmzwv\" (UniqueName: \"kubernetes.io/projected/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d-kube-api-access-kmzwv\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:24.807777 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:24.807738    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd" event={"ID":"f570b038-63a9-4ba6-84e6-f1fa6dcddb5d","Type":"ContainerDied","Data":"e4761cd9050a468f6f0c37371a070ba8070f1d6537806abc5076dff3952d8633"}
Jul 23 10:39:24.807777 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:24.807760    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"
Jul 23 10:39:24.808277 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:24.807812    2564 scope.go:117] "RemoveContainer" containerID="b025f63edf0dae29b6a08753b5fb97fda17f16762e424466b87b6c37d87375f2"
Jul 23 10:39:24.826940 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:24.826903    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"]
Jul 23 10:39:24.830560 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:24.830539    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d0ac3e-5c7f7cdb54-g7vcd"]
Jul 23 10:39:26.610330 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:26.610298    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f570b038-63a9-4ba6-84e6-f1fa6dcddb5d" path="/var/lib/kubelet/pods/f570b038-63a9-4ba6-84e6-f1fa6dcddb5d/volumes"
Jul 23 10:39:28.256750 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:28.256706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:28.658836 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:28.658796    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:34.621838 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:34.621807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:34.723698 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:34.723662    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:34.898845 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:34.898809    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:35.131545 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:35.131506    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:35.885559 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:35.885505    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:35.979456 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:35.979416    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:40.771444 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:40.771411    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:39:40.775874 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:40.775848    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7c9b_a1580c5d-8c66-4cf8-8ead-874da37ffa96/ovn-acl-logging/0.log"
Jul 23 10:39:45.592616 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.592582    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"]
Jul 23 10:39:45.593080 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.592842    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4" podUID="a693aa36-247a-4ffd-ab92-bc4bcffcc20c" containerName="maas-api" containerID="cri-o://6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680" gracePeriod=30
Jul 23 10:39:45.613624 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.613597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:45.854669 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.854613    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:39:45.915713 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.915683    2564 generic.go:356] "Generic (PLEG): container finished" podID="a693aa36-247a-4ffd-ab92-bc4bcffcc20c" containerID="6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680" exitCode=0
Jul 23 10:39:45.915894 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.915732    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"
Jul 23 10:39:45.915894 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.915785    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4" event={"ID":"a693aa36-247a-4ffd-ab92-bc4bcffcc20c","Type":"ContainerDied","Data":"6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680"}
Jul 23 10:39:45.915894 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.915837    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4" event={"ID":"a693aa36-247a-4ffd-ab92-bc4bcffcc20c","Type":"ContainerDied","Data":"b4dea5210db73db72f28a07b645b1ac53fb8680ebd69e4fc6c62fd988a1414b5"}
Jul 23 10:39:45.915894 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.915864    2564 scope.go:117] "RemoveContainer" containerID="6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680"
Jul 23 10:39:45.925309 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.925285    2564 scope.go:117] "RemoveContainer" containerID="6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680"
Jul 23 10:39:45.925630 ip-10-0-141-187 kubenswrapper[2564]: E0723 10:39:45.925602    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680\": container with ID starting with 6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680 not found: ID does not exist" containerID="6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680"
Jul 23 10:39:45.925748 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.925642    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680"} err="failed to get container status \"6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680\": rpc error: code = NotFound desc = could not find container \"6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680\": container with ID starting with 6341352a8e827c3be1fd7e3b8d51c587d3e99b7d4c0233fd68e1db0cee7be680 not found: ID does not exist"
Jul 23 10:39:45.928941 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.928923    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-maas-api-tls\") pod \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") "
Jul 23 10:39:45.929046 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.928955    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-openshift-service-ca\") pod \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") "
Jul 23 10:39:45.929426 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.929403    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a693aa36-247a-4ffd-ab92-bc4bcffcc20c" (UID: "a693aa36-247a-4ffd-ab92-bc4bcffcc20c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 10:39:45.931132 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:45.931110    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a693aa36-247a-4ffd-ab92-bc4bcffcc20c" (UID: "a693aa36-247a-4ffd-ab92-bc4bcffcc20c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 10:39:46.030082 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:46.030050    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hps5r\" (UniqueName: \"kubernetes.io/projected/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-kube-api-access-hps5r\") pod \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\" (UID: \"a693aa36-247a-4ffd-ab92-bc4bcffcc20c\") "
Jul 23 10:39:46.030246 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:46.030225    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:46.030246 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:46.030237    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:46.032393 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:46.032362    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-kube-api-access-hps5r" (OuterVolumeSpecName: "kube-api-access-hps5r") pod "a693aa36-247a-4ffd-ab92-bc4bcffcc20c" (UID: "a693aa36-247a-4ffd-ab92-bc4bcffcc20c"). InnerVolumeSpecName "kube-api-access-hps5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 10:39:46.130755 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:46.130729    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hps5r\" (UniqueName: \"kubernetes.io/projected/a693aa36-247a-4ffd-ab92-bc4bcffcc20c-kube-api-access-hps5r\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 23 10:39:46.239238 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:46.239196    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"]
Jul 23 10:39:46.241232 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:46.241206    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc0d57-5d47f96778-qnql4"]
Jul 23 10:39:46.610580 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:46.610493    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a693aa36-247a-4ffd-ab92-bc4bcffcc20c" path="/var/lib/kubelet/pods/a693aa36-247a-4ffd-ab92-bc4bcffcc20c/volumes"
Jul 23 10:39:50.306491 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:50.306446    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:50.672818 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:50.672779    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:56.519363 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:56.519326    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:56.619550 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:56.619514    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:56.803890 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:56.803807    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:39:57.027771 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:39:57.027730    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:40:02.907363 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:02.907337    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9fkcb_91485fdf-3fc3-4e69-af62-93d8f3ca7fec/manager/0.log"
Jul 23 10:40:03.061873 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:03.061839    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-spmmh_9302ee41-aaca-48fc-ae76-e7f5dbca9e12/manager/0.log"
Jul 23 10:40:03.189223 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:03.189146    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86975d4f4c-cnwjz_dad07cc9-124c-473c-90b3-9c7596489290/manager/0.log"
Jul 23 10:40:03.460386 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:03.460285    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6xxzg_83db31c6-5a47-4659-aa96-32b5b6cae36e/manager/0.log"
Jul 23 10:40:03.712892 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:03.712816    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bc8b458c-swdj4_f23c1728-8d73-4564-9d57-15e28bdae03e/copy-manifests/0.log"
Jul 23 10:40:03.719620 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:03.719590    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bc8b458c-swdj4_f23c1728-8d73-4564-9d57-15e28bdae03e/manager/0.log"
Jul 23 10:40:04.205797 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:04.205768    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b975bd78-lknzh_1818b624-1135-4035-b700-ae786b281339/maas-api/0.log"
Jul 23 10:40:04.555656 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:04.555573    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-t7v89_0ad8f4cb-9a01-4db9-8a0f-ee80e1fb1c5a/postgres/0.log"
Jul 23 10:40:06.057748 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:06.057715    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-27cxh_236ab872-6cc0-441b-8e90-9347bb9a4361/manager/0.log"
Jul 23 10:40:06.177994 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:06.177967    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cqkpj_420f30d0-7a30-4191-a4cf-d8271c303223/manager/0.log"
Jul 23 10:40:06.415908 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:06.415872    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t9wzx_d9067278-bd37-44d4-95ee-d173d5a6432d/registry-server/0.log"
Jul 23 10:40:06.541897 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:06.541854    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z9lcx_5354fadc-4089-4074-9f4b-d1ca26af1b91/manager/0.log"
Jul 23 10:40:06.781353 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:06.781267    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dkrtd_95aaca2c-716b-43f7-bbd7-1df4c46ccda8/manager/0.log"
Jul 23 10:40:07.420029 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:07.419997    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-565557bd5f-rn67f_70a159bf-6e69-45ac-a8b5-04a1e4582795/kube-auth-proxy/0.log"
Jul 23 10:40:07.793875 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:07.793765    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-t8dz5_54f201f7-d767-448d-b2d2-42247b5d030c/payload-pre-processing/0.log"
Jul 23 10:40:07.926335 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:07.926293    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k67d7_4bac54c8-f964-49c5-95c7-d3b9dd3e46db/payload-processing/0.log"
Jul 23 10:40:08.394190 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:08.394156    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-dpmsb_ad2a7322-5bdd-4ace-9644-7820feb1f78b/main/0.log"
Jul 23 10:40:08.743303 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:08.743184    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fjx5dd_10d0ed10-da49-47c4-a391-c004fdca3f9b/main/0.log"
Jul 23 10:40:08.854655 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:08.854628    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-w8j6h_64200b18-0a1f-4286-bf6b-330552978930/main/0.log"
Jul 23 10:40:08.965339 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:08.965310    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-4czgc_e7287fca-e47f-4818-b616-1544d89adc5c/main/0.log"
Jul 23 10:40:14.138310 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:14.138239    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:40:14.205643 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:14.205607    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log" limit=1024
Jul 23 10:40:17.218673 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:17.218639    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x9fcp_4e8212ab-e7db-4401-a85e-692f2df349ee/global-pull-secret-syncer/0.log"
Jul 23 10:40:17.280758 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:17.280729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d727z_ee687b05-645e-4ce7-bb53-b830df9c85c7/konnectivity-agent/0.log"
Jul 23 10:40:17.495489 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:17.495397    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-187.ec2.internal_8751f98f709c66f3539a477cf86c9438/haproxy/0.log"
Jul 23 10:40:22.953856 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:22.953819    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-27cxh_236ab872-6cc0-441b-8e90-9347bb9a4361/manager/0.log"
Jul 23 10:40:22.978691 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:22.978667    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cqkpj_420f30d0-7a30-4191-a4cf-d8271c303223/manager/0.log"
Jul 23 10:40:23.063350 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:23.063316    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-t9wzx_d9067278-bd37-44d4-95ee-d173d5a6432d/registry-server/0.log"
Jul 23 10:40:23.251910 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:23.251827    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-z9lcx_5354fadc-4089-4074-9f4b-d1ca26af1b91/manager/0.log"
Jul 23 10:40:23.403173 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:23.403145    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-dkrtd_95aaca2c-716b-43f7-bbd7-1df4c46ccda8/manager/0.log"
Jul 23 10:40:25.445052 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:25.444963    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-558fd88468-qd7md_f94d6f29-cbf8-45f6-bc45-f7cba019dfc3/metrics-server/0.log"
Jul 23 10:40:25.628497 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:25.628472    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hsk9b_572512f6-e9d4-4b90-bd46-acedb36c6cb9/node-exporter/0.log"
Jul 23 10:40:25.652275 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:25.652224    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hsk9b_572512f6-e9d4-4b90-bd46-acedb36c6cb9/kube-rbac-proxy/0.log"
Jul 23 10:40:25.679931 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:25.679910    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hsk9b_572512f6-e9d4-4b90-bd46-acedb36c6cb9/init-textfile/0.log"
Jul 23 10:40:26.013802 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:26.013759    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff/prometheus/0.log"
Jul 23 10:40:26.035988 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:26.035956    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff/config-reloader/0.log"
Jul 23 10:40:26.067559 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:26.067537    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff/thanos-sidecar/0.log"
Jul 23 10:40:26.092830 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:26.092807    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff/kube-rbac-proxy-web/0.log"
Jul 23 10:40:26.115713 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:26.115687    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff/kube-rbac-proxy/0.log"
Jul 23 10:40:26.144806 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:26.144777    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff/kube-rbac-proxy-thanos/0.log"
Jul 23 10:40:26.168772 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:26.168748    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9a3d397c-bcaa-4195-8b42-fe9af9a6b1ff/init-config-reloader/0.log"
Jul 23 10:40:27.858284 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.858216    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"]
Jul 23 10:40:27.858663 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.858634    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a693aa36-247a-4ffd-ab92-bc4bcffcc20c" containerName="maas-api"
Jul 23 10:40:27.858663 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.858646    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a693aa36-247a-4ffd-ab92-bc4bcffcc20c" containerName="maas-api"
Jul 23 10:40:27.858663 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.858662    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f570b038-63a9-4ba6-84e6-f1fa6dcddb5d" containerName="maas-api"
Jul 23 10:40:27.858766 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.858667    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f570b038-63a9-4ba6-84e6-f1fa6dcddb5d" containerName="maas-api"
Jul 23 10:40:27.858766 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.858679    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d191c26-7109-4ba4-845e-58a2c031c9a7" containerName="main"
Jul 23 10:40:27.858766 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.858685    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d191c26-7109-4ba4-845e-58a2c031c9a7" containerName="main"
Jul 23 10:40:27.858766 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.858749    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d191c26-7109-4ba4-845e-58a2c031c9a7" containerName="main"
Jul 23 10:40:27.858766 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.858757    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a693aa36-247a-4ffd-ab92-bc4bcffcc20c" containerName="maas-api"
Jul 23 10:40:27.858766 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.858764    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f570b038-63a9-4ba6-84e6-f1fa6dcddb5d" containerName="maas-api"
Jul 23 10:40:27.862158 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.862138    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:27.864991 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.864963    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjjkv\"/\"kube-root-ca.crt\""
Jul 23 10:40:27.865103 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.864996    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zjjkv\"/\"openshift-service-ca.crt\""
Jul 23 10:40:27.866226 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.866204    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zjjkv\"/\"default-dockercfg-7rpwf\""
Jul 23 10:40:27.871737 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.871712    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"]
Jul 23 10:40:27.921457 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.921405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-427sh\" (UniqueName: \"kubernetes.io/projected/513434f9-b751-4133-93b6-372b0c9d3269-kube-api-access-427sh\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:27.921662 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.921512    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-sys\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:27.921662 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.921639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-lib-modules\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:27.921788 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.921697    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-podres\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:27.921849 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:27.921806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-proc\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.023018 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.022922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-lib-modules\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.023018 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.022987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-podres\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.023229 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.023032    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-proc\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.023229 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.023104    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-427sh\" (UniqueName: \"kubernetes.io/projected/513434f9-b751-4133-93b6-372b0c9d3269-kube-api-access-427sh\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.023229 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.023119    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-lib-modules\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.023229 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.023151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-sys\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.023229 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.023153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-podres\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.023229 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.023180    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-proc\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.023229 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.023227    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/513434f9-b751-4133-93b6-372b0c9d3269-sys\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.032551 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.032524    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-427sh\" (UniqueName: \"kubernetes.io/projected/513434f9-b751-4133-93b6-372b0c9d3269-kube-api-access-427sh\") pod \"perf-node-gather-daemonset-85bll\" (UID: \"513434f9-b751-4133-93b6-372b0c9d3269\") " pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.173435 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.173401    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:28.306446 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:28.306420    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"]
Jul 23 10:40:28.308722 ip-10-0-141-187 kubenswrapper[2564]: W0723 10:40:28.308697    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod513434f9_b751_4133_93b6_372b0c9d3269.slice/crio-a0c65f7a54bd5da7c33a7bd9e68d7ea051b145f623e4ea8e6b72e807d576540a WatchSource:0}: Error finding container a0c65f7a54bd5da7c33a7bd9e68d7ea051b145f623e4ea8e6b72e807d576540a: Status 404 returned error can't find the container with id a0c65f7a54bd5da7c33a7bd9e68d7ea051b145f623e4ea8e6b72e807d576540a
Jul 23 10:40:29.128207 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:29.128171    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll" event={"ID":"513434f9-b751-4133-93b6-372b0c9d3269","Type":"ContainerStarted","Data":"1c2f29c08a5fbebe3d9e901a544b3e0027ede1eea8c592fb0aff1a807cc756f5"}
Jul 23 10:40:29.128715 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:29.128230    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll" event={"ID":"513434f9-b751-4133-93b6-372b0c9d3269","Type":"ContainerStarted","Data":"a0c65f7a54bd5da7c33a7bd9e68d7ea051b145f623e4ea8e6b72e807d576540a"}
Jul 23 10:40:29.128715 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:29.128289    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:29.148635 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:29.148588    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll" podStartSLOduration=2.148573334 podStartE2EDuration="2.148573334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 10:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 10:40:29.147023634 +0000 UTC m=+2749.050711909" watchObservedRunningTime="2026-07-23 10:40:29.148573334 +0000 UTC m=+2749.052261610"
Jul 23 10:40:30.702600 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:30.702563    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qblh8_e2381f20-e972-4eee-ae02-b63b13d6435f/dns/0.log"
Jul 23 10:40:30.721745 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:30.721720    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qblh8_e2381f20-e972-4eee-ae02-b63b13d6435f/kube-rbac-proxy/0.log"
Jul 23 10:40:30.795110 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:30.795080    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cc9zb_ba9d1476-4001-4f45-8cf4-d99c58643653/dns-node-resolver/0.log"
Jul 23 10:40:31.378736 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:31.378704    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75c9fcfb6c-56d6d_ca7dfee7-4077-4973-8d6b-f519020fc82e/registry/0.log"
Jul 23 10:40:31.454228 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:31.454172    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lhx2q_f816c379-732d-46bb-83cb-1b7230cf16df/node-ca/0.log"
Jul 23 10:40:32.641375 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:32.641341    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-565557bd5f-rn67f_70a159bf-6e69-45ac-a8b5-04a1e4582795/kube-auth-proxy/0.log"
Jul 23 10:40:32.787643 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:32.787611    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-t8dz5_54f201f7-d767-448d-b2d2-42247b5d030c/payload-pre-processing/0.log"
Jul 23 10:40:32.823619 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:32.823589    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k67d7_4bac54c8-f964-49c5-95c7-d3b9dd3e46db/payload-processing/0.log"
Jul 23 10:40:33.567300 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:33.567235    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tq2cs_abdfa6ba-271e-498e-a870-94fa550f3487/serve-healthcheck-canary/0.log"
Jul 23 10:40:34.098600 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:34.098568    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9t725_e1ac7c12-efe3-46ad-9e15-1f88780f2a40/kube-rbac-proxy/0.log"
Jul 23 10:40:34.117685 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:34.117660    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9t725_e1ac7c12-efe3-46ad-9e15-1f88780f2a40/exporter/0.log"
Jul 23 10:40:34.137845 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:34.137823    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9t725_e1ac7c12-efe3-46ad-9e15-1f88780f2a40/extractor/0.log"
Jul 23 10:40:35.143115 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:35.143088    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zjjkv/perf-node-gather-daemonset-85bll"
Jul 23 10:40:36.517835 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:36.517793    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9fkcb_91485fdf-3fc3-4e69-af62-93d8f3ca7fec/manager/0.log"
Jul 23 10:40:36.854881 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:36.854802    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-spmmh_9302ee41-aaca-48fc-ae76-e7f5dbca9e12/manager/0.log"
Jul 23 10:40:37.049168 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:37.049134    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86975d4f4c-cnwjz_dad07cc9-124c-473c-90b3-9c7596489290/manager/0.log"
Jul 23 10:40:37.188721 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:37.188687    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6xxzg_83db31c6-5a47-4659-aa96-32b5b6cae36e/manager/0.log"
Jul 23 10:40:37.376024 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:37.375991    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bc8b458c-swdj4_f23c1728-8d73-4564-9d57-15e28bdae03e/manager/0.log"
Jul 23 10:40:37.398185 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:37.398117    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86bc8b458c-swdj4_f23c1728-8d73-4564-9d57-15e28bdae03e/copy-manifests/0.log"
Jul 23 10:40:38.591119 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:38.591031    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-565557bd5f-rn67f_70a159bf-6e69-45ac-a8b5-04a1e4582795/kube-auth-proxy/0.log"
Jul 23 10:40:38.709958 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:38.709920    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-t8dz5_54f201f7-d767-448d-b2d2-42247b5d030c/payload-pre-processing/0.log"
Jul 23 10:40:38.742429 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:38.742400    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k67d7_4bac54c8-f964-49c5-95c7-d3b9dd3e46db/payload-processing/0.log"
Jul 23 10:40:40.311292 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:40.311245    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-565557bd5f-rn67f_70a159bf-6e69-45ac-a8b5-04a1e4582795/kube-auth-proxy/0.log"
Jul 23 10:40:40.439031 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:40.439003    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-t8dz5_54f201f7-d767-448d-b2d2-42247b5d030c/payload-pre-processing/0.log"
Jul 23 10:40:40.468589 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:40.468551    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k67d7_4bac54c8-f964-49c5-95c7-d3b9dd3e46db/payload-processing/0.log"
Jul 23 10:40:43.884153 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:43.884124    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-n5g9s_6f050684-34f6-4db5-a06c-26d7cbbefb10/migrator/0.log"
Jul 23 10:40:43.904773 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:43.904745    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-n5g9s_6f050684-34f6-4db5-a06c-26d7cbbefb10/graceful-termination/0.log"
Jul 23 10:40:45.580764 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:45.580736    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltwkn_74961b81-9ad0-4de2-b990-f363869d36b0/kube-multus-additional-cni-plugins/0.log"
Jul 23 10:40:45.599010 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:45.598987    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltwkn_74961b81-9ad0-4de2-b990-f363869d36b0/egress-router-binary-copy/0.log"
Jul 23 10:40:45.617730 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:45.617702    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltwkn_74961b81-9ad0-4de2-b990-f363869d36b0/cni-plugins/0.log"
Jul 23 10:40:45.638171 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:45.638143    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltwkn_74961b81-9ad0-4de2-b990-f363869d36b0/bond-cni-plugin/0.log"
Jul 23 10:40:45.659337 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:45.659312    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltwkn_74961b81-9ad0-4de2-b990-f363869d36b0/routeoverride-cni/0.log"
Jul 23 10:40:45.677052 ip-10-0-141-187 kubenswrapper[2564]: I0723 10:40:45.677022    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ltwkn_74961b81-9ad0-4de2-b990-f363869d36b0/whereabouts-cni-bincopy/0.log"