Jul 10 14:29:18.234519 ip-10-0-141-223 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 10 14:29:18.234534 ip-10-0-141-223 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 10 14:29:18.234543 ip-10-0-141-223 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 10 14:29:18.234955 ip-10-0-141-223 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 10 14:29:28.425797 ip-10-0-141-223 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 10 14:29:28.425820 ip-10-0-141-223 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 24d66892a6684d898e0294690d976c22 --
Jul 10 14:31:27.936034 ip-10-0-141-223 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 14:31:28.305460 ip-10-0-141-223 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 14:31:28.305460 ip-10-0-141-223 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 14:31:28.305460 ip-10-0-141-223 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 14:31:28.305460 ip-10-0-141-223 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 14:31:28.305460 ip-10-0-141-223 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 14:31:28.307187 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.307102    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 14:31:28.312976 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.312960    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 14:31:28.312976 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.312975    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 14:31:28.312976 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.312979    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.312982    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.312985    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.312988    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.312992    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.312995    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.312999    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313002    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313007    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313011    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313020    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313024    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313026    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313029    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313033    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313037    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313040    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313042    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313045    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 14:31:28.313068 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313048    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313051    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313054    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313056    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313059    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313062    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313064    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313066    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313069    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313072    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313075    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313078    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313081    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313083    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313086    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313088    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313091    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313093    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313096    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313098    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 14:31:28.313511 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313101    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313103    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313106    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313108    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313113    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313116    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313118    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313120    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313123    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313125    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313128    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313130    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313132    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313135    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313139    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313142    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313144    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313147    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313149    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313152    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 14:31:28.314007 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313154    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313157    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313159    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313162    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313164    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313167    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313171    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313173    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313176    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313178    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313181    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313183    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313186    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313188    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313190    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313193    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313195    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313198    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313201    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313203    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 14:31:28.314479 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313206    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313208    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313211    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313214    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313216    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313218    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313222    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313224    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313227    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313229    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313234    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313236    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313239    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313241    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313243    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313246    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313248    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313252    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313968    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313975    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 14:31:28.314970 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313979    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313982    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313986    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313990    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313993    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313996    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.313999    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314002    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314004    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314007    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314011    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314014    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314018    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314021    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314023    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314026    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314029    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314031    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314034    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 14:31:28.315442 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314036    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314040    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314043    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314046    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314049    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314052    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314055    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314057    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314060    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314062    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314065    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314067    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314070    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314072    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314074    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314077    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314079    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314082    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314085    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314087    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 14:31:28.315918 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314090    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314092    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314095    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314098    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314101    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314104    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314106    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314109    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314111    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314114    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314116    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314119    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314122    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314125    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314127    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314130    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314132    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314134    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314137    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314139    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 14:31:28.316386 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314141    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314144    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314146    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314149    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314152    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314154    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314157    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314159    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314161    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314164    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314166    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314169    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314171    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314174    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314177    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314179    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314181    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314185    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314188    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314190    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 14:31:28.316876 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314193    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314195    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314199    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314202    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314204    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314207    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314209    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314211    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314214    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314216    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314219    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314221    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314224    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314226    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314229    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314231    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314233    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314236    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314591    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 14:31:28.317342 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314596    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314598    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314601    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314604    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314607    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314610    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314612    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314615    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314618    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314620    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314624    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314627    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314630    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314632    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314635    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314639    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314642    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314645    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314648    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 14:31:28.317834 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314651    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314653    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314656    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314659    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314661    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314664    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314666    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314668    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314671    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314674    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314677    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314679    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314681    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314684    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314687    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314689    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314691    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314694    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314697    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314699    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 14:31:28.318303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314704    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314707    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314709    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314713    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314716    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314718    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314720    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314723    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314725    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314728    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314730    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314733    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314735    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314737    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314740    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314742    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314745    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314767    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314771    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314774    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 14:31:28.318789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314776    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314780    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314784    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314787    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314789    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314792    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314795    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314798    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314800    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314803    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314805    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314808    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314812    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314814    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314817    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314820    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314822    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314825    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314828    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 14:31:28.319262 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314830    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314832    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314835    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314837    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314840    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314842    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314844    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314847    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314850    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314852    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314854    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314857    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314859    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314862    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314864    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314867    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314869    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314872    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314875    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.314878    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 14:31:28.319741 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.314955    2564 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.314962    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.314969    2564 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.314973    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.314977    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.314982    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.314986    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.314990    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.314994    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.314997    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315001    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315004    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315007    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315010    2564 flags.go:64] FLAG: --cgroup-root=""
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315013    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315016    2564 flags.go:64] FLAG: --client-ca-file=""
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315018    2564 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315021    2564 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315025    2564 flags.go:64] FLAG: --cluster-domain=""
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315027    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315030    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315033    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315036    2564 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315040    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 14:31:28.320210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315043    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315046    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315049    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315052    2564 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315055    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315057    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315061    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315063    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315067    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315070    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315072    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315075    2564 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315078    2564 flags.go:64] FLAG: --enable-server="true"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315082    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315087    2564 flags.go:64] FLAG: --event-burst="100"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315090    2564 flags.go:64] FLAG: --event-qps="50"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315095    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315098    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315101    2564 flags.go:64] FLAG: --eviction-hard=""
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315104    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315107    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315110    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315113    2564 flags.go:64] FLAG: --eviction-soft=""
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315116    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315119    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 14:31:28.320827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315122    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315125    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315127    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315130    2564 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315133    2564 flags.go:64] FLAG: --feature-gates=""
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315136    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315139    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315142    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315145    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315148    2564 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315151    2564 flags.go:64] FLAG: --help="false"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315153    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315156    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315159    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315162    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315165    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315168    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315171    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315173    2564 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315176    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315180    2564 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315183    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315186    2564 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315190    2564 flags.go:64] FLAG: --kube-reserved=""
Jul 10 14:31:28.321431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315198    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315200    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315204    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315206    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315210    2564 flags.go:64] FLAG: --lock-file=""
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315212    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315215    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315218    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315224    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315227    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315229    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315232    2564 flags.go:64] FLAG: --logging-format="text"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315235    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315238    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315240    2564 flags.go:64] FLAG: --manifest-url=""
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315243    2564 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315247    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315250    2564 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315254    2564 flags.go:64] FLAG: --max-pods="110"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315257    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315260    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315263    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315266    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315269    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315271    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 14:31:28.322112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315274    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315281    2564 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315284    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315288    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315291    2564 flags.go:64] FLAG: --pod-cidr=""
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315294    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315299    2564 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315303    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315306    2564 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315309    2564 flags.go:64] FLAG: --port="10250"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315312    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315315    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-095f697dbcd186702"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315318    2564 flags.go:64] FLAG: --qos-reserved=""
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315321    2564 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315324    2564 flags.go:64] FLAG: --register-node="true"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315327    2564 flags.go:64] FLAG: --register-with-taints=""
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315330    2564 flags.go:64] FLAG: --registry-burst="10"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315333    2564 flags.go:64] FLAG: --registry-qps="5"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315335    2564 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315338    2564 flags.go:64] FLAG: --reserved-memory=""
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315341    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315344    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315347    2564 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315349    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315352    2564 flags.go:64] FLAG: --runonce="false"
Jul 10 14:31:28.322796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315355    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315358    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315360    2564 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315363    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315366    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315369    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315372    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315375    2564 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315377    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315380    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315385    2564 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315387    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315390    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315393    2564 flags.go:64] FLAG: --system-cgroups=""
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315397    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315402    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315405    2564 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315408    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315412    2564 flags.go:64] FLAG: --tls-min-version=""
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315414    2564 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315418    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315421    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315424    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315426    2564 flags.go:64] FLAG: --v="2"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315430    2564 flags.go:64] FLAG: --version="false"
Jul 10 14:31:28.323694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315434    2564 flags.go:64] FLAG: --vmodule=""
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315438    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.315441    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315570    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315574    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315578    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315581    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315583    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315586    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315589    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315591    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315594    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315597    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315600    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315602    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315605    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315607    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315611    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315614    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315616    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 14:31:28.324325 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315618    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315622    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315625    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315628    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315630    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315633    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315635    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315638    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315641    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315644    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315647    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315649    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315652    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315654    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315656    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315659    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315661    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315663    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315666    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315668    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 14:31:28.324877 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315671    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315673    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315676    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315679    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315681    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315685    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315689    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315691    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315694    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315697    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315699    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315702    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315704    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315708    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315711    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315713    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315715    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315718    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315721    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 14:31:28.325346 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315723    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315726    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315729    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315731    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315734    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315736    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315739    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315741    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315744    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315746    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315764    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315767    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315770    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315773    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315776    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315779    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315782    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315785    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315788    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 14:31:28.325836 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315790    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315793    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315795    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315797    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315800    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315802    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315806    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315811    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315814    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315816    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315819    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315822    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315825    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315827    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315830    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315833    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315836    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315839    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315842    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315844    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 14:31:28.326283 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315847    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315850    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315852    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.315855    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.316553    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.324521    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.324538    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.324557    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.324563    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324620    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324624    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324628    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324631    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324634    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324637    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 14:31:28.326739 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324641    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324643    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324646    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324649    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324653    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324657    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324660    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324663    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324666    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324669    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324671    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324674    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324676    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324679    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324682    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324684    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324687    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324689    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324692    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324694    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 14:31:28.327189 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324696    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324699    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324702    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324705    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324707    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324710    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324713    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324715    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324718    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324720    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324722    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324725    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324727    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324730    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324732    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324735    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324737    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324740    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324742    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324744    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 14:31:28.327658 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324766    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324771    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324774    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324777    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324780    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324782    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324785    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324787    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324790    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324792    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324795    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324797    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324799    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324802    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324804    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324807    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324810    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324812    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324815    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324818    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 14:31:28.328150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324820    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324823    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324825    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324828    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324830    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324833    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324835    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324837    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324840    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324842    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324846    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324849    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324852    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324855    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324858    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324861    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324863    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324865    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324868    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 14:31:28.328634 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324871    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324873    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324875    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324878    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324881    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324883    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324887    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324891    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324894    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324897    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324899    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324902    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324905    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.324908    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 14:31:28.329112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.324913    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325027    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325032    2564 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325035    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325038    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325041    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325044    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325047    2564 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325049    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325052    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325054    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325057    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325059    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325062    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325065    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325067    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325070    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325072    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325075    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325077    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 14:31:28.329449 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325079    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325082    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325084    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325086    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325089    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325092    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325094    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325097    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325100    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325104    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325107    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325111    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325114    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325117    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325120    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325123    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325125    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325128    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325131    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 14:31:28.329943 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325134    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325138    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325141    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325144    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325146    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325150    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325153    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325157    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325160    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325162    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325165    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325167    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325169    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325172    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325174    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325176    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325179    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325181    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325184    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 14:31:28.330390 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325186    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325189    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325191    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325193    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325196    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325198    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325201    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325203    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325205    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325208    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325210    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325213    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325215    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325217    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325220    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325222    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325224    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325227    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325229    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 14:31:28.330851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325232    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325234    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325238    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325240    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325243    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325245    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325248    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325250    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325252    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325254    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325257    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325259    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325262    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325264    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325267    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325269    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325272    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325274    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325277    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325279    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 14:31:28.331303 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325281    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 14:31:28.331784 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325284    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 14:31:28.331784 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:28.325286    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 14:31:28.331784 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.325291    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 14:31:28.331784 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.325397    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 14:31:28.331784 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.328425    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 14:31:28.331784 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.329800    2564 server.go:1019] "Starting client certificate rotation"
Jul 10 14:31:28.331784 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.329898    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 14:31:28.331784 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.329933    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 14:31:28.333145 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.333129    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 14:31:28.338932 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.338911    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 14:31:28.349029 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.349011    2564 log.go:25] "Validated CRI v1 runtime API"
Jul 10 14:31:28.351262 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.351247    2564 log.go:25] "Validated CRI v1 image API"
Jul 10 14:31:28.352563 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.352550    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 14:31:28.356279 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.356246    2564 fs.go:135] Filesystem UUIDs: map[341984ef-8026-474c-a6b4-a6b45dbd968f:/dev/nvme0n1p4 6ef3ed8b-633c-4af0-b3ce-cee8aabc8e6b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 10 14:31:28.356369 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.356282    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 14:31:28.356911 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.356890    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 14:31:28.360847 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.360715    2564 manager.go:216] Machine: {Timestamp:2026-07-10 14:31:28.360211121 +0000 UTC m=+0.313101188 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094909 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27ee61664fdb53e75fb88da8b4003d SystemUUID:ec27ee61-664f-db53-e75f-b88da8b4003d BootID:24d66892-a668-4d89-8e02-94690d976c22 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3c:a1:f9:b8:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3c:a1:f9:b8:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:b5:97:58:fa:7f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 14:31:28.360847 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.360841    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 14:31:28.360964 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.360921    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 14:31:28.363881 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.363843    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 14:31:28.364022 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.363885    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-223.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 14:31:28.364626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.364617    2564 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 14:31:28.364663 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.364629    2564 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 14:31:28.364663 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.364637    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 14:31:28.364663 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.364647    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 14:31:28.366219 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.366208    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 14:31:28.370589 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.370577    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 14:31:28.370696 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.370687    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 14:31:28.371375 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.371364    2564 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 14:31:28.371419 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.371382    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 14:31:28.371419 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.371397    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 14:31:28.371419 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.371406    2564 kubelet.go:398] "Adding apiserver pod source"
Jul 10 14:31:28.371419 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.371415    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 14:31:28.372509 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.372486    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 14:31:28.372614 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.372516    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 14:31:28.374876 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.374858    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 14:31:28.376923 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.376910    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 14:31:28.376969 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.376940    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 14:31:28.377092 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377082    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 14:31:28.377133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377097    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 14:31:28.377133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377102    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 14:31:28.377133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377108    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 14:31:28.377133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377117    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 14:31:28.377133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377122    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 14:31:28.377601 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377593    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 14:31:28.377632 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377602    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 14:31:28.377632 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377608    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 14:31:28.377632 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377614    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 14:31:28.377632 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377622    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 14:31:28.377632 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377629    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 14:31:28.377819 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377650    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 14:31:28.377819 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.377655    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 14:31:28.378846 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.378829    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pwxjn"
Jul 10 14:31:28.380738 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.380715    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 14:31:28.380738 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.380729    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-223.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 14:31:28.380881 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.380784    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-223.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 14:31:28.380998 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.380985    2564 server.go:1268] "Started kubelet"
Jul 10 14:31:28.381101 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.381055    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 14:31:28.381148 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.381121    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 14:31:28.381197 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.381076    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 14:31:28.381921 ip-10-0-141-223 systemd[1]: Started Kubernetes Kubelet.
Jul 10 14:31:28.383364 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.383348    2564 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 14:31:28.384612 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.384593    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 14:31:28.385799 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.385776    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 14:31:28.386308 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.385477    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-223.ec2.internal.18c0f4241cfb6afc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-223.ec2.internal,UID:ip-10-0-141-223.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-223.ec2.internal,},FirstTimestamp:2026-07-10 14:31:28.380955388 +0000 UTC m=+0.333845456,LastTimestamp:2026-07-10 14:31:28.380955388 +0000 UTC m=+0.333845456,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-223.ec2.internal,}"
Jul 10 14:31:28.386650 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.386633    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pwxjn"
Jul 10 14:31:28.390392 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.390375    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 14:31:28.390392 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.390385    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 14:31:28.390515 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.390491    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:28.391049 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391028    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 14:31:28.391049 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391033    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 14:31:28.391181 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391054    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 14:31:28.391181 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391167    2564 factory.go:55] Registering systemd factory
Jul 10 14:31:28.391316 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391183    2564 factory.go:223] Registration of the systemd container factory successfully
Jul 10 14:31:28.391316 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391221    2564 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 14:31:28.391316 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391229    2564 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 14:31:28.391447 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391387    2564 factory.go:153] Registering CRI-O factory
Jul 10 14:31:28.391447 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391396    2564 factory.go:223] Registration of the crio container factory successfully
Jul 10 14:31:28.391447 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391446    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 14:31:28.391579 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391464    2564 factory.go:103] Registering Raw factory
Jul 10 14:31:28.391579 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391477    2564 manager.go:1196] Started watching for new ooms in manager
Jul 10 14:31:28.391879 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.391860    2564 manager.go:349] Starting recovery of all containers
Jul 10 14:31:28.401138 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.400974    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 14:31:28.402525 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.402510    2564 manager.go:354] Recovery completed
Jul 10 14:31:28.404691 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.404669    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-223.ec2.internal\" not found" node="ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.406700 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.406685    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 14:31:28.408601 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.408584    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 14:31:28.408661 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.408610    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 14:31:28.408661 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.408621    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 10 14:31:28.409130 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.409116    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 14:31:28.409130 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.409127    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 14:31:28.409130 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.409131    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 14:31:28.409283 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.409142    2564 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 14:31:28.409789 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.409773    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 14:31:28.409881 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.409799    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 14:31:28.409881 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.409808    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 10 14:31:28.411193 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.411181    2564 policy_none.go:49] "None policy: Start"
Jul 10 14:31:28.411226 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.411197    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 14:31:28.411226 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.411207    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 14:31:28.413192 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.413180    2564 policy_none.go:47] "Start"
Jul 10 14:31:28.458253 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.458234    2564 manager.go:337] "Starting Device Plugin manager"
Jul 10 14:31:28.458307 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.458265    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 14:31:28.458307 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.458279    2564 server.go:87] "Starting device plugin registration server"
Jul 10 14:31:28.458533 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.458520    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 14:31:28.458568 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.458535    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 14:31:28.458646 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.458628    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 14:31:28.458779 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.458710    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 14:31:28.458779 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.458720    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 14:31:28.459227 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.459209    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 14:31:28.459281 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.459266    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:28.556394 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.556318    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 14:31:28.558578 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.557623    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 14:31:28.558578 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.557655    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 14:31:28.558578 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.557677    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 14:31:28.558578 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.557714    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 14:31:28.559105 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.559091    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 14:31:28.560166 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.560147    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 14:31:28.560261 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.560184    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 14:31:28.560261 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.560199    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 10 14:31:28.560359 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.560264    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.560459 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.560443    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 14:31:28.568277 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.568261    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.568277 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.568283    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-223.ec2.internal\": node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:28.582449 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.582433    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:28.658458 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.658433    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"]
Jul 10 14:31:28.658544 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.658502    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 14:31:28.660551 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.660534    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 14:31:28.660607 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.660571    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 14:31:28.660607 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.660585    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 10 14:31:28.663012 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.663000    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 14:31:28.663112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.663098    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.663172 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.663126    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 14:31:28.663711 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.663694    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 14:31:28.663792 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.663721    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 14:31:28.663792 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.663735    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 10 14:31:28.664354 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.664340    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 14:31:28.664417 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.664370    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 14:31:28.664417 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.664384    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 10 14:31:28.666674 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.666657    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.666776 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.666687    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 14:31:28.667462 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.667446    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 14:31:28.667527 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.667472    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 14:31:28.667527 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.667481    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeHasSufficientPID"
Jul 10 14:31:28.683038 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.683017    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:28.687355 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.687339    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-223.ec2.internal\" not found" node="ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.691821 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.691806    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-223.ec2.internal\" not found" node="ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.692796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.692775    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1bb2252ed8048f628af720c7c7d25f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"d1bb2252ed8048f628af720c7c7d25f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.692885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.692810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1bb2252ed8048f628af720c7c7d25f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"d1bb2252ed8048f628af720c7c7d25f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.692885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.692825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8bd5008cbd0ebf5bf387f822976f37c2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-223.ec2.internal\" (UID: \"8bd5008cbd0ebf5bf387f822976f37c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.783543 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.783502    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:28.793966 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.793929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1bb2252ed8048f628af720c7c7d25f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"d1bb2252ed8048f628af720c7c7d25f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.793966 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.793889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1bb2252ed8048f628af720c7c7d25f9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"d1bb2252ed8048f628af720c7c7d25f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.794133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.794006    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1bb2252ed8048f628af720c7c7d25f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"d1bb2252ed8048f628af720c7c7d25f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.794133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.794025    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8bd5008cbd0ebf5bf387f822976f37c2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-223.ec2.internal\" (UID: \"8bd5008cbd0ebf5bf387f822976f37c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.794133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.794073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8bd5008cbd0ebf5bf387f822976f37c2-config\") pod \"kube-apiserver-proxy-ip-10-0-141-223.ec2.internal\" (UID: \"8bd5008cbd0ebf5bf387f822976f37c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.794133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.794084    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1bb2252ed8048f628af720c7c7d25f9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal\" (UID: \"d1bb2252ed8048f628af720c7c7d25f9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.884358 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.884267    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:28.984826 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:28.984792    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:28.989974 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.989949    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:28.995370 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:28.995327    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:29.085281 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:29.085239    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:29.191929 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:29.191848    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:29.295260 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:29.295225    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:29.331091 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.331065    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 14:31:29.331632 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.331213    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 14:31:29.331632 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.331250    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 14:31:29.392547 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.392483    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 14:26:29 +0000 UTC" deadline="2027-12-04 08:49:39.362921391 +0000 UTC"
Jul 10 14:31:29.392547 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.392543    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12282h18m9.970383007s"
Jul 10 14:31:29.396173 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:29.396153    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:29.496527 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:29.496457    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:29.596722 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:29.596699    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-223.ec2.internal\" not found"
Jul 10 14:31:29.682318 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.682290    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 14:31:29.691161 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.691143    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:29.709935 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.709915    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 14:31:29.711722 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.711708    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal"
Jul 10 14:31:29.715310 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.715291    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 14:31:29.722843 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.722819    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 14:31:29.743003 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:29.742980    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd5008cbd0ebf5bf387f822976f37c2.slice/crio-3956f5c857e4291cee1f3ba84737400b811dd649b8ea30c814dd5cca61dd279f WatchSource:0}: Error finding container 3956f5c857e4291cee1f3ba84737400b811dd649b8ea30c814dd5cca61dd279f: Status 404 returned error can't find the container with id 3956f5c857e4291cee1f3ba84737400b811dd649b8ea30c814dd5cca61dd279f
Jul 10 14:31:29.749903 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:29.749724    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 14:31:29.755465 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:29.755443    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1bb2252ed8048f628af720c7c7d25f9.slice/crio-e84c962ff86633147372ee146229889b8efb748512a5a670fe0ceed3735b50c9 WatchSource:0}: Error finding container e84c962ff86633147372ee146229889b8efb748512a5a670fe0ceed3735b50c9: Status 404 returned error can't find the container with id e84c962ff86633147372ee146229889b8efb748512a5a670fe0ceed3735b50c9
Jul 10 14:31:30.374990 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.374967    2564 apiserver.go:52] "Watching apiserver"
Jul 10 14:31:30.375485 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.375066    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 14:31:30.386456 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.386437    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 14:31:30.387661 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.387642    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rkrrs","kube-system/global-pull-secret-syncer-kvhmz","kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv","openshift-dns/node-resolver-fcxcl","openshift-multus/multus-additional-cni-plugins-skbsn","openshift-multus/network-metrics-daemon-zqgjg","openshift-ovn-kubernetes/ovnkube-node-cqlrr","kube-system/konnectivity-agent-4mjkq","openshift-cluster-node-tuning-operator/tuned-4pkbk","openshift-image-registry/node-ca-fz28k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal","openshift-multus/multus-8g8zm","openshift-network-diagnostics/network-check-target-h9266"]
Jul 10 14:31:30.390539 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.390521    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:30.390621 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.390602    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:30.390695 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.390679    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 14:31:30.392712 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.392697    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.394940 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.394923    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:30.395029 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.395012    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:30.397350 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.397335    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.399108 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.399086    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 14:31:30.399217 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.399154    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 14:31:30.399282 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.399215    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 14:31:30.399282 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.399221    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 14:31:30.399282 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.399239    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-srpsq\""
Jul 10 14:31:30.399902 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.399679    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.400965 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.400938    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 14:31:30.401062 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.400976    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 14:31:30.402243 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.401311    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7fsgc\""
Jul 10 14:31:30.402243 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.401334    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 14:31:30.403528 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.402917    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m5w69\""
Jul 10 14:31:30.403528 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.403086    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 14:31:30.403528 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.403201    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 14:31:30.403851 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.403828    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.403971 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.403921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-os-release\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.404038 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404003    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-var-lib-cni-multus\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.404096 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-var-lib-kubelet\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.404156 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-hostroot\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.404211 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-daemon-config\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.404267 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404232    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-etc-kubernetes\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.404359 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:30.404467 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-system-cni-dir\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.404467 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-cni-dir\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.404467 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fa24274-f5c5-4019-b48b-da6121ab2cfc-cni-binary-copy\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.404631 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404482    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-socket-dir-parent\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.405003 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.404524    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-run-k8s-cni-cncf-io\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.405092 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.405021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-conf-dir\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.405092 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.405046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crjxz\" (UniqueName: \"kubernetes.io/projected/5945701c-79c9-494b-bc92-3f0b8e754baf-kube-api-access-crjxz\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:30.405092 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.405062    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdckh\" (UniqueName: \"kubernetes.io/projected/8fa24274-f5c5-4019-b48b-da6121ab2cfc-kube-api-access-wdckh\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.405092 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.405082    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-cnibin\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.405305 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.405100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-run-netns\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.405305 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.405158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-var-lib-cni-bin\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.405305 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.405209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-run-multus-certs\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.406540 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.406522    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 14:31:30.406626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.406568    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:30.408122 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.408029    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5574c\""
Jul 10 14:31:30.408122 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.408113    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 14:31:30.408931 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.408910    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.409204 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.409184    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 14:31:30.409302 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.409223    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gb6hm\""
Jul 10 14:31:30.409441 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.409425    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 14:31:30.410431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.410414    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 14:31:30.411433 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.411405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:30.411511 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.411485    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:30.411692 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.411671    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 14:31:30.411777 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.411723    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7pr2x\""
Jul 10 14:31:30.411868 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.411852    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 14:31:30.412014 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.411999    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 14:31:30.413738 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.413715    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.416748 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.416725    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rthdk\""
Jul 10 14:31:30.416867 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.416834    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 14:31:30.416973 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.416957    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 14:31:30.417164 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.417144    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.419572 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.419553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.419891 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.419870    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m7nwc\""
Jul 10 14:31:30.420117 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.420095    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 14:31:30.420518 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.420496    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 14:31:30.420734 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.420720    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 14:31:30.422181 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.422159    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 14:31:30.422619 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.422383    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 14:31:30.422731 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.422680    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 14:31:30.422731 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.422717    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 14:31:30.423051 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.423030    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 14:31:30.423292 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.423274    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-468w4\""
Jul 10 14:31:30.424126 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.424107    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 14:31:30.436598 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.436573    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6kh2r"
Jul 10 14:31:30.447895 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.447878    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6kh2r"
Jul 10 14:31:30.492877 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.492854    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 14:31:30.505569 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-daemon-config\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.505666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505583    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/682aeedf-019e-47da-bba8-a60e9d430381-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.505666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-system-cni-dir\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.505666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505640    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n56gh\" (UniqueName: \"kubernetes.io/projected/56fd283f-02c5-4ef4-bb01-ca6634416c8c-kube-api-access-n56gh\") pod \"node-resolver-fcxcl\" (UID: \"56fd283f-02c5-4ef4-bb01-ca6634416c8c\") " pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.505865 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505665    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffdd1754-7f60-4043-8064-fbc1988e5526-host-slash\") pod \"iptables-alerter-rkrrs\" (UID: \"ffdd1754-7f60-4043-8064-fbc1988e5526\") " pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.505865 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505688    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-run\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.505865 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-run-systemd\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.505865 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505736    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-var-lib-openvswitch\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.505865 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crjxz\" (UniqueName: \"kubernetes.io/projected/5945701c-79c9-494b-bc92-3f0b8e754baf-kube-api-access-crjxz\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:30.505865 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505808    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6ss9\" (UniqueName: \"kubernetes.io/projected/b31a4f20-9432-457c-8827-1c5de8a16d91-kube-api-access-n6ss9\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.505865 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-run-netns\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.505865 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88chj\" (UniqueName: \"kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj\") pod \"network-check-target-h9266\" (UID: \"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70\") " pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56fd283f-02c5-4ef4-bb01-ca6634416c8c-tmp-dir\") pod \"node-resolver-fcxcl\" (UID: \"56fd283f-02c5-4ef4-bb01-ca6634416c8c\") " pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fa3c17a-ecb7-4804-8244-3aadc6a4ef91-agent-certs\") pod \"konnectivity-agent-4mjkq\" (UID: \"1fa3c17a-ecb7-4804-8244-3aadc6a4ef91\") " pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505933    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-sysctl-conf\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.505983    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-var-lib-kubelet\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-registration-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506036    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-cnibin\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-run-openvswitch\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506088    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac78210f-b14e-4300-bd29-22ad3d8e49ee-ovn-node-metrics-cert\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506117    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-socket-dir-parent\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506142    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-conf-dir\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdckh\" (UniqueName: \"kubernetes.io/projected/8fa24274-f5c5-4019-b48b-da6121ab2cfc-kube-api-access-wdckh\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-device-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.506269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506218    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-node-log\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-cni-bin\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mmdf\" (UniqueName: \"kubernetes.io/projected/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-kube-api-access-9mmdf\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqwqw\" (UniqueName: \"kubernetes.io/projected/ffdd1754-7f60-4043-8064-fbc1988e5526-kube-api-access-bqwqw\") pod \"iptables-alerter-rkrrs\" (UID: \"ffdd1754-7f60-4043-8064-fbc1988e5526\") " pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506413    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-sysctl-d\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-etc-openvswitch\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/682aeedf-019e-47da-bba8-a60e9d430381-cni-binary-copy\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/682aeedf-019e-47da-bba8-a60e9d430381-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-var-lib-kubelet\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1264b577-71fc-4fe2-b67a-d75ed2254b01-dbus\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b46e1a8-bc65-4c92-9284-9d62f2643289-serviceca\") pod \"node-ca-fz28k\" (UID: \"2b46e1a8-bc65-4c92-9284-9d62f2643289\") " pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506638    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-log-socket\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-os-release\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.506991 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506697    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-var-lib-cni-multus\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-etc-kubernetes\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac78210f-b14e-4300-bd29-22ad3d8e49ee-ovnkube-script-lib\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrr6n\" (UniqueName: \"kubernetes.io/projected/ac78210f-b14e-4300-bd29-22ad3d8e49ee-kube-api-access-wrr6n\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506868    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fa24274-f5c5-4019-b48b-da6121ab2cfc-cni-binary-copy\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506921    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2clg\" (UniqueName: \"kubernetes.io/projected/682aeedf-019e-47da-bba8-a60e9d430381-kube-api-access-w2clg\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-kubernetes\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506972    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-lib-modules\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.506996    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-tuned\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-cni-netd\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac78210f-b14e-4300-bd29-22ad3d8e49ee-env-overrides\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507072    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56fd283f-02c5-4ef4-bb01-ca6634416c8c-hosts-file\") pod \"node-resolver-fcxcl\" (UID: \"56fd283f-02c5-4ef4-bb01-ca6634416c8c\") " pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507099    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fa3c17a-ecb7-4804-8244-3aadc6a4ef91-konnectivity-ca\") pod \"konnectivity-agent-4mjkq\" (UID: \"1fa3c17a-ecb7-4804-8244-3aadc6a4ef91\") " pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-modprobe-d\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507161    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-sysconfig\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.507885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507189    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbhx9\" (UniqueName: \"kubernetes.io/projected/2b46e1a8-bc65-4c92-9284-9d62f2643289-kube-api-access-mbhx9\") pod \"node-ca-fz28k\" (UID: \"2b46e1a8-bc65-4c92-9284-9d62f2643289\") " pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507217    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-cnibin\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-var-lib-cni-bin\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507300    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-os-release\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-host\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507353    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-kubelet\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507379    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-systemd-units\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507405    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-slash\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac78210f-b14e-4300-bd29-22ad3d8e49ee-ovnkube-config\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507469    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-hostroot\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-cni-dir\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-run-k8s-cni-cncf-io\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-sys-fs\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffdd1754-7f60-4043-8064-fbc1988e5526-iptables-alerter-script\") pod \"iptables-alerter-rkrrs\" (UID: \"ffdd1754-7f60-4043-8064-fbc1988e5526\") " pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-sys\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507664    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-run-ovn\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.508914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b31a4f20-9432-457c-8827-1c5de8a16d91-tmp\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507732    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-run-netns\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-run-multus-certs\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507792    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-socket-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-system-cni-dir\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507870    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-systemd\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1264b577-71fc-4fe2-b67a-d75ed2254b01-kubelet-config\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.507927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b46e1a8-bc65-4c92-9284-9d62f2643289-host\") pod \"node-ca-fz28k\" (UID: \"2b46e1a8-bc65-4c92-9284-9d62f2643289\") " pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.508700    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-daemon-config\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.508818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-system-cni-dir\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.509231    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-run-netns\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.509337    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-var-lib-kubelet\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.509487    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-socket-dir-parent\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.509544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-conf-dir\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.510017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.509972    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-os-release\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.510887 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.510038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-var-lib-cni-multus\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.510887 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.510087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-etc-kubernetes\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.510887 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.510204    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:30.510887 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.510281    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs podName:5945701c-79c9-494b-bc92-3f0b8e754baf nodeName:}" failed. No retries permitted until 2026-07-10 14:31:31.010253235 +0000 UTC m=+2.963143309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs") pod "network-metrics-daemon-zqgjg" (UID: "5945701c-79c9-494b-bc92-3f0b8e754baf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:30.511104 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.510928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8fa24274-f5c5-4019-b48b-da6121ab2cfc-cni-binary-copy\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.511157 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.511121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-cnibin\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.511212 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.511173    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-var-lib-cni-bin\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.511289 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.511272    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-hostroot\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.511359 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.511340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-multus-cni-dir\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.511413 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.511386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-run-k8s-cni-cncf-io\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.511496 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.511481    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8fa24274-f5c5-4019-b48b-da6121ab2cfc-host-run-multus-certs\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.515706 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.515684    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 14:31:30.519485 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.519458    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdckh\" (UniqueName: \"kubernetes.io/projected/8fa24274-f5c5-4019-b48b-da6121ab2cfc-kube-api-access-wdckh\") pod \"multus-8g8zm\" (UID: \"8fa24274-f5c5-4019-b48b-da6121ab2cfc\") " pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.519778 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.519758    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crjxz\" (UniqueName: \"kubernetes.io/projected/5945701c-79c9-494b-bc92-3f0b8e754baf-kube-api-access-crjxz\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:30.563738 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.563693    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal" event={"ID":"d1bb2252ed8048f628af720c7c7d25f9","Type":"ContainerStarted","Data":"e84c962ff86633147372ee146229889b8efb748512a5a670fe0ceed3735b50c9"}
Jul 10 14:31:30.565044 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.565017    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal" event={"ID":"8bd5008cbd0ebf5bf387f822976f37c2","Type":"ContainerStarted","Data":"3956f5c857e4291cee1f3ba84737400b811dd649b8ea30c814dd5cca61dd279f"}
Jul 10 14:31:30.570575 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.570550    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 14:31:30.608281 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-node-log\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.608402 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608293    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-cni-bin\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.608402 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.608402 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mmdf\" (UniqueName: \"kubernetes.io/projected/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-kube-api-access-9mmdf\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.608402 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-node-log\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.608402 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608373    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqwqw\" (UniqueName: \"kubernetes.io/projected/ffdd1754-7f60-4043-8064-fbc1988e5526-kube-api-access-bqwqw\") pod \"iptables-alerter-rkrrs\" (UID: \"ffdd1754-7f60-4043-8064-fbc1988e5526\") " pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608416    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-cni-bin\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-sysctl-d\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608456    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-etc-openvswitch\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608480    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/682aeedf-019e-47da-bba8-a60e9d430381-cni-binary-copy\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608527    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/682aeedf-019e-47da-bba8-a60e9d430381-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-var-lib-kubelet\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608576    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1264b577-71fc-4fe2-b67a-d75ed2254b01-dbus\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b46e1a8-bc65-4c92-9284-9d62f2643289-serviceca\") pod \"node-ca-fz28k\" (UID: \"2b46e1a8-bc65-4c92-9284-9d62f2643289\") " pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-log-socket\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608649    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.608666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608672    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac78210f-b14e-4300-bd29-22ad3d8e49ee-ovnkube-script-lib\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrr6n\" (UniqueName: \"kubernetes.io/projected/ac78210f-b14e-4300-bd29-22ad3d8e49ee-kube-api-access-wrr6n\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2clg\" (UniqueName: \"kubernetes.io/projected/682aeedf-019e-47da-bba8-a60e9d430381-kube-api-access-w2clg\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608761    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-kubernetes\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-lib-modules\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608806    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-tuned\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608850    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-cni-netd\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac78210f-b14e-4300-bd29-22ad3d8e49ee-env-overrides\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608890    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56fd283f-02c5-4ef4-bb01-ca6634416c8c-hosts-file\") pod \"node-resolver-fcxcl\" (UID: \"56fd283f-02c5-4ef4-bb01-ca6634416c8c\") " pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608913    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fa3c17a-ecb7-4804-8244-3aadc6a4ef91-konnectivity-ca\") pod \"konnectivity-agent-4mjkq\" (UID: \"1fa3c17a-ecb7-4804-8244-3aadc6a4ef91\") " pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608937    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-modprobe-d\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1264b577-71fc-4fe2-b67a-d75ed2254b01-dbus\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608960    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-sysconfig\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbhx9\" (UniqueName: \"kubernetes.io/projected/2b46e1a8-bc65-4c92-9284-9d62f2643289-kube-api-access-mbhx9\") pod \"node-ca-fz28k\" (UID: \"2b46e1a8-bc65-4c92-9284-9d62f2643289\") " pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609009    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-etc-selinux\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-os-release\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.609356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609063    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-host\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-kubelet\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609113    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-systemd-units\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-slash\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609160    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac78210f-b14e-4300-bd29-22ad3d8e49ee-ovnkube-config\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-sys-fs\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609228    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffdd1754-7f60-4043-8064-fbc1988e5526-iptables-alerter-script\") pod \"iptables-alerter-rkrrs\" (UID: \"ffdd1754-7f60-4043-8064-fbc1988e5526\") " pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-sys\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609274    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-run-ovn\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b31a4f20-9432-457c-8827-1c5de8a16d91-tmp\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-sysctl-d\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-run-netns\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609349    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-socket-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-etc-openvswitch\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609379    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-system-cni-dir\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-systemd\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.610269 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1264b577-71fc-4fe2-b67a-d75ed2254b01-kubelet-config\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b46e1a8-bc65-4c92-9284-9d62f2643289-host\") pod \"node-ca-fz28k\" (UID: \"2b46e1a8-bc65-4c92-9284-9d62f2643289\") " pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609530    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/682aeedf-019e-47da-bba8-a60e9d430381-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609561    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n56gh\" (UniqueName: \"kubernetes.io/projected/56fd283f-02c5-4ef4-bb01-ca6634416c8c-kube-api-access-n56gh\") pod \"node-resolver-fcxcl\" (UID: \"56fd283f-02c5-4ef4-bb01-ca6634416c8c\") " pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffdd1754-7f60-4043-8064-fbc1988e5526-host-slash\") pod \"iptables-alerter-rkrrs\" (UID: \"ffdd1754-7f60-4043-8064-fbc1988e5526\") " pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-run\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609642    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-run-systemd\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-var-lib-openvswitch\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6ss9\" (UniqueName: \"kubernetes.io/projected/b31a4f20-9432-457c-8827-1c5de8a16d91-kube-api-access-n6ss9\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609731    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88chj\" (UniqueName: \"kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj\") pod \"network-check-target-h9266\" (UID: \"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70\") " pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56fd283f-02c5-4ef4-bb01-ca6634416c8c-tmp-dir\") pod \"node-resolver-fcxcl\" (UID: \"56fd283f-02c5-4ef4-bb01-ca6634416c8c\") " pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fa3c17a-ecb7-4804-8244-3aadc6a4ef91-agent-certs\") pod \"konnectivity-agent-4mjkq\" (UID: \"1fa3c17a-ecb7-4804-8244-3aadc6a4ef91\") " pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609810    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-sysctl-conf\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609889    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-registration-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-cnibin\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609954    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-run-openvswitch\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.611081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.609982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac78210f-b14e-4300-bd29-22ad3d8e49ee-ovn-node-metrics-cert\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.610002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/682aeedf-019e-47da-bba8-a60e9d430381-cni-binary-copy\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.610016    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-device-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.610114    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-device-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.608575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-tuning-conf-dir\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.610469    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/682aeedf-019e-47da-bba8-a60e9d430381-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.610533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-var-lib-kubelet\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.610593    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-sys\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.610635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b46e1a8-bc65-4c92-9284-9d62f2643289-serviceca\") pod \"node-ca-fz28k\" (UID: \"2b46e1a8-bc65-4c92-9284-9d62f2643289\") " pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.610662    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-log-socket\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.610673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-run-ovn\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.610716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-var-lib-openvswitch\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611153    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fa3c17a-ecb7-4804-8244-3aadc6a4ef91-konnectivity-ca\") pod \"konnectivity-agent-4mjkq\" (UID: \"1fa3c17a-ecb7-4804-8244-3aadc6a4ef91\") " pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-kubernetes\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611264    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-modprobe-d\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-lib-modules\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-os-release\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.612071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611398    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-kubelet\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611402    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-slash\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611439    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-cni-netd\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611514    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-sys-fs\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611533    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-registration-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611552    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-systemd-units\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-system-cni-dir\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-run\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611599    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1264b577-71fc-4fe2-b67a-d75ed2254b01-kubelet-config\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-socket-dir\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611662    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-run-ovn-kubernetes\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611689    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-run-systemd\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611730    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-host\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/56fd283f-02c5-4ef4-bb01-ca6634416c8c-tmp-dir\") pod \"node-resolver-fcxcl\" (UID: \"56fd283f-02c5-4ef4-bb01-ca6634416c8c\") " pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611745    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-systemd\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ffdd1754-7f60-4043-8064-fbc1988e5526-host-slash\") pod \"iptables-alerter-rkrrs\" (UID: \"ffdd1754-7f60-4043-8064-fbc1988e5526\") " pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-run-openvswitch\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.611988    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-run-netns\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613005 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.612077    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612148    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-sysctl-conf\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.612175    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret podName:1264b577-71fc-4fe2-b67a-d75ed2254b01 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:31.112156329 +0000 UTC m=+3.065046386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret") pod "global-pull-secret-syncer-kvhmz" (UID: "1264b577-71fc-4fe2-b67a-d75ed2254b01") : object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/682aeedf-019e-47da-bba8-a60e9d430381-cnibin\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612225    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac78210f-b14e-4300-bd29-22ad3d8e49ee-ovnkube-config\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612323    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac78210f-b14e-4300-bd29-22ad3d8e49ee-ovnkube-script-lib\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612348    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac78210f-b14e-4300-bd29-22ad3d8e49ee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b46e1a8-bc65-4c92-9284-9d62f2643289-host\") pod \"node-ca-fz28k\" (UID: \"2b46e1a8-bc65-4c92-9284-9d62f2643289\") " pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612511    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-sysconfig\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612768    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ffdd1754-7f60-4043-8064-fbc1988e5526-iptables-alerter-script\") pod \"iptables-alerter-rkrrs\" (UID: \"ffdd1754-7f60-4043-8064-fbc1988e5526\") " pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612872    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/682aeedf-019e-47da-bba8-a60e9d430381-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/56fd283f-02c5-4ef4-bb01-ca6634416c8c-hosts-file\") pod \"node-resolver-fcxcl\" (UID: \"56fd283f-02c5-4ef4-bb01-ca6634416c8c\") " pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.613925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.612952    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac78210f-b14e-4300-bd29-22ad3d8e49ee-env-overrides\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.615657 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.615629    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b31a4f20-9432-457c-8827-1c5de8a16d91-tmp\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.632430 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.632369    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqwqw\" (UniqueName: \"kubernetes.io/projected/ffdd1754-7f60-4043-8064-fbc1988e5526-kube-api-access-bqwqw\") pod \"iptables-alerter-rkrrs\" (UID: \"ffdd1754-7f60-4043-8064-fbc1988e5526\") " pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.632430 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.632374    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mmdf\" (UniqueName: \"kubernetes.io/projected/0fae9b52-e365-46f1-82ca-8d7c003c8f4e-kube-api-access-9mmdf\") pod \"aws-ebs-csi-driver-node-vttvv\" (UID: \"0fae9b52-e365-46f1-82ca-8d7c003c8f4e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.632584 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.632510    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b31a4f20-9432-457c-8827-1c5de8a16d91-etc-tuned\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.633203 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.632663    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac78210f-b14e-4300-bd29-22ad3d8e49ee-ovn-node-metrics-cert\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.633203 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.633093    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fa3c17a-ecb7-4804-8244-3aadc6a4ef91-agent-certs\") pod \"konnectivity-agent-4mjkq\" (UID: \"1fa3c17a-ecb7-4804-8244-3aadc6a4ef91\") " pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:30.633371 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.633221    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 14:31:30.633371 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.633251    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 14:31:30.633371 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.633278    2564 projected.go:196] Error preparing data for projected volume kube-api-access-88chj for pod openshift-network-diagnostics/network-check-target-h9266: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:30.633520 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:30.633368    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj podName:f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:31.133338509 +0000 UTC m=+3.086228585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-88chj" (UniqueName: "kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj") pod "network-check-target-h9266" (UID: "f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:30.637546 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.637517    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrr6n\" (UniqueName: \"kubernetes.io/projected/ac78210f-b14e-4300-bd29-22ad3d8e49ee-kube-api-access-wrr6n\") pod \"ovnkube-node-cqlrr\" (UID: \"ac78210f-b14e-4300-bd29-22ad3d8e49ee\") " pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.638351 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.638285    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbhx9\" (UniqueName: \"kubernetes.io/projected/2b46e1a8-bc65-4c92-9284-9d62f2643289-kube-api-access-mbhx9\") pod \"node-ca-fz28k\" (UID: \"2b46e1a8-bc65-4c92-9284-9d62f2643289\") " pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.638539 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.638519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6ss9\" (UniqueName: \"kubernetes.io/projected/b31a4f20-9432-457c-8827-1c5de8a16d91-kube-api-access-n6ss9\") pod \"tuned-4pkbk\" (UID: \"b31a4f20-9432-457c-8827-1c5de8a16d91\") " pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.639456 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.639405    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n56gh\" (UniqueName: \"kubernetes.io/projected/56fd283f-02c5-4ef4-bb01-ca6634416c8c-kube-api-access-n56gh\") pod \"node-resolver-fcxcl\" (UID: \"56fd283f-02c5-4ef4-bb01-ca6634416c8c\") " pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.639609 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.639585    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2clg\" (UniqueName: \"kubernetes.io/projected/682aeedf-019e-47da-bba8-a60e9d430381-kube-api-access-w2clg\") pod \"multus-additional-cni-plugins-skbsn\" (UID: \"682aeedf-019e-47da-bba8-a60e9d430381\") " pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.703946 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.703905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8g8zm"
Jul 10 14:31:30.711152 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.710911    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv"
Jul 10 14:31:30.717408 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:30.717375    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fa24274_f5c5_4019_b48b_da6121ab2cfc.slice/crio-36441894d344404288edbb9f649705ae4708774babb8d59459d241d79f27a98a WatchSource:0}: Error finding container 36441894d344404288edbb9f649705ae4708774babb8d59459d241d79f27a98a: Status 404 returned error can't find the container with id 36441894d344404288edbb9f649705ae4708774babb8d59459d241d79f27a98a
Jul 10 14:31:30.718805 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.718784    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fcxcl"
Jul 10 14:31:30.723803 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:30.723772    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fae9b52_e365_46f1_82ca_8d7c003c8f4e.slice/crio-63e65b4f8d955e56a7bcfc8aae51766b1ba6461d1f9748273bb55b9c5f8ebcfb WatchSource:0}: Error finding container 63e65b4f8d955e56a7bcfc8aae51766b1ba6461d1f9748273bb55b9c5f8ebcfb: Status 404 returned error can't find the container with id 63e65b4f8d955e56a7bcfc8aae51766b1ba6461d1f9748273bb55b9c5f8ebcfb
Jul 10 14:31:30.725725 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.725427    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-skbsn"
Jul 10 14:31:30.733145 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.733121    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:30.735789 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:30.735759    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56fd283f_02c5_4ef4_bb01_ca6634416c8c.slice/crio-b7e5ca02290eb174b1d41843483bbe904aba71b895cb8d2c1aa5108e24a7e396 WatchSource:0}: Error finding container b7e5ca02290eb174b1d41843483bbe904aba71b895cb8d2c1aa5108e24a7e396: Status 404 returned error can't find the container with id b7e5ca02290eb174b1d41843483bbe904aba71b895cb8d2c1aa5108e24a7e396
Jul 10 14:31:30.740421 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.740236    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rkrrs"
Jul 10 14:31:30.748212 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:30.748188    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa3c17a_ecb7_4804_8244_3aadc6a4ef91.slice/crio-116fdd1d895bc855ac3942eee8dfe497e1e80f02757f2e9996df5479b09cf484 WatchSource:0}: Error finding container 116fdd1d895bc855ac3942eee8dfe497e1e80f02757f2e9996df5479b09cf484: Status 404 returned error can't find the container with id 116fdd1d895bc855ac3942eee8dfe497e1e80f02757f2e9996df5479b09cf484
Jul 10 14:31:30.748768 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.748751    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4pkbk"
Jul 10 14:31:30.754919 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.754902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fz28k"
Jul 10 14:31:30.763355 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:30.762862    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:31:30.763932 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:30.763903    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31a4f20_9432_457c_8827_1c5de8a16d91.slice/crio-133df8ec7cabe5a020fafb2abad4b64a3d974991cf00718aa4eeca97db653273 WatchSource:0}: Error finding container 133df8ec7cabe5a020fafb2abad4b64a3d974991cf00718aa4eeca97db653273: Status 404 returned error can't find the container with id 133df8ec7cabe5a020fafb2abad4b64a3d974991cf00718aa4eeca97db653273
Jul 10 14:31:30.770635 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:30.770612    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b46e1a8_bc65_4c92_9284_9d62f2643289.slice/crio-1aaac61769de07d9ecf94d9494af4f6c11b26a7cffc01d26041a4144ceee4496 WatchSource:0}: Error finding container 1aaac61769de07d9ecf94d9494af4f6c11b26a7cffc01d26041a4144ceee4496: Status 404 returned error can't find the container with id 1aaac61769de07d9ecf94d9494af4f6c11b26a7cffc01d26041a4144ceee4496
Jul 10 14:31:30.777188 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:31:30.776298    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac78210f_b14e_4300_bd29_22ad3d8e49ee.slice/crio-d536481438e19c36af85f88d6034e8f1414182c9f2f3209ffd149571ed8737bb WatchSource:0}: Error finding container d536481438e19c36af85f88d6034e8f1414182c9f2f3209ffd149571ed8737bb: Status 404 returned error can't find the container with id d536481438e19c36af85f88d6034e8f1414182c9f2f3209ffd149571ed8737bb
Jul 10 14:31:31.013249 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.013176    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:31.013408 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:31.013379    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:31.013474 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:31.013430    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs podName:5945701c-79c9-494b-bc92-3f0b8e754baf nodeName:}" failed. No retries permitted until 2026-07-10 14:31:32.013415237 +0000 UTC m=+3.966305298 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs") pod "network-metrics-daemon-zqgjg" (UID: "5945701c-79c9-494b-bc92-3f0b8e754baf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:31.113861 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.113819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:31.114038 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:31.114014    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:31.114124 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:31.114111    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret podName:1264b577-71fc-4fe2-b67a-d75ed2254b01 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:32.114080068 +0000 UTC m=+4.066970143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret") pod "global-pull-secret-syncer-kvhmz" (UID: "1264b577-71fc-4fe2-b67a-d75ed2254b01") : object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:31.214666 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.214633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88chj\" (UniqueName: \"kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj\") pod \"network-check-target-h9266\" (UID: \"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70\") " pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:31.214870 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:31.214854    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 14:31:31.214949 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:31.214878    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 14:31:31.214949 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:31.214889    2564 projected.go:196] Error preparing data for projected volume kube-api-access-88chj for pod openshift-network-diagnostics/network-check-target-h9266: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:31.215053 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:31.214971    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj podName:f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:32.214933469 +0000 UTC m=+4.167823553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-88chj" (UniqueName: "kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj") pod "network-check-target-h9266" (UID: "f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:31.451004 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.450944    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 14:26:30 +0000 UTC" deadline="2028-02-25 00:52:43.898113138 +0000 UTC"
Jul 10 14:31:31.451004 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.450998    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14266h21m12.447118072s"
Jul 10 14:31:31.558283 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.558249    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:31.558470 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:31.558363    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:31.567524 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.567491    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rkrrs" event={"ID":"ffdd1754-7f60-4043-8064-fbc1988e5526","Type":"ContainerStarted","Data":"cebd950e334cb853a75a42530dee16cce6ec3fb01f9f3b9b86f6d01230116857"}
Jul 10 14:31:31.568537 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.568506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4mjkq" event={"ID":"1fa3c17a-ecb7-4804-8244-3aadc6a4ef91","Type":"ContainerStarted","Data":"116fdd1d895bc855ac3942eee8dfe497e1e80f02757f2e9996df5479b09cf484"}
Jul 10 14:31:31.569556 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.569518    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fcxcl" event={"ID":"56fd283f-02c5-4ef4-bb01-ca6634416c8c","Type":"ContainerStarted","Data":"b7e5ca02290eb174b1d41843483bbe904aba71b895cb8d2c1aa5108e24a7e396"}
Jul 10 14:31:31.570464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.570442    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv" event={"ID":"0fae9b52-e365-46f1-82ca-8d7c003c8f4e","Type":"ContainerStarted","Data":"63e65b4f8d955e56a7bcfc8aae51766b1ba6461d1f9748273bb55b9c5f8ebcfb"}
Jul 10 14:31:31.571537 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.571517    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" event={"ID":"ac78210f-b14e-4300-bd29-22ad3d8e49ee","Type":"ContainerStarted","Data":"d536481438e19c36af85f88d6034e8f1414182c9f2f3209ffd149571ed8737bb"}
Jul 10 14:31:31.575023 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.574960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fz28k" event={"ID":"2b46e1a8-bc65-4c92-9284-9d62f2643289","Type":"ContainerStarted","Data":"1aaac61769de07d9ecf94d9494af4f6c11b26a7cffc01d26041a4144ceee4496"}
Jul 10 14:31:31.576794 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.576767    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4pkbk" event={"ID":"b31a4f20-9432-457c-8827-1c5de8a16d91","Type":"ContainerStarted","Data":"133df8ec7cabe5a020fafb2abad4b64a3d974991cf00718aa4eeca97db653273"}
Jul 10 14:31:31.578513 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.578477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skbsn" event={"ID":"682aeedf-019e-47da-bba8-a60e9d430381","Type":"ContainerStarted","Data":"e2d7f260a8e2d4c3a8ebac6f39adbe564261cc4064f4903861ef7efb6686cf8b"}
Jul 10 14:31:31.579807 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:31.579785    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8g8zm" event={"ID":"8fa24274-f5c5-4019-b48b-da6121ab2cfc","Type":"ContainerStarted","Data":"36441894d344404288edbb9f649705ae4708774babb8d59459d241d79f27a98a"}
Jul 10 14:31:32.021582 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:32.021498    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:32.021745 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:32.021687    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:32.021822 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:32.021754    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs podName:5945701c-79c9-494b-bc92-3f0b8e754baf nodeName:}" failed. No retries permitted until 2026-07-10 14:31:34.021733185 +0000 UTC m=+5.974623246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs") pod "network-metrics-daemon-zqgjg" (UID: "5945701c-79c9-494b-bc92-3f0b8e754baf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:32.122531 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:32.122288    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:32.123329 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:32.122510    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:32.123329 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:32.122958    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret podName:1264b577-71fc-4fe2-b67a-d75ed2254b01 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:34.122932364 +0000 UTC m=+6.075822425 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret") pod "global-pull-secret-syncer-kvhmz" (UID: "1264b577-71fc-4fe2-b67a-d75ed2254b01") : object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:32.224475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:32.223739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88chj\" (UniqueName: \"kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj\") pod \"network-check-target-h9266\" (UID: \"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70\") " pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:32.224475 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:32.224013    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 14:31:32.224475 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:32.224037    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 14:31:32.224475 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:32.224051    2564 projected.go:196] Error preparing data for projected volume kube-api-access-88chj for pod openshift-network-diagnostics/network-check-target-h9266: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:32.224475 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:32.224115    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj podName:f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:34.224091525 +0000 UTC m=+6.176981608 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-88chj" (UniqueName: "kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj") pod "network-check-target-h9266" (UID: "f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:32.452098 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:32.452005    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 14:26:30 +0000 UTC" deadline="2028-02-23 06:02:31.472474037 +0000 UTC"
Jul 10 14:31:32.452098 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:32.452049    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14223h30m59.020429592s"
Jul 10 14:31:32.565848 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:32.561493    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:32.565848 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:32.561925    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:32.565848 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:32.562361    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:32.565848 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:32.562469    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:33.557940 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:33.557916    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:33.558327 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:33.558038    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:33.591577 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:33.591507    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal" event={"ID":"d1bb2252ed8048f628af720c7c7d25f9","Type":"ContainerStarted","Data":"8d5333ea20e316669bd58d4360aba519f7aa37c61f6d52ad31e0225f20dc601f"}
Jul 10 14:31:33.603655 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:33.603598    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal" event={"ID":"8bd5008cbd0ebf5bf387f822976f37c2","Type":"ContainerStarted","Data":"5774a325020352f936d1b2a2f309895782f5bbad29515feedc95a863923e8791"}
Jul 10 14:31:34.052797 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:34.052229    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:34.052797 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:34.052382    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:34.052797 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:34.052450    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs podName:5945701c-79c9-494b-bc92-3f0b8e754baf nodeName:}" failed. No retries permitted until 2026-07-10 14:31:38.052427417 +0000 UTC m=+10.005317476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs") pod "network-metrics-daemon-zqgjg" (UID: "5945701c-79c9-494b-bc92-3f0b8e754baf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:34.154333 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:34.153647    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:34.154333 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:34.153884    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:34.154333 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:34.153978    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret podName:1264b577-71fc-4fe2-b67a-d75ed2254b01 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:38.153956427 +0000 UTC m=+10.106846501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret") pod "global-pull-secret-syncer-kvhmz" (UID: "1264b577-71fc-4fe2-b67a-d75ed2254b01") : object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:34.254688 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:34.254642    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88chj\" (UniqueName: \"kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj\") pod \"network-check-target-h9266\" (UID: \"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70\") " pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:34.254885 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:34.254854    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 14:31:34.254885 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:34.254880    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 14:31:34.255000 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:34.254893    2564 projected.go:196] Error preparing data for projected volume kube-api-access-88chj for pod openshift-network-diagnostics/network-check-target-h9266: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:34.255000 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:34.254953    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj podName:f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:38.254932252 +0000 UTC m=+10.207822311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-88chj" (UniqueName: "kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj") pod "network-check-target-h9266" (UID: "f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:34.558076 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:34.558043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:34.558557 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:34.558043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:34.558557 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:34.558210    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:34.558557 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:34.558269    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:34.612862 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:34.612092    2564 generic.go:356] "Generic (PLEG): container finished" podID="d1bb2252ed8048f628af720c7c7d25f9" containerID="8d5333ea20e316669bd58d4360aba519f7aa37c61f6d52ad31e0225f20dc601f" exitCode=0
Jul 10 14:31:34.613380 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:34.613124    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal" event={"ID":"d1bb2252ed8048f628af720c7c7d25f9","Type":"ContainerDied","Data":"8d5333ea20e316669bd58d4360aba519f7aa37c61f6d52ad31e0225f20dc601f"}
Jul 10 14:31:34.631116 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:34.631062    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-223.ec2.internal" podStartSLOduration=4.631041323 podStartE2EDuration="4.631041323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:33.628098102 +0000 UTC m=+5.580988184" watchObservedRunningTime="2026-07-10 14:31:34.631041323 +0000 UTC m=+6.583931406"
Jul 10 14:31:35.558904 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:35.558868    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:35.559392 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:35.559007    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:36.558993 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:36.558907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:36.559472 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:36.559053    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:36.559565 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:36.559501    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:36.559638 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:36.559611    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:37.558475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:37.557992    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:37.558475 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:37.558121    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:38.089969 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:38.089935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:38.090427 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:38.090070    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:38.090427 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:38.090123    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs podName:5945701c-79c9-494b-bc92-3f0b8e754baf nodeName:}" failed. No retries permitted until 2026-07-10 14:31:46.090107983 +0000 UTC m=+18.042998038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs") pod "network-metrics-daemon-zqgjg" (UID: "5945701c-79c9-494b-bc92-3f0b8e754baf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:38.191011 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:38.190979    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:38.191170 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:38.191136    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:38.191213 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:38.191206    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret podName:1264b577-71fc-4fe2-b67a-d75ed2254b01 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:46.191187052 +0000 UTC m=+18.144077115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret") pod "global-pull-secret-syncer-kvhmz" (UID: "1264b577-71fc-4fe2-b67a-d75ed2254b01") : object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:38.291576 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:38.291549    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88chj\" (UniqueName: \"kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj\") pod \"network-check-target-h9266\" (UID: \"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70\") " pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:38.291727 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:38.291711    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 14:31:38.291803 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:38.291732    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 14:31:38.291803 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:38.291743    2564 projected.go:196] Error preparing data for projected volume kube-api-access-88chj for pod openshift-network-diagnostics/network-check-target-h9266: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:38.291876 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:38.291812    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj podName:f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:46.291795989 +0000 UTC m=+18.244686043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-88chj" (UniqueName: "kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj") pod "network-check-target-h9266" (UID: "f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:38.559847 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:38.559770    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:38.559847 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:38.559804    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:38.560015 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:38.559871    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:38.560015 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:38.559983    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:39.558600 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:39.558565    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:39.559086 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:39.558665    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:40.558808 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:40.558124    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:40.558808 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:40.558255    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:40.558808 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:40.558126    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:40.558808 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:40.558441    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:41.558205 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:41.558171    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:41.558395 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:41.558285    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:42.558515 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.558273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:42.559049 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.558273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:42.559049 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:42.558612    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:42.559049 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:42.558687    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:42.631239 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.631203    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv" event={"ID":"0fae9b52-e365-46f1-82ca-8d7c003c8f4e","Type":"ContainerStarted","Data":"c15c8dc69b85e8be44c1e48434c634e303154bfb5a7dee6ca8118c134c541d46"}
Jul 10 14:31:42.633012 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.632981    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fz28k" event={"ID":"2b46e1a8-bc65-4c92-9284-9d62f2643289","Type":"ContainerStarted","Data":"1dfe81f090e0074cf5883631275a7485b601ccba0fdde3654fdbf95a8fad7be8"}
Jul 10 14:31:42.634728 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.634694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4pkbk" event={"ID":"b31a4f20-9432-457c-8827-1c5de8a16d91","Type":"ContainerStarted","Data":"0216c6421ebc45554c434875ef5a315a3740284cfd459e9144278d627d015dcb"}
Jul 10 14:31:42.638271 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.638136    2564 generic.go:356] "Generic (PLEG): container finished" podID="682aeedf-019e-47da-bba8-a60e9d430381" containerID="bfd64a5a268c2c63f0347db667e2238e6da80c24429cd1d0b1fda0c8fee865db" exitCode=0
Jul 10 14:31:42.638271 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.638215    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skbsn" event={"ID":"682aeedf-019e-47da-bba8-a60e9d430381","Type":"ContainerDied","Data":"bfd64a5a268c2c63f0347db667e2238e6da80c24429cd1d0b1fda0c8fee865db"}
Jul 10 14:31:42.642708 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.642684    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal" event={"ID":"d1bb2252ed8048f628af720c7c7d25f9","Type":"ContainerStarted","Data":"6ae21fcfa98040ef654c2a662c29bbb6bf1e83bae256434c94d23da7c05ad2a7"}
Jul 10 14:31:42.644741 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.644689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4mjkq" event={"ID":"1fa3c17a-ecb7-4804-8244-3aadc6a4ef91","Type":"ContainerStarted","Data":"fbf33f580f81c25e5c22a371ced951be7f02268c34744c038955550638715561"}
Jul 10 14:31:42.648303 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.648281    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fcxcl" event={"ID":"56fd283f-02c5-4ef4-bb01-ca6634416c8c","Type":"ContainerStarted","Data":"4ade845a5efb0488cea68b44bb788b244c559b40b5ce7d7bad8266912942bf97"}
Jul 10 14:31:42.651200 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.651157    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fz28k" podStartSLOduration=2.763643373 podStartE2EDuration="13.651139117s" totalImagesPullingTime="10.887495744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:42.650352798 +0000 UTC m=+14.603242877" watchObservedRunningTime="2026-07-10 14:31:42.651139117 +0000 UTC m=+14.604029194"
Jul 10 14:31:42.669823 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.669786    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4mjkq" podStartSLOduration=2.758968779 podStartE2EDuration="13.669768805s" totalImagesPullingTime="10.910800026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:42.669394408 +0000 UTC m=+14.622284485" watchObservedRunningTime="2026-07-10 14:31:42.669768805 +0000 UTC m=+14.622658875"
Jul 10 14:31:42.706947 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.706847    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4pkbk" podStartSLOduration=2.7503858450000003 podStartE2EDuration="13.706828471s" totalImagesPullingTime="10.956442626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:42.691211083 +0000 UTC m=+14.644101161" watchObservedRunningTime="2026-07-10 14:31:42.706828471 +0000 UTC m=+14.659718549"
Jul 10 14:31:42.707435 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:42.707391    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fcxcl" podStartSLOduration=2.791808632 podStartE2EDuration="13.707381179s" totalImagesPullingTime="10.915572547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:42.706546487 +0000 UTC m=+14.659436565" watchObservedRunningTime="2026-07-10 14:31:42.707381179 +0000 UTC m=+14.660271260"
Jul 10 14:31:43.107663 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.107638    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 14:31:43.304098 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.304018    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:43.367391 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.367354    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:43.471202 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.471000    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T14:31:43.107658798Z","UUID":"1ea6b9b4-1da9-4050-920f-9bd9fa005a47","Handler":null,"Name":"","Endpoint":""}
Jul 10 14:31:43.472797 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.472774    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 14:31:43.472931 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.472819    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 14:31:43.558182 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.558105    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:43.558331 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:43.558219    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:43.653792 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.653732    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv" event={"ID":"0fae9b52-e365-46f1-82ca-8d7c003c8f4e","Type":"ContainerStarted","Data":"21e2440185aff629adfa2c434c94aa7f54aa26bd46f67cf8715a3dc76c3231f5"}
Jul 10 14:31:43.656848 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.656814    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rkrrs" event={"ID":"ffdd1754-7f60-4043-8064-fbc1988e5526","Type":"ContainerStarted","Data":"8a0e47c5a31f256f1ad7c06b7e1901d6fbaa9456d5040b9960eaf141f50478cc"}
Jul 10 14:31:43.672558 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.672514    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-223.ec2.internal" podStartSLOduration=13.672496391 podStartE2EDuration="13.672496391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:42.755268912 +0000 UTC m=+14.708158989" watchObservedRunningTime="2026-07-10 14:31:43.672496391 +0000 UTC m=+15.625386472"
Jul 10 14:31:43.672733 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.672708    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rkrrs" podStartSLOduration=3.763192912 podStartE2EDuration="14.672702273s" totalImagesPullingTime="10.909509361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:43.672430888 +0000 UTC m=+15.625320965" watchObservedRunningTime="2026-07-10 14:31:43.672702273 +0000 UTC m=+15.625592351"
Jul 10 14:31:43.691779 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.691740    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fcxcl_56fd283f-02c5-4ef4-bb01-ca6634416c8c/dns-node-resolver/0.log"
Jul 10 14:31:43.795182 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.795122    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:43.892576 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:43.892500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:44.051093 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.050815    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:44.051268 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.051232    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:44.162589 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.162470    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:44.263340 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.263311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:44.363619 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.363558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:44.463216 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.463137    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:44.561778 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.558563    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:44.561778 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:44.558708    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:44.561778 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.558773    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:44.561778 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:44.558883    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:44.694622 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.694587    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fz28k_2b46e1a8-bc65-4c92-9284-9d62f2643289/node-ca/0.log"
Jul 10 14:31:44.815180 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.815082    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:44.871832 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.871799    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:44.938104 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:44.938073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:45.512605 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:45.512568    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:45.558781 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:45.558732    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:45.558933 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:45.558881    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:45.660387 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:45.660353    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 10 14:31:45.777502 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:45.777408    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:46.033589 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:46.033509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:46.134396 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:46.134366    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:46.158017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:46.157990    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:46.158168 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:46.158147    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:46.158246 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:46.158220    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs podName:5945701c-79c9-494b-bc92-3f0b8e754baf nodeName:}" failed. No retries permitted until 2026-07-10 14:32:02.158199196 +0000 UTC m=+34.111089257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs") pod "network-metrics-daemon-zqgjg" (UID: "5945701c-79c9-494b-bc92-3f0b8e754baf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:31:46.234847 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:46.234813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:46.259042 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:46.259005    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:46.259199 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:46.259121    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:46.259199 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:46.259182    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret podName:1264b577-71fc-4fe2-b67a-d75ed2254b01 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:02.259166354 +0000 UTC m=+34.212056412 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret") pod "global-pull-secret-syncer-kvhmz" (UID: "1264b577-71fc-4fe2-b67a-d75ed2254b01") : object "kube-system"/"original-pull-secret" not registered
Jul 10 14:31:46.339400 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:46.339322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:46.359957 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:46.359927    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88chj\" (UniqueName: \"kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj\") pod \"network-check-target-h9266\" (UID: \"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70\") " pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:46.360138 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:46.360101    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 14:31:46.360138 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:46.360117    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 14:31:46.360138 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:46.360126    2564 projected.go:196] Error preparing data for projected volume kube-api-access-88chj for pod openshift-network-diagnostics/network-check-target-h9266: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:46.360263 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:46.360173    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj podName:f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:02.360156038 +0000 UTC m=+34.313046116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-88chj" (UniqueName: "kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj") pod "network-check-target-h9266" (UID: "f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:31:46.475569 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:46.475520    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:46.559366 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:46.558861    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:46.559366 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:46.558979    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:46.559366 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:46.559248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:46.559366 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:46.559328    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:47.068878 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:47.068621    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:47.558899 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:47.558797    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:47.559033 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:47.558923    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:47.888625 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:47.888544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:48.298911 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:48.298832    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:48.480743 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:48.480707    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:48.559527 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:48.559446    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:48.559691 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:48.559558    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:48.559691 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:48.559667    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:48.559838 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:48.559798    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:48.668323 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:48.668281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:48.746210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:48.746172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:49.073247 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:49.073215    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:49.474333 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:49.474250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:49.558572 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:49.558538    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:49.558681 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:49.558659    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:49.573816 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:49.573782    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:49.787201 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:49.787128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:50.272685 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:50.272548    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:50.372735 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:50.372694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:50.558334 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:50.558256    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:50.558798 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:50.558403    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:50.558798 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:50.558453    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:50.558798 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:50.558554    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:50.577935 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:50.577900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:50.578084 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:50.578015    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 10 14:31:50.578473 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:50.578418    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4mjkq"
Jul 10 14:31:50.676783 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:50.676731    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:50.742169 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:50.742135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:50.878266 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:50.878187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:51.068429 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:51.068393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:51.169616 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:51.169530    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:51.223048 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:51.223005    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:51.466209 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:51.466127    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:51.558522 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:51.558490    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:51.558988 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:51.558609    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:52.279237 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:52.279198    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:52.558407 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:52.558314    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:52.558566 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:52.558445    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:52.558566 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:52.558512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:52.559016 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:52.558612    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:52.670826 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:52.670796    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:52.865942 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:52.865844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:53.069803 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:53.069742    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:53.179631 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:53.179536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:53.281484 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:53.281450    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:53.558647 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:53.558574    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:53.559069 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:53.558690    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:54.283035 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:54.283009    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:54.558831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:54.558766    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:54.558831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:54.558809    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:54.559224 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:54.558877    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:54.559224 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:54.558984    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:54.658258 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:54.658232    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:54.721298 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:54.721273    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:54.872184 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:54.872142    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:55.069531 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.069503    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:55.474567 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.474393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:55.558177 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.558157    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:55.558299 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:55.558280    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:55.683605 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.683581    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:31:55.684116 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.683970    2564 generic.go:356] "Generic (PLEG): container finished" podID="ac78210f-b14e-4300-bd29-22ad3d8e49ee" containerID="4437502caa3425c0dc34609841a6feacc1c2129b33f796872c953ce078fe6940" exitCode=1
Jul 10 14:31:55.684116 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.684036    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" event={"ID":"ac78210f-b14e-4300-bd29-22ad3d8e49ee","Type":"ContainerStarted","Data":"4693ea709b9cf98f64d31fea126b1afab387940fdcc72a01681e855df2017eb9"}
Jul 10 14:31:55.684116 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.684106    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" event={"ID":"ac78210f-b14e-4300-bd29-22ad3d8e49ee","Type":"ContainerStarted","Data":"2452c102a9d7443d4b8526c2df9cda41b51ed85f7c216c8a89d071927a8b5c3b"}
Jul 10 14:31:55.684270 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.684143    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" event={"ID":"ac78210f-b14e-4300-bd29-22ad3d8e49ee","Type":"ContainerStarted","Data":"5526c6608461bacc6f840b49f72d52d5f89f7aa188fb9f801d9e32c7a88c4304"}
Jul 10 14:31:55.684270 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.684179    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" event={"ID":"ac78210f-b14e-4300-bd29-22ad3d8e49ee","Type":"ContainerStarted","Data":"b6aec807041565f5ac6a3abd9b7e42ac96f448ebc9d2aaafef500bf9a29f2997"}
Jul 10 14:31:55.684270 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.684208    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" event={"ID":"ac78210f-b14e-4300-bd29-22ad3d8e49ee","Type":"ContainerDied","Data":"4437502caa3425c0dc34609841a6feacc1c2129b33f796872c953ce078fe6940"}
Jul 10 14:31:55.684270 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.684246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" event={"ID":"ac78210f-b14e-4300-bd29-22ad3d8e49ee","Type":"ContainerStarted","Data":"23ef97f6dcc1c0f9644467ad7ce69d4b5384d24c5e0a2026d2eaebbabbb2487a"}
Jul 10 14:31:55.685841 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.685821    2564 generic.go:356] "Generic (PLEG): container finished" podID="682aeedf-019e-47da-bba8-a60e9d430381" containerID="ae40301e508e08c21222efd3b168727264a3941e19725c8b5b144eb6f6c4e861" exitCode=0
Jul 10 14:31:55.685946 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.685895    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skbsn" event={"ID":"682aeedf-019e-47da-bba8-a60e9d430381","Type":"ContainerDied","Data":"ae40301e508e08c21222efd3b168727264a3941e19725c8b5b144eb6f6c4e861"}
Jul 10 14:31:55.687240 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.687217    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8g8zm" event={"ID":"8fa24274-f5c5-4019-b48b-da6121ab2cfc","Type":"ContainerStarted","Data":"3fbd6913b93db5aff7177fc8c851879301dda05b7ae97ccbb59151ff76c7830c"}
Jul 10 14:31:55.692990 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.692942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv" event={"ID":"0fae9b52-e365-46f1-82ca-8d7c003c8f4e","Type":"ContainerStarted","Data":"255169ad6bb526cc78b5f21cd0016c221dec363a6e597f8da7f40f2604146c3a"}
Jul 10 14:31:55.745606 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.745555    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8g8zm" podStartSLOduration=2.849359387 podStartE2EDuration="26.745541455s" totalImagesPullingTime="23.896182068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:55.729502156 +0000 UTC m=+27.682392232" watchObservedRunningTime="2026-07-10 14:31:55.745541455 +0000 UTC m=+27.698431531"
Jul 10 14:31:55.745865 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:55.745830    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vttvv" podStartSLOduration=2.839899793 podStartE2EDuration="26.745817163s" totalImagesPullingTime="23.90591737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:55.745266113 +0000 UTC m=+27.698156202" watchObservedRunningTime="2026-07-10 14:31:55.745817163 +0000 UTC m=+27.698707241"
Jul 10 14:31:56.073216 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:56.073141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:56.269051 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:56.269017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:56.487973 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:56.487882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:56.560956 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:56.560926    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:56.561095 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:56.561022    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:56.561095 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:56.561074    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:56.561177 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:56.561160    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:57.067371 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:57.067324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:31:57.558481 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:57.558388    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:57.558633 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:57.558499    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:31:57.699966 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:57.699934    2564 generic.go:356] "Generic (PLEG): container finished" podID="682aeedf-019e-47da-bba8-a60e9d430381" containerID="ba1bd394c2edc53efd96e1e269c7f60dc19a22750c4b1e43b74c36310fd64be8" exitCode=0
Jul 10 14:31:57.699966 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:57.699971    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skbsn" event={"ID":"682aeedf-019e-47da-bba8-a60e9d430381","Type":"ContainerDied","Data":"ba1bd394c2edc53efd96e1e269c7f60dc19a22750c4b1e43b74c36310fd64be8"}
Jul 10 14:31:58.559325 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:58.559290    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:31:58.559943 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:58.559467    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:31:58.559943 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:58.559485    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:31:58.559943 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:58.559579    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:31:58.705116 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:58.705093    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:31:58.705483 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:58.705460    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" event={"ID":"ac78210f-b14e-4300-bd29-22ad3d8e49ee","Type":"ContainerStarted","Data":"72ab2a3969502214e807f4850970970faa228c1d6a89ee66abc1c41814fd55e7"}
Jul 10 14:31:58.707736 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:58.707708    2564 generic.go:356] "Generic (PLEG): container finished" podID="682aeedf-019e-47da-bba8-a60e9d430381" containerID="953f44969f73c789b7ede15b211b6de92f11bb076fa420eedc89c9e0bfab6402" exitCode=0
Jul 10 14:31:58.707858 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:58.707790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skbsn" event={"ID":"682aeedf-019e-47da-bba8-a60e9d430381","Type":"ContainerDied","Data":"953f44969f73c789b7ede15b211b6de92f11bb076fa420eedc89c9e0bfab6402"}
Jul 10 14:31:59.558560 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:31:59.558518    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:31:59.558738 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:31:59.558660    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:32:00.562069 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:00.561840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:00.562507 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:00.561905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:00.562507 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:00.562176    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:32:00.562507 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:00.562253    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:32:00.715740 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:00.715711    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:32:00.716071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:00.716049    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" event={"ID":"ac78210f-b14e-4300-bd29-22ad3d8e49ee","Type":"ContainerStarted","Data":"18fdc8a8242a0b110f34335403a2a5da0da9f541c9eee04ad8dbd70c1663c0ef"}
Jul 10 14:32:00.716364 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:00.716350    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:32:00.716426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:00.716416    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:32:00.716516 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:00.716501    2564 scope.go:117] "RemoveContainer" containerID="4437502caa3425c0dc34609841a6feacc1c2129b33f796872c953ce078fe6940"
Jul 10 14:32:00.722546 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:00.722460    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:00.733265 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:00.733245    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:32:00.784786 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:00.784739    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:01.558419 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:01.558387    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:01.558595 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:01.558491    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:32:01.722739 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:01.722700    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:32:01.723189 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:01.723114    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" event={"ID":"ac78210f-b14e-4300-bd29-22ad3d8e49ee","Type":"ContainerStarted","Data":"688be5d861ae2fd06b7df2386e7710b5ed9d6d243834d9365b21cdd6b4ed8f4d"}
Jul 10 14:32:01.724494 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:01.724220    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:32:01.742160 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:01.742136    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:32:01.755028 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:01.754991    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr" podStartSLOduration=8.547300018 podStartE2EDuration="32.754977777s" totalImagesPullingTime="24.207677759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:01.753531205 +0000 UTC m=+33.706421300" watchObservedRunningTime="2026-07-10 14:32:01.754977777 +0000 UTC m=+33.707868027"
Jul 10 14:32:02.184518 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:02.184484    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:02.184701 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:02.184656    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:32:02.184747 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:02.184732    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs podName:5945701c-79c9-494b-bc92-3f0b8e754baf nodeName:}" failed. No retries permitted until 2026-07-10 14:32:34.184710751 +0000 UTC m=+66.137600808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs") pod "network-metrics-daemon-zqgjg" (UID: "5945701c-79c9-494b-bc92-3f0b8e754baf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 14:32:02.285503 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:02.285471    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:02.285650 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:02.285618    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 14:32:02.285687 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:02.285676    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret podName:1264b577-71fc-4fe2-b67a-d75ed2254b01 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:34.285660687 +0000 UTC m=+66.238550741 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret") pod "global-pull-secret-syncer-kvhmz" (UID: "1264b577-71fc-4fe2-b67a-d75ed2254b01") : object "kube-system"/"original-pull-secret" not registered
Jul 10 14:32:02.386087 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:02.386044    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88chj\" (UniqueName: \"kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj\") pod \"network-check-target-h9266\" (UID: \"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70\") " pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:02.386227 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:02.386205    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 14:32:02.386282 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:02.386230    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 14:32:02.386282 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:02.386239    2564 projected.go:196] Error preparing data for projected volume kube-api-access-88chj for pod openshift-network-diagnostics/network-check-target-h9266: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:32:02.386350 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:02.386289    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj podName:f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:34.386271398 +0000 UTC m=+66.339161660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-88chj" (UniqueName: "kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj") pod "network-check-target-h9266" (UID: "f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 14:32:02.558512 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:02.558441    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:02.558512 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:02.558445    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:02.558658 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:02.558599    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:32:02.558658 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:02.558649    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:32:03.558190 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:03.558156    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:03.558639 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:03.558285    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:32:04.560606 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:04.560589    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:04.560872 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:04.560613    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:04.560872 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:04.560701    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:32:04.560872 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:04.560821    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:32:04.732844 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:04.732799    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skbsn" event={"ID":"682aeedf-019e-47da-bba8-a60e9d430381","Type":"ContainerStarted","Data":"3ab6c676844a1b2da7a58e648d278627c1ccabc2ca8a6b7dccc4c45593e50f74"}
Jul 10 14:32:05.558170 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:05.558133    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:05.558314 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:05.558244    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:32:05.737065 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:05.737029    2564 generic.go:356] "Generic (PLEG): container finished" podID="682aeedf-019e-47da-bba8-a60e9d430381" containerID="3ab6c676844a1b2da7a58e648d278627c1ccabc2ca8a6b7dccc4c45593e50f74" exitCode=0
Jul 10 14:32:05.737425 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:05.737077    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skbsn" event={"ID":"682aeedf-019e-47da-bba8-a60e9d430381","Type":"ContainerDied","Data":"3ab6c676844a1b2da7a58e648d278627c1ccabc2ca8a6b7dccc4c45593e50f74"}
Jul 10 14:32:06.201329 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.201028    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:06.314876 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.314841    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:06.409919 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.409884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:06.560919 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.560856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:06.561039 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.560856    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:06.561039 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:06.560955    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:32:06.561039 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:06.561018    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:32:06.610567 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.610542    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:06.678322 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.678287    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:06.741556 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.741527    2564 generic.go:356] "Generic (PLEG): container finished" podID="682aeedf-019e-47da-bba8-a60e9d430381" containerID="488620e01e938465fc50f414d279187d02d3ea4de5462d7bc2684932c65757a0" exitCode=0
Jul 10 14:32:06.741968 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.741586    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skbsn" event={"ID":"682aeedf-019e-47da-bba8-a60e9d430381","Type":"ContainerDied","Data":"488620e01e938465fc50f414d279187d02d3ea4de5462d7bc2684932c65757a0"}
Jul 10 14:32:06.762796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.762773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:06.831935 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:06.831910    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:07.158858 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.158662    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:07.258562 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.258533    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:07.457161 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.457069    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h9266"]
Jul 10 14:32:07.457310 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.457219    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:07.457379 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:07.457313    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:32:07.457846 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.457808    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kvhmz"]
Jul 10 14:32:07.457987 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.457914    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:07.458063 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:07.458041    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:32:07.458634 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.458609    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zqgjg"]
Jul 10 14:32:07.458736 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.458711    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:07.458849 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:07.458827    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:32:07.746566 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.746481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-skbsn" event={"ID":"682aeedf-019e-47da-bba8-a60e9d430381","Type":"ContainerStarted","Data":"e871214a5699d653dc581fad00e89fab5ac726bb3f357f2cb5bd7b45a131417e"}
Jul 10 14:32:07.773362 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.773316    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-skbsn" podStartSLOduration=7.808660931 podStartE2EDuration="38.773301118s" totalImagesPullingTime="30.964640187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:07.773133443 +0000 UTC m=+39.726023521" watchObservedRunningTime="2026-07-10 14:32:07.773301118 +0000 UTC m=+39.726191195"
Jul 10 14:32:07.892849 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.892812    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:07.994370 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:07.994317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:08.052055 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:08.052023    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:08.168886 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:08.168861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:08.298450 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:08.298358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:08.561046 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:08.560982    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:08.561176 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:08.561076    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:32:08.561176 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:08.561147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:08.561253 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:08.561235    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:32:08.582740 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:08.582706    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:09.558219 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:09.558195    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:09.558667 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:09.558291    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-h9266" podUID="f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70"
Jul 10 14:32:10.529392 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:10.529358    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:10.558438 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:10.558414    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:10.558864 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:10.558547    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zqgjg" podUID="5945701c-79c9-494b-bc92-3f0b8e754baf"
Jul 10 14:32:10.558864 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:10.558582    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:10.558864 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:10.558654    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kvhmz" podUID="1264b577-71fc-4fe2-b67a-d75ed2254b01"
Jul 10 14:32:10.633865 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:10.633823    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:10.720555 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:10.720522    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:10.780199 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:10.780117    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:11.376006 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.375982    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-223.ec2.internal" event="NodeReady"
Jul 10 14:32:11.376144 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.376114    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 14:32:11.411775 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.411731    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-857c4f75fd-ht495"]
Jul 10 14:32:11.442014 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.441980    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2md87"]
Jul 10 14:32:11.442177 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.442109    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.445651 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.445577    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 10 14:32:11.445651 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.445604    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 10 14:32:11.445935 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.445885    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 10 14:32:11.446162 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.446144    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ssv9d\""
Jul 10 14:32:11.462009 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.461336    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 10 14:32:11.468282 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.468111    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-857c4f75fd-ht495"]
Jul 10 14:32:11.468282 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.468151    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7skr9"]
Jul 10 14:32:11.469825 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.469392    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.473364 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.473344    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 14:32:11.473364 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.473353    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 14:32:11.473522 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.473407    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2nt82\""
Jul 10 14:32:11.473522 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.473448    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 14:32:11.473619 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.473585    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 14:32:11.483910 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.483891    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2md87"]
Jul 10 14:32:11.483996 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.483933    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7skr9"]
Jul 10 14:32:11.484035 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.483997    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7skr9"
Jul 10 14:32:11.487305 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.487280    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 14:32:11.487462 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.487440    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 14:32:11.487555 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.487534    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 14:32:11.487703 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.487687    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g8rnp\""
Jul 10 14:32:11.526546 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.526521    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x2ztj"]
Jul 10 14:32:11.552067 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552038    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x2ztj"]
Jul 10 14:32:11.552167 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-registry-tls\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.552167 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552147    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.552167 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552154    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-trusted-ca\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.552289 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66607373-dee2-4c64-8d4c-7553b5b9478b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.552289 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66607373-dee2-4c64-8d4c-7553b5b9478b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.552289 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552219    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-bound-sa-token\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.552289 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxq4m\" (UniqueName: \"kubernetes.io/projected/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-kube-api-access-nxq4m\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.552289 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjf2s\" (UniqueName: \"kubernetes.io/projected/66607373-dee2-4c64-8d4c-7553b5b9478b-kube-api-access-sjf2s\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.552524 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-installation-pull-secrets\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.552524 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552463    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4193abf-2819-46cd-8570-c28e870d7279-cert\") pod \"ingress-canary-7skr9\" (UID: \"c4193abf-2819-46cd-8570-c28e870d7279\") " pod="openshift-ingress-canary/ingress-canary-7skr9"
Jul 10 14:32:11.552524 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552513    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-ca-trust-extracted\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.552618 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552583    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qfn8\" (UniqueName: \"kubernetes.io/projected/c4193abf-2819-46cd-8570-c28e870d7279-kube-api-access-2qfn8\") pod \"ingress-canary-7skr9\" (UID: \"c4193abf-2819-46cd-8570-c28e870d7279\") " pod="openshift-ingress-canary/ingress-canary-7skr9"
Jul 10 14:32:11.552651 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552615    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-image-registry-private-configuration\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.552651 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-registry-certificates\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.552719 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552653    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66607373-dee2-4c64-8d4c-7553b5b9478b-crio-socket\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.552719 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.552677    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66607373-dee2-4c64-8d4c-7553b5b9478b-data-volume\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.555074 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.555052    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 14:32:11.555187 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.555053    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2n5mh\""
Jul 10 14:32:11.555187 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.555134    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 14:32:11.557821 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.557802    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:11.560358 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.560340    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 14:32:11.560719 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.560517    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-42vlj\""
Jul 10 14:32:11.560719 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.560529    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 14:32:11.630536 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.630438    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:11.653366 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653341    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-ca-trust-extracted\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.653497 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653371    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/203f87c9-e57c-4034-8e9e-2dab6d56cd43-config-volume\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.653497 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653405    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qfn8\" (UniqueName: \"kubernetes.io/projected/c4193abf-2819-46cd-8570-c28e870d7279-kube-api-access-2qfn8\") pod \"ingress-canary-7skr9\" (UID: \"c4193abf-2819-46cd-8570-c28e870d7279\") " pod="openshift-ingress-canary/ingress-canary-7skr9"
Jul 10 14:32:11.653497 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dhpw\" (UniqueName: \"kubernetes.io/projected/203f87c9-e57c-4034-8e9e-2dab6d56cd43-kube-api-access-5dhpw\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.653497 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-image-registry-private-configuration\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.653497 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653481    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-registry-certificates\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.653717 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653519    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/203f87c9-e57c-4034-8e9e-2dab6d56cd43-metrics-tls\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.653717 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203f87c9-e57c-4034-8e9e-2dab6d56cd43-tmp-dir\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.653717 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66607373-dee2-4c64-8d4c-7553b5b9478b-crio-socket\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.653717 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66607373-dee2-4c64-8d4c-7553b5b9478b-data-volume\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.653717 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653662    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-registry-tls\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.653717 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-trusted-ca\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.653717 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653711    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66607373-dee2-4c64-8d4c-7553b5b9478b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.654077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-ca-trust-extracted\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.654077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/66607373-dee2-4c64-8d4c-7553b5b9478b-crio-socket\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.654077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66607373-dee2-4c64-8d4c-7553b5b9478b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.654077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-bound-sa-token\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.654077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653923    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxq4m\" (UniqueName: \"kubernetes.io/projected/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-kube-api-access-nxq4m\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.654077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.653956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjf2s\" (UniqueName: \"kubernetes.io/projected/66607373-dee2-4c64-8d4c-7553b5b9478b-kube-api-access-sjf2s\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.654077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.654013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-installation-pull-secrets\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.654077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.654020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/66607373-dee2-4c64-8d4c-7553b5b9478b-data-volume\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.654077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.654037    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4193abf-2819-46cd-8570-c28e870d7279-cert\") pod \"ingress-canary-7skr9\" (UID: \"c4193abf-2819-46cd-8570-c28e870d7279\") " pod="openshift-ingress-canary/ingress-canary-7skr9"
Jul 10 14:32:11.654484 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.654352    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-registry-certificates\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.654673 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.654646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-trusted-ca\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.654777 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.654651    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/66607373-dee2-4c64-8d4c-7553b5b9478b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.657924 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.657896    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-registry-tls\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.658025 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.657967    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-image-registry-private-configuration\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.658064 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.658033    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-installation-pull-secrets\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.658295 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.658273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/66607373-dee2-4c64-8d4c-7553b5b9478b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.658355 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.658341    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4193abf-2819-46cd-8570-c28e870d7279-cert\") pod \"ingress-canary-7skr9\" (UID: \"c4193abf-2819-46cd-8570-c28e870d7279\") " pod="openshift-ingress-canary/ingress-canary-7skr9"
Jul 10 14:32:11.663239 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.663219    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjf2s\" (UniqueName: \"kubernetes.io/projected/66607373-dee2-4c64-8d4c-7553b5b9478b-kube-api-access-sjf2s\") pod \"insights-runtime-extractor-2md87\" (UID: \"66607373-dee2-4c64-8d4c-7553b5b9478b\") " pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.663338 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.663278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-bound-sa-token\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.663622 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.663606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qfn8\" (UniqueName: \"kubernetes.io/projected/c4193abf-2819-46cd-8570-c28e870d7279-kube-api-access-2qfn8\") pod \"ingress-canary-7skr9\" (UID: \"c4193abf-2819-46cd-8570-c28e870d7279\") " pod="openshift-ingress-canary/ingress-canary-7skr9"
Jul 10 14:32:11.664305 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.664289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxq4m\" (UniqueName: \"kubernetes.io/projected/b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d-kube-api-access-nxq4m\") pod \"image-registry-857c4f75fd-ht495\" (UID: \"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d\") " pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.731889 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.731857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:11.754464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.754440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/203f87c9-e57c-4034-8e9e-2dab6d56cd43-config-volume\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.754617 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.754485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dhpw\" (UniqueName: \"kubernetes.io/projected/203f87c9-e57c-4034-8e9e-2dab6d56cd43-kube-api-access-5dhpw\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.754617 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.754504    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/203f87c9-e57c-4034-8e9e-2dab6d56cd43-metrics-tls\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.754617 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.754524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203f87c9-e57c-4034-8e9e-2dab6d56cd43-tmp-dir\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.754884 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.754867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/203f87c9-e57c-4034-8e9e-2dab6d56cd43-tmp-dir\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.755076 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.755050    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/203f87c9-e57c-4034-8e9e-2dab6d56cd43-config-volume\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.756383 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.756370    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:11.756854 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.756835    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/203f87c9-e57c-4034-8e9e-2dab6d56cd43-metrics-tls\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.762537 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.762515    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dhpw\" (UniqueName: \"kubernetes.io/projected/203f87c9-e57c-4034-8e9e-2dab6d56cd43-kube-api-access-5dhpw\") pod \"dns-default-x2ztj\" (UID: \"203f87c9-e57c-4034-8e9e-2dab6d56cd43\") " pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.780483 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.780461    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2md87"
Jul 10 14:32:11.795265 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.795107    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7skr9"
Jul 10 14:32:11.860686 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.860656    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:11.978328 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.978297    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:11.994380 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.994355    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2md87"]
Jul 10 14:32:11.998433 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:11.998406    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66607373_dee2_4c64_8d4c_7553b5b9478b.slice/crio-7ecc344d4dc69a11a2786eb03ba9ce9c3210f65b361d6f7c671b72e1fcf3abd3 WatchSource:0}: Error finding container 7ecc344d4dc69a11a2786eb03ba9ce9c3210f65b361d6f7c671b72e1fcf3abd3: Status 404 returned error can't find the container with id 7ecc344d4dc69a11a2786eb03ba9ce9c3210f65b361d6f7c671b72e1fcf3abd3
Jul 10 14:32:11.999025 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:11.999002    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-857c4f75fd-ht495"]
Jul 10 14:32:12.000971 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:12.000951    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79ed7a5_c3a8_42f2_a4a7_a27bb46b039d.slice/crio-5479a86fb9dc0517fe1be6899570127cf2fef162595a90d192ae8c9dbda305ad WatchSource:0}: Error finding container 5479a86fb9dc0517fe1be6899570127cf2fef162595a90d192ae8c9dbda305ad: Status 404 returned error can't find the container with id 5479a86fb9dc0517fe1be6899570127cf2fef162595a90d192ae8c9dbda305ad
Jul 10 14:32:12.006021 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.005935    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7skr9"]
Jul 10 14:32:12.009529 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:12.009500    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4193abf_2819_46cd_8570_c28e870d7279.slice/crio-5b29cadfcd84f96bdf856e1bdf6b153c8486641b0d901f1fc21eab2595528ed9 WatchSource:0}: Error finding container 5b29cadfcd84f96bdf856e1bdf6b153c8486641b0d901f1fc21eab2595528ed9: Status 404 returned error can't find the container with id 5b29cadfcd84f96bdf856e1bdf6b153c8486641b0d901f1fc21eab2595528ed9
Jul 10 14:32:12.071197 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.071177    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x2ztj"]
Jul 10 14:32:12.072707 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:12.072685    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod203f87c9_e57c_4034_8e9e_2dab6d56cd43.slice/crio-f7bf4e854aa4a7b8fbab46603c1006c53ff4aad7bb97d78e1d4f26b38c01ba0b WatchSource:0}: Error finding container f7bf4e854aa4a7b8fbab46603c1006c53ff4aad7bb97d78e1d4f26b38c01ba0b: Status 404 returned error can't find the container with id f7bf4e854aa4a7b8fbab46603c1006c53ff4aad7bb97d78e1d4f26b38c01ba0b
Jul 10 14:32:12.078336 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.078317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:12.562282 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.562257    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:12.562832 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.562259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:12.566930 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.566899    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 14:32:12.567248 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.567234    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 14:32:12.567424 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.567411    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pxtsm\""
Jul 10 14:32:12.761889 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.761853    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2ztj" event={"ID":"203f87c9-e57c-4034-8e9e-2dab6d56cd43","Type":"ContainerStarted","Data":"f7bf4e854aa4a7b8fbab46603c1006c53ff4aad7bb97d78e1d4f26b38c01ba0b"}
Jul 10 14:32:12.764326 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.764299    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2md87" event={"ID":"66607373-dee2-4c64-8d4c-7553b5b9478b","Type":"ContainerStarted","Data":"7ecc344d4dc69a11a2786eb03ba9ce9c3210f65b361d6f7c671b72e1fcf3abd3"}
Jul 10 14:32:12.766146 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.766118    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7skr9" event={"ID":"c4193abf-2819-46cd-8570-c28e870d7279","Type":"ContainerStarted","Data":"5b29cadfcd84f96bdf856e1bdf6b153c8486641b0d901f1fc21eab2595528ed9"}
Jul 10 14:32:12.768923 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.768896    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-857c4f75fd-ht495" event={"ID":"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d","Type":"ContainerStarted","Data":"4aeab2f3b2416a76d10c1e96e62664a8e8b6c85d110cd2062709f0431c386bc0"}
Jul 10 14:32:12.769024 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.768945    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-857c4f75fd-ht495" event={"ID":"b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d","Type":"ContainerStarted","Data":"5479a86fb9dc0517fe1be6899570127cf2fef162595a90d192ae8c9dbda305ad"}
Jul 10 14:32:12.769744 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.769727    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:12.792775 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:12.792703    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-857c4f75fd-ht495" podStartSLOduration=6.792690236 podStartE2EDuration="6.792690236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:12.791384327 +0000 UTC m=+44.744274422" watchObservedRunningTime="2026-07-10 14:32:12.792690236 +0000 UTC m=+44.745580291"
Jul 10 14:32:13.604710 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:13.604673    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:13.696987 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:13.696937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:15.786089 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:15.785909    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:15.846071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:15.846043    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:17.658725 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:17.658694    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:17.716886 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:17.716852    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:18.703829 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:18.703789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:18.777255 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:18.777223    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:18.788197 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:18.788157    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7skr9" event={"ID":"c4193abf-2819-46cd-8570-c28e870d7279","Type":"ContainerStarted","Data":"834540348a836e767c5fd4297d695a82163aaccb1463173263432899f2c4b3b2"}
Jul 10 14:32:18.789926 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:18.789900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2ztj" event={"ID":"203f87c9-e57c-4034-8e9e-2dab6d56cd43","Type":"ContainerStarted","Data":"23ff02dc17cf876a7310ccd54a2edd7e7ed6448e7f035863b2802adaee038da4"}
Jul 10 14:32:18.790071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:18.789959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x2ztj" event={"ID":"203f87c9-e57c-4034-8e9e-2dab6d56cd43","Type":"ContainerStarted","Data":"4248e376af8624cea4abd97f9fad87c5465daebcc09c522a7630493a0424b145"}
Jul 10 14:32:18.790071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:18.789992    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:18.791352 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:18.791332    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2md87" event={"ID":"66607373-dee2-4c64-8d4c-7553b5b9478b","Type":"ContainerStarted","Data":"cae7f2f9394f048233b9358f520d7cb3469f8ad20f4eb2ca6c47ed1ccc671152"}
Jul 10 14:32:18.806107 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:18.806059    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7skr9" podStartSLOduration=1.801399059 podStartE2EDuration="7.80604632s" totalImagesPullingTime="6.004647261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:18.805227877 +0000 UTC m=+50.758117965" watchObservedRunningTime="2026-07-10 14:32:18.80604632 +0000 UTC m=+50.758936397"
Jul 10 14:32:18.822741 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:18.822696    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x2ztj" podStartSLOduration=1.888927637 podStartE2EDuration="7.822681191s" totalImagesPullingTime="5.933753554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:18.822159864 +0000 UTC m=+50.775049937" watchObservedRunningTime="2026-07-10 14:32:18.822681191 +0000 UTC m=+50.775571275"
Jul 10 14:32:18.982199 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:18.982109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:19.084491 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:19.084454    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:19.796049 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:19.795961    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2md87" event={"ID":"66607373-dee2-4c64-8d4c-7553b5b9478b","Type":"ContainerStarted","Data":"fdcd3b88b65eabe88f543540fba1cd26ea44f0f025653a36e6ad3d6cbca50222"}
Jul 10 14:32:21.783674 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:21.783641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:21.836048 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:21.836010    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:21.978695 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:21.978661    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ff49f464b-tzhdp"]
Jul 10 14:32:22.102379 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.102312    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff49f464b-tzhdp"]
Jul 10 14:32:22.102499 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.102405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.105833 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.105800    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 14:32:22.105833 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.105813    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 14:32:22.105833 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.105818    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wvx2q\""
Jul 10 14:32:22.106084 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.105850    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 14:32:22.107172 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.107129    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 14:32:22.107172 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.107151    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 14:32:22.107172 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.107139    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 14:32:22.107425 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.107167    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 14:32:22.111911 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.111892    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 14:32:22.246189 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.246157    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-service-ca\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.246189 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.246200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-serving-cert\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.246318 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.246225    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-trusted-ca-bundle\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.246318 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.246252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqd9k\" (UniqueName: \"kubernetes.io/projected/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-kube-api-access-bqd9k\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.246318 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.246301    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-config\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.246414 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.246348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-oauth-config\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.246414 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.246376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-oauth-serving-cert\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.347516 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.347485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-service-ca\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.347597 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.347522    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-serving-cert\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.347597 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.347539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-trusted-ca-bundle\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.347597 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.347558    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqd9k\" (UniqueName: \"kubernetes.io/projected/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-kube-api-access-bqd9k\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.347799 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.347604    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-config\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.347799 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.347621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-oauth-config\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.347799 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.347635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-oauth-serving-cert\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.348307 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.348279    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-service-ca\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.348398 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.348336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-oauth-serving-cert\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.348444 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.348413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-config\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.348490 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.348456    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-trusted-ca-bundle\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.351462 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.351436    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-oauth-config\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.351543 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.351523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-serving-cert\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.355209 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.355186    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqd9k\" (UniqueName: \"kubernetes.io/projected/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-kube-api-access-bqd9k\") pod \"console-6ff49f464b-tzhdp\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") " pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.411403 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.411380    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:22.534966 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.534931    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ff49f464b-tzhdp"]
Jul 10 14:32:22.539019 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:22.538984    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce9a916_9ee3_48c2_93b1_3852c92a3a48.slice/crio-e4aad2a586da5893a6e8ccca291043abcfbc6783faee1c6e1e21b2ea37e8568f WatchSource:0}: Error finding container e4aad2a586da5893a6e8ccca291043abcfbc6783faee1c6e1e21b2ea37e8568f: Status 404 returned error can't find the container with id e4aad2a586da5893a6e8ccca291043abcfbc6783faee1c6e1e21b2ea37e8568f
Jul 10 14:32:22.809195 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.809104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff49f464b-tzhdp" event={"ID":"8ce9a916-9ee3-48c2-93b1-3852c92a3a48","Type":"ContainerStarted","Data":"e4aad2a586da5893a6e8ccca291043abcfbc6783faee1c6e1e21b2ea37e8568f"}
Jul 10 14:32:22.811009 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.810984    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2md87" event={"ID":"66607373-dee2-4c64-8d4c-7553b5b9478b","Type":"ContainerStarted","Data":"d311712613f34b8ec3c1e63788175a2e7bf28c0540a8cfeb6d2d3f1a067ff096"}
Jul 10 14:32:22.830923 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.830882    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2md87" podStartSLOduration=1.9215542129999998 podStartE2EDuration="11.830868213s" totalImagesPullingTime="9.909314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:32:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:22.82961699 +0000 UTC m=+54.782507067" watchObservedRunningTime="2026-07-10 14:32:22.830868213 +0000 UTC m=+54.783758290"
Jul 10 14:32:22.905006 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:22.904979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:23.004499 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:23.004448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:23.162115 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:23.162081    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:24.385333 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:24.385285    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:24.439732 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:24.439699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:25.821142 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:25.821056    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff49f464b-tzhdp" event={"ID":"8ce9a916-9ee3-48c2-93b1-3852c92a3a48","Type":"ContainerStarted","Data":"882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d"}
Jul 10 14:32:25.830392 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:25.830364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:25.844961 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:25.844915    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ff49f464b-tzhdp" podStartSLOduration=2.013219441 podStartE2EDuration="4.844901319s" totalImagesPullingTime="2.831681878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:25.843239288 +0000 UTC m=+57.796129384" watchObservedRunningTime="2026-07-10 14:32:25.844901319 +0000 UTC m=+57.797791395"
Jul 10 14:32:26.039226 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.039189    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:26.082267 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.082182    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-2khvk"]
Jul 10 14:32:26.085406 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.085387    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"]
Jul 10 14:32:26.085534 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.085517    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.088264 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.088243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.088436 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.088417    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 10 14:32:26.088436 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.088431    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pwh7l\""
Jul 10 14:32:26.088885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.088866    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 10 14:32:26.088965 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.088915    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 14:32:26.089659 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.089642    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 14:32:26.089775 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.089660    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 14:32:26.089775 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.089690    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 10 14:32:26.090916 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.090895    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-b8tw9\""
Jul 10 14:32:26.091339 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.091321    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 10 14:32:26.091593 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.091580    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 10 14:32:26.100047 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.100028    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8qwj7"]
Jul 10 14:32:26.103078 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.103056    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"]
Jul 10 14:32:26.103162 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.103105    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-2khvk"]
Jul 10 14:32:26.103202 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.103167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.106068 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.106052    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 14:32:26.106158 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.106088    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 14:32:26.106289 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.106272    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 14:32:26.106362 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.106300    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nmp5h\""
Jul 10 14:32:26.141802 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.141773    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:26.177258 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177233    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c4ffc4b-a0da-458d-a837-30033b10e321-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.177369 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177260    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc9k2\" (UniqueName: \"kubernetes.io/projected/9c4ffc4b-a0da-458d-a837-30033b10e321-kube-api-access-hc9k2\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.177369 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177294    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4csv\" (UniqueName: \"kubernetes.io/projected/9e27744b-90b1-449b-a5fe-88e1e086c3d1-kube-api-access-p4csv\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.177369 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177312    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-textfile\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.177470 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177372    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f179613-f936-4dd6-8a94-71e932403be6-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.177470 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6f179613-f936-4dd6-8a94-71e932403be6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.177470 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177419    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e27744b-90b1-449b-a5fe-88e1e086c3d1-metrics-client-ca\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.177470 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.177470 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-wtmp\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.177653 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c4ffc4b-a0da-458d-a837-30033b10e321-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.177653 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177503    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6f179613-f936-4dd6-8a94-71e932403be6-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.177653 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c4ffc4b-a0da-458d-a837-30033b10e321-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.177653 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e27744b-90b1-449b-a5fe-88e1e086c3d1-root\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.177653 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-tls\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.177653 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177587    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e27744b-90b1-449b-a5fe-88e1e086c3d1-sys\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.177653 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhrmv\" (UniqueName: \"kubernetes.io/projected/6f179613-f936-4dd6-8a94-71e932403be6-kube-api-access-hhrmv\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.177653 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177631    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f179613-f936-4dd6-8a94-71e932403be6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.177925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f179613-f936-4dd6-8a94-71e932403be6-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.177925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.177695    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.239977 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.239946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:26.278024 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278000    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4csv\" (UniqueName: \"kubernetes.io/projected/9e27744b-90b1-449b-a5fe-88e1e086c3d1-kube-api-access-p4csv\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278105 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278029    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-textfile\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278105 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278056    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f179613-f936-4dd6-8a94-71e932403be6-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.278105 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6f179613-f936-4dd6-8a94-71e932403be6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.278243 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e27744b-90b1-449b-a5fe-88e1e086c3d1-metrics-client-ca\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278243 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278145    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278243 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278170    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-wtmp\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278243 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c4ffc4b-a0da-458d-a837-30033b10e321-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.278243 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6f179613-f936-4dd6-8a94-71e932403be6-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.278469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c4ffc4b-a0da-458d-a837-30033b10e321-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.278469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e27744b-90b1-449b-a5fe-88e1e086c3d1-root\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-tls\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278336    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e27744b-90b1-449b-a5fe-88e1e086c3d1-sys\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278361    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhrmv\" (UniqueName: \"kubernetes.io/projected/6f179613-f936-4dd6-8a94-71e932403be6-kube-api-access-hhrmv\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.278469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278390    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f179613-f936-4dd6-8a94-71e932403be6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.278469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f179613-f936-4dd6-8a94-71e932403be6-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.278469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278454    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-textfile\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278914 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:26.278511    2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 14:32:26.278914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c4ffc4b-a0da-458d-a837-30033b10e321-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.278914 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:26.278571    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-tls podName:9e27744b-90b1-449b-a5fe-88e1e086c3d1 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:26.778553124 +0000 UTC m=+58.731443181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-tls") pod "node-exporter-8qwj7" (UID: "9e27744b-90b1-449b-a5fe-88e1e086c3d1") : secret "node-exporter-tls" not found
Jul 10 14:32:26.278914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc9k2\" (UniqueName: \"kubernetes.io/projected/9c4ffc4b-a0da-458d-a837-30033b10e321-kube-api-access-hc9k2\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.278914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278790    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9e27744b-90b1-449b-a5fe-88e1e086c3d1-metrics-client-ca\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278835    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-accelerators-collector-config\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.278914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278851    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f179613-f936-4dd6-8a94-71e932403be6-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.278914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9e27744b-90b1-449b-a5fe-88e1e086c3d1-root\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.279357 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:26.278926    2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 10 14:32:26.279357 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:32:26.278971    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c4ffc4b-a0da-458d-a837-30033b10e321-openshift-state-metrics-tls podName:9c4ffc4b-a0da-458d-a837-30033b10e321 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:26.778953827 +0000 UTC m=+58.731843885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9c4ffc4b-a0da-458d-a837-30033b10e321-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-g7dg6" (UID: "9c4ffc4b-a0da-458d-a837-30033b10e321") : secret "openshift-state-metrics-tls" not found
Jul 10 14:32:26.279357 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.278975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-wtmp\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.279357 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.279063    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e27744b-90b1-449b-a5fe-88e1e086c3d1-sys\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.279357 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.279204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c4ffc4b-a0da-458d-a837-30033b10e321-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.279357 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.279347    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6f179613-f936-4dd6-8a94-71e932403be6-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.279771 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.279724    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6f179613-f936-4dd6-8a94-71e932403be6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.281385 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.281355    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c4ffc4b-a0da-458d-a837-30033b10e321-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.281510 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.281404    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.281567 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.281545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6f179613-f936-4dd6-8a94-71e932403be6-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.281736 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.281717    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f179613-f936-4dd6-8a94-71e932403be6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.292633 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.292606    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4csv\" (UniqueName: \"kubernetes.io/projected/9e27744b-90b1-449b-a5fe-88e1e086c3d1-kube-api-access-p4csv\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.297856 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.297836    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhrmv\" (UniqueName: \"kubernetes.io/projected/6f179613-f936-4dd6-8a94-71e932403be6-kube-api-access-hhrmv\") pod \"kube-state-metrics-785778ff74-2khvk\" (UID: \"6f179613-f936-4dd6-8a94-71e932403be6\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.298040 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.298023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc9k2\" (UniqueName: \"kubernetes.io/projected/9c4ffc4b-a0da-458d-a837-30033b10e321-kube-api-access-hc9k2\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.395499 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.395470    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk"
Jul 10 14:32:26.425132 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.425097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:26.517727 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.517688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:26.524897 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.524874    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-2khvk"]
Jul 10 14:32:26.528012 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:26.527978    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f179613_f936_4dd6_8a94_71e932403be6.slice/crio-430fe5cc43f66fe31069b0b9359487cb1fbc8e278e81603b6d45155476176747 WatchSource:0}: Error finding container 430fe5cc43f66fe31069b0b9359487cb1fbc8e278e81603b6d45155476176747: Status 404 returned error can't find the container with id 430fe5cc43f66fe31069b0b9359487cb1fbc8e278e81603b6d45155476176747
Jul 10 14:32:26.620893 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.620866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:26.782575 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.782503    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c4ffc4b-a0da-458d-a837-30033b10e321-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.782575 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.782542    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-tls\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.785048 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.785026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9e27744b-90b1-449b-a5fe-88e1e086c3d1-node-exporter-tls\") pod \"node-exporter-8qwj7\" (UID: \"9e27744b-90b1-449b-a5fe-88e1e086c3d1\") " pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:26.785160 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.785052    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c4ffc4b-a0da-458d-a837-30033b10e321-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-g7dg6\" (UID: \"9c4ffc4b-a0da-458d-a837-30033b10e321\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:26.812284 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.812247    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:26.825170 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:26.825142    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk" event={"ID":"6f179613-f936-4dd6-8a94-71e932403be6","Type":"ContainerStarted","Data":"430fe5cc43f66fe31069b0b9359487cb1fbc8e278e81603b6d45155476176747"}
Jul 10 14:32:27.002099 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.002068    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"
Jul 10 14:32:27.011321 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.011299    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8qwj7"
Jul 10 14:32:27.021525 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:27.021499    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e27744b_90b1_449b_a5fe_88e1e086c3d1.slice/crio-6719bc9b821f7ace50623622df05f1fb6a0140365b278319851fe3dde786f34e WatchSource:0}: Error finding container 6719bc9b821f7ace50623622df05f1fb6a0140365b278319851fe3dde786f34e: Status 404 returned error can't find the container with id 6719bc9b821f7ace50623622df05f1fb6a0140365b278319851fe3dde786f34e
Jul 10 14:32:27.041867 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.041803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:27.145162 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.145141    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6"]
Jul 10 14:32:27.147983 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:27.147947    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4ffc4b_a0da_458d_a837_30033b10e321.slice/crio-e561fa4893d6bb9839b27c7eefcde4100916276e5e459202ff0105ccaa92d814 WatchSource:0}: Error finding container e561fa4893d6bb9839b27c7eefcde4100916276e5e459202ff0105ccaa92d814: Status 404 returned error can't find the container with id e561fa4893d6bb9839b27c7eefcde4100916276e5e459202ff0105ccaa92d814
Jul 10 14:32:27.151130 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.151096    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:27.242653 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.242573    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:27.668675 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.668623    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:27.830245 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.830207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qwj7" event={"ID":"9e27744b-90b1-449b-a5fe-88e1e086c3d1","Type":"ContainerStarted","Data":"6719bc9b821f7ace50623622df05f1fb6a0140365b278319851fe3dde786f34e"}
Jul 10 14:32:27.832180 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.832152    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6" event={"ID":"9c4ffc4b-a0da-458d-a837-30033b10e321","Type":"ContainerStarted","Data":"ad02ea706addb03ca5d7f88dc76b24c5d6f8a848dc9240290c856180527c3007"}
Jul 10 14:32:27.832302 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.832211    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6" event={"ID":"9c4ffc4b-a0da-458d-a837-30033b10e321","Type":"ContainerStarted","Data":"c1c1e6e313530f271a5c17423861eb3a94b2591ef8a04b673aef4bafed7227fa"}
Jul 10 14:32:27.832302 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:27.832239    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6" event={"ID":"9c4ffc4b-a0da-458d-a837-30033b10e321","Type":"ContainerStarted","Data":"e561fa4893d6bb9839b27c7eefcde4100916276e5e459202ff0105ccaa92d814"}
Jul 10 14:32:28.798873 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:28.798841    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x2ztj"
Jul 10 14:32:28.837670 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:28.837640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk" event={"ID":"6f179613-f936-4dd6-8a94-71e932403be6","Type":"ContainerStarted","Data":"6a35b8cbae41fc14a7783cd605bfe590a39da34dfc9a739f4238a945ca5c4cae"}
Jul 10 14:32:28.838143 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:28.837700    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk" event={"ID":"6f179613-f936-4dd6-8a94-71e932403be6","Type":"ContainerStarted","Data":"974a0e777eab08c89381fef3ebbed4e3fc10ba615247acb2ccfc09b78454a533"}
Jul 10 14:32:28.838143 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:28.837732    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk" event={"ID":"6f179613-f936-4dd6-8a94-71e932403be6","Type":"ContainerStarted","Data":"014d8036bb2a7aa8e506f2eec64945164cc8edc0e0d5d3b503294dcd64d5ab78"}
Jul 10 14:32:28.839328 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:28.839301    2564 generic.go:356] "Generic (PLEG): container finished" podID="9e27744b-90b1-449b-a5fe-88e1e086c3d1" containerID="6b4d69ec9dbcaf3e58d13850b973d35365d37b5dec5c363ae8055526838a2084" exitCode=0
Jul 10 14:32:28.839442 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:28.839378    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qwj7" event={"ID":"9e27744b-90b1-449b-a5fe-88e1e086c3d1","Type":"ContainerDied","Data":"6b4d69ec9dbcaf3e58d13850b973d35365d37b5dec5c363ae8055526838a2084"}
Jul 10 14:32:28.842156 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:28.842118    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6" event={"ID":"9c4ffc4b-a0da-458d-a837-30033b10e321","Type":"ContainerStarted","Data":"9173e7144b4bcb03719f37939009e3232ba6df9cc8f4a89e9ffb0d47e2478439"}
Jul 10 14:32:28.860372 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:28.859875    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-2khvk" podStartSLOduration=1.342914127 podStartE2EDuration="2.859854535s" totalImagesPullingTime="1.516940408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:28.859312819 +0000 UTC m=+60.812202908" watchObservedRunningTime="2026-07-10 14:32:28.859854535 +0000 UTC m=+60.812744614"
Jul 10 14:32:28.877854 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:28.877692    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-g7dg6" podStartSLOduration=1.527532374 podStartE2EDuration="2.877671097s" totalImagesPullingTime="1.350138723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:28.877535921 +0000 UTC m=+60.830426024" watchObservedRunningTime="2026-07-10 14:32:28.877671097 +0000 UTC m=+60.830561175"
Jul 10 14:32:29.019015 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:29.018970    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:29.117669 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:29.117630    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:29.363421 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:29.363382    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:29.463547 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:29.463508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:29.848231 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:29.848154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qwj7" event={"ID":"9e27744b-90b1-449b-a5fe-88e1e086c3d1","Type":"ContainerStarted","Data":"e7429d00e4efcfe860375c4b5cab487a3a8134439cabf20cca0a87f05e25c53e"}
Jul 10 14:32:29.848231 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:29.848204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8qwj7" event={"ID":"9e27744b-90b1-449b-a5fe-88e1e086c3d1","Type":"ContainerStarted","Data":"e39cd132c20b9ebb35724b34dd332bd43621eee76eec40adec0d9b12643f1690"}
Jul 10 14:32:29.869125 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:29.869083    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8qwj7" podStartSLOduration=2.736310463 podStartE2EDuration="3.869065739s" totalImagesPullingTime="1.026546318s" totalInitContainerRuntime="106.208958ms" isStatefulPod=true podCreationTimestamp="2026-07-10 14:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:29.867658752 +0000 UTC m=+61.820548828" watchObservedRunningTime="2026-07-10 14:32:29.869065739 +0000 UTC m=+61.821955816"
Jul 10 14:32:30.485236 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.485206    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"]
Jul 10 14:32:30.488359 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.488340    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.491181 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.491154    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 10 14:32:30.491181 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.491179    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 14:32:30.492257 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.492241    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-345ssm6771o8r\""
Jul 10 14:32:30.492468 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.492454    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mmksj\""
Jul 10 14:32:30.492547 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.492528    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 10 14:32:30.492604 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.492556    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 10 14:32:30.498490 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.498471    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"]
Jul 10 14:32:30.618047 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.618011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxdcg\" (UniqueName: \"kubernetes.io/projected/3c5c1b43-0fc3-4f9f-b493-d30727194c82-kube-api-access-fxdcg\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.618193 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.618067    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c5c1b43-0fc3-4f9f-b493-d30727194c82-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.618193 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.618106    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3c5c1b43-0fc3-4f9f-b493-d30727194c82-secret-metrics-server-tls\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.618193 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.618136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3c5c1b43-0fc3-4f9f-b493-d30727194c82-metrics-server-audit-profiles\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.618193 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.618158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3c5c1b43-0fc3-4f9f-b493-d30727194c82-secret-metrics-server-client-certs\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.618315 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.618212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c5c1b43-0fc3-4f9f-b493-d30727194c82-client-ca-bundle\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.618315 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.618234    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3c5c1b43-0fc3-4f9f-b493-d30727194c82-audit-log\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.719431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.719397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3c5c1b43-0fc3-4f9f-b493-d30727194c82-metrics-server-audit-profiles\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.719602 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.719438    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3c5c1b43-0fc3-4f9f-b493-d30727194c82-secret-metrics-server-client-certs\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.719602 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.719585    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c5c1b43-0fc3-4f9f-b493-d30727194c82-client-ca-bundle\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.719788 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.719614    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3c5c1b43-0fc3-4f9f-b493-d30727194c82-audit-log\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.719788 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.719678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxdcg\" (UniqueName: \"kubernetes.io/projected/3c5c1b43-0fc3-4f9f-b493-d30727194c82-kube-api-access-fxdcg\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.719788 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.719718    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c5c1b43-0fc3-4f9f-b493-d30727194c82-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.719788 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.719773    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3c5c1b43-0fc3-4f9f-b493-d30727194c82-secret-metrics-server-tls\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.720069 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.720041    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3c5c1b43-0fc3-4f9f-b493-d30727194c82-audit-log\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.720729 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.720700    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3c5c1b43-0fc3-4f9f-b493-d30727194c82-metrics-server-audit-profiles\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.720876 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.720746    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c5c1b43-0fc3-4f9f-b493-d30727194c82-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.722299 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.722276    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c5c1b43-0fc3-4f9f-b493-d30727194c82-client-ca-bundle\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.722384 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.722279    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3c5c1b43-0fc3-4f9f-b493-d30727194c82-secret-metrics-server-tls\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.722426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.722406    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3c5c1b43-0fc3-4f9f-b493-d30727194c82-secret-metrics-server-client-certs\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.733144 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.733126    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxdcg\" (UniqueName: \"kubernetes.io/projected/3c5c1b43-0fc3-4f9f-b493-d30727194c82-kube-api-access-fxdcg\") pod \"metrics-server-7c49c9ddcc-5cpxb\" (UID: \"3c5c1b43-0fc3-4f9f-b493-d30727194c82\") " pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.797377 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.797325    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:30.901690 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.901659    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:30.936356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.936325    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"]
Jul 10 14:32:30.940012 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:30.939985    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c5c1b43_0fc3_4f9f_b493_d30727194c82.slice/crio-ac1f615879b6a951f929189fa122034b3a92596eda74c4f82df75eab3c37677f WatchSource:0}: Error finding container ac1f615879b6a951f929189fa122034b3a92596eda74c4f82df75eab3c37677f: Status 404 returned error can't find the container with id ac1f615879b6a951f929189fa122034b3a92596eda74c4f82df75eab3c37677f
Jul 10 14:32:30.942853 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.942829    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f697c646-kn78f"]
Jul 10 14:32:30.947173 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.947154    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:30.962583 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.962563    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f697c646-kn78f"]
Jul 10 14:32:30.995842 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:30.995813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:31.021926 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.021903    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-serving-cert\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.022002 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.021980    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-oauth-serving-cert\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.022129 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.022085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-service-ca\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.022195 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.022130    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df7rt\" (UniqueName: \"kubernetes.io/projected/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-kube-api-access-df7rt\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.022195 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.022160    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-oauth-config\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.022195 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.022182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-config\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.022308 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.022255    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-trusted-ca-bundle\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.101596 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.101529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:31.123569 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.123545    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-serving-cert\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.123660 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.123599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-oauth-serving-cert\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.123726 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.123708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-service-ca\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.123803 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.123743    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df7rt\" (UniqueName: \"kubernetes.io/projected/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-kube-api-access-df7rt\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.123851 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.123814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-oauth-config\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.123851 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.123836    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-config\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.123940 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.123861    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-trusted-ca-bundle\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.124351 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.124327    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-oauth-serving-cert\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.124433 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.124331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-service-ca\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.124591 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.124544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-config\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.124874 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.124856    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-trusted-ca-bundle\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.126230 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.126204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-serving-cert\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.126318 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.126302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-oauth-config\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.132943 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.132926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df7rt\" (UniqueName: \"kubernetes.io/projected/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-kube-api-access-df7rt\") pod \"console-55f697c646-kn78f\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") " pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.158800 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.158776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:31.256076 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.256041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:31.396382 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.396351    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f697c646-kn78f"]
Jul 10 14:32:31.399806 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:31.399782    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a99d4e2_6dd7_4b2b_ade0_c1c8ef4a72f7.slice/crio-8d069df7fd5ee3c3f38406b494c40e544332849557799f5ead19c74c3e4cd8b3 WatchSource:0}: Error finding container 8d069df7fd5ee3c3f38406b494c40e544332849557799f5ead19c74c3e4cd8b3: Status 404 returned error can't find the container with id 8d069df7fd5ee3c3f38406b494c40e544332849557799f5ead19c74c3e4cd8b3
Jul 10 14:32:31.596616 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.596581    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:31.857819 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.857780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f697c646-kn78f" event={"ID":"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7","Type":"ContainerStarted","Data":"754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e"}
Jul 10 14:32:31.857975 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.857842    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f697c646-kn78f" event={"ID":"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7","Type":"ContainerStarted","Data":"8d069df7fd5ee3c3f38406b494c40e544332849557799f5ead19c74c3e4cd8b3"}
Jul 10 14:32:31.859132 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:31.859096    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb" event={"ID":"3c5c1b43-0fc3-4f9f-b493-d30727194c82","Type":"ContainerStarted","Data":"ac1f615879b6a951f929189fa122034b3a92596eda74c4f82df75eab3c37677f"}
Jul 10 14:32:32.032541 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:32.032507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:32.321145 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:32.320986    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:32.411490 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:32.411463    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:32.411626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:32.411568    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:32.416258 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:32.416237    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:32.434791 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:32.434730    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f697c646-kn78f" podStartSLOduration=2.43471845 podStartE2EDuration="2.43471845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:31.874840035 +0000 UTC m=+63.827730111" watchObservedRunningTime="2026-07-10 14:32:32.43471845 +0000 UTC m=+64.387608517"
Jul 10 14:32:32.864467 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:32.864427    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb" event={"ID":"3c5c1b43-0fc3-4f9f-b493-d30727194c82","Type":"ContainerStarted","Data":"7863fbcf8611c2e99c8c882a8150a9531f9da64e3b93417e6a24d280eef1d501"}
Jul 10 14:32:32.868550 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:32.868526    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:32:32.883878 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:32.883835    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb" podStartSLOduration=1.364935477 podStartE2EDuration="2.883821895s" totalImagesPullingTime="1.518886418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:32.88267686 +0000 UTC m=+64.835566937" watchObservedRunningTime="2026-07-10 14:32:32.883821895 +0000 UTC m=+64.836711970"
Jul 10 14:32:33.277925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:33.277848    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:33.338554 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:33.338521    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:33.575683 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:33.575599    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:33.676323 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:33.676294    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:33.738476 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:33.738449    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cqlrr"
Jul 10 14:32:33.776868 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:33.776838    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-857c4f75fd-ht495"
Jul 10 14:32:33.862032 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:33.862002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:33.929486 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:33.929456    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:33.990742 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:33.990715    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:34.059798 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.059767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:34.133859 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.133759    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:34.212208 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.212181    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:34.256989 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.256965    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:34.260502 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.260486    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 14:32:34.269570 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.269549    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5945701c-79c9-494b-bc92-3f0b8e754baf-metrics-certs\") pod \"network-metrics-daemon-zqgjg\" (UID: \"5945701c-79c9-494b-bc92-3f0b8e754baf\") " pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:34.357353 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.357324    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:34.360635 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.360617    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 14:32:34.370636 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.370615    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1264b577-71fc-4fe2-b67a-d75ed2254b01-original-pull-secret\") pod \"global-pull-secret-syncer-kvhmz\" (UID: \"1264b577-71fc-4fe2-b67a-d75ed2254b01\") " pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:34.458123 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.458035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88chj\" (UniqueName: \"kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj\") pod \"network-check-target-h9266\" (UID: \"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70\") " pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:34.461275 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.461256    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 14:32:34.471293 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.471274    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 14:32:34.475659 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.475645    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kvhmz"
Jul 10 14:32:34.481407 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.481297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88chj\" (UniqueName: \"kubernetes.io/projected/f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70-kube-api-access-88chj\") pod \"network-check-target-h9266\" (UID: \"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70\") " pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:34.486002 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.485983    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pxtsm\""
Jul 10 14:32:34.493396 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.493370    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zqgjg"
Jul 10 14:32:34.618384 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.618356    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kvhmz"]
Jul 10 14:32:34.621292 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:34.621262    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1264b577_71fc_4fe2_b67a_d75ed2254b01.slice/crio-5e1173eb2673ba8548869d094b6e58cf4853b97ca1ac76c8bc0ef25d50066b80 WatchSource:0}: Error finding container 5e1173eb2673ba8548869d094b6e58cf4853b97ca1ac76c8bc0ef25d50066b80: Status 404 returned error can't find the container with id 5e1173eb2673ba8548869d094b6e58cf4853b97ca1ac76c8bc0ef25d50066b80
Jul 10 14:32:34.634970 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.634945    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zqgjg"]
Jul 10 14:32:34.637958 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:34.637928    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5945701c_79c9_494b_bc92_3f0b8e754baf.slice/crio-d4b03ef4c73688a443f097f96a2da0e60dc392bda3745502c6864fe088fe0820 WatchSource:0}: Error finding container d4b03ef4c73688a443f097f96a2da0e60dc392bda3745502c6864fe088fe0820: Status 404 returned error can't find the container with id d4b03ef4c73688a443f097f96a2da0e60dc392bda3745502c6864fe088fe0820
Jul 10 14:32:34.669606 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.669580    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-42vlj\""
Jul 10 14:32:34.676967 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.676952    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:34.801023 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.800922    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-h9266"]
Jul 10 14:32:34.803843 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:32:34.803814    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42b31d5_fbc8_4a1d_96b1_784a2b2f2f70.slice/crio-5cb191f98a85068e3cb54a88576582b5b085c92088c121409cdf5771d99ec636 WatchSource:0}: Error finding container 5cb191f98a85068e3cb54a88576582b5b085c92088c121409cdf5771d99ec636: Status 404 returned error can't find the container with id 5cb191f98a85068e3cb54a88576582b5b085c92088c121409cdf5771d99ec636
Jul 10 14:32:34.872056 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.872018    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zqgjg" event={"ID":"5945701c-79c9-494b-bc92-3f0b8e754baf","Type":"ContainerStarted","Data":"d4b03ef4c73688a443f097f96a2da0e60dc392bda3745502c6864fe088fe0820"}
Jul 10 14:32:34.873207 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.873184    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h9266" event={"ID":"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70","Type":"ContainerStarted","Data":"5cb191f98a85068e3cb54a88576582b5b085c92088c121409cdf5771d99ec636"}
Jul 10 14:32:34.874321 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:34.874294    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kvhmz" event={"ID":"1264b577-71fc-4fe2-b67a-d75ed2254b01","Type":"ContainerStarted","Data":"5e1173eb2673ba8548869d094b6e58cf4853b97ca1ac76c8bc0ef25d50066b80"}
Jul 10 14:32:35.142021 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:35.141996    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:35.240966 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:35.240940    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:36.893516 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:36.893477    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zqgjg" event={"ID":"5945701c-79c9-494b-bc92-3f0b8e754baf","Type":"ContainerStarted","Data":"7b20febc7391cfc09e415b91741707d8ce3717f800c325179d737d20486a8510"}
Jul 10 14:32:36.894007 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:36.893539    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zqgjg" event={"ID":"5945701c-79c9-494b-bc92-3f0b8e754baf","Type":"ContainerStarted","Data":"fc4e7a7ff55384749f71bea23880135f98cd0eab60d4f24fcfc8cf95e903e7cf"}
Jul 10 14:32:36.912068 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:36.912009    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zqgjg" podStartSLOduration=66.534884873 podStartE2EDuration="1m7.911989175s" totalImagesPullingTime="1.377104302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:36.910518285 +0000 UTC m=+68.863408359" watchObservedRunningTime="2026-07-10 14:32:36.911989175 +0000 UTC m=+68.864879253"
Jul 10 14:32:37.054675 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:37.054633    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:37.176563 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:37.176471    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:37.282900 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:37.282862    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:37.376675 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:37.376640    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:37.481032 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:37.480864    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:40.592478 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:40.592433    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:40.910086 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:40.910051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-h9266" event={"ID":"f42b31d5-fbc8-4a1d-96b1-784a2b2f2f70","Type":"ContainerStarted","Data":"f3231bf794fbc0c9f980bce0cadd96bacab8172727c1d79283f083c2bb7ab1ee"}
Jul 10 14:32:40.910293 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:40.910276    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:32:40.911425 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:40.911400    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kvhmz" event={"ID":"1264b577-71fc-4fe2-b67a-d75ed2254b01","Type":"ContainerStarted","Data":"cfcc1e192e09af929dea6cea8f4a052e0383d061d4dbc5a9b5d5c546081c253b"}
Jul 10 14:32:40.926998 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:40.926951    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-h9266" podStartSLOduration=66.880885537 podStartE2EDuration="1m11.926933268s" totalImagesPullingTime="5.046047731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:40.92663312 +0000 UTC m=+72.879523191" watchObservedRunningTime="2026-07-10 14:32:40.926933268 +0000 UTC m=+72.879823351"
Jul 10 14:32:40.946469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:40.946432    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kvhmz" podStartSLOduration=66.714002128 podStartE2EDuration="1m11.946419893s" totalImagesPullingTime="5.232417765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:40.944696045 +0000 UTC m=+72.897586122" watchObservedRunningTime="2026-07-10 14:32:40.946419893 +0000 UTC m=+72.899309970"
Jul 10 14:32:41.257044 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:41.256956    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:41.257174 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:41.257042    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:41.261683 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:41.261656    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:41.919610 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:41.919586    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:32:41.965076 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:41.965046    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff49f464b-tzhdp"]
Jul 10 14:32:42.066947 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:42.066916    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:42.168730 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:42.168698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:42.269595 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:42.269513    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:42.648600 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:42.648569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:42.717726 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:42.717688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:45.717509 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:45.717479    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:45.821128 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:45.821090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:32:50.797986 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:50.797843    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:32:50.797986 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:32:50.797920    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:33:00.975261 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:00.975208    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:01.040488 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:01.040452    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:06.990966 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:06.990932    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ff49f464b-tzhdp" podUID="8ce9a916-9ee3-48c2-93b1-3852c92a3a48" containerName="console" containerID="cri-o://882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d" gracePeriod=15
Jul 10 14:33:07.221512 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.221491    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:33:07.285460 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.285401    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-oauth-serving-cert\") pod \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") "
Jul 10 14:33:07.285460 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.285432    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-config\") pod \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") "
Jul 10 14:33:07.285460 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.285452    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-service-ca\") pod \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") "
Jul 10 14:33:07.285689 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.285490    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-serving-cert\") pod \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") "
Jul 10 14:33:07.285689 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.285524    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-trusted-ca-bundle\") pod \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") "
Jul 10 14:33:07.285689 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.285539    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqd9k\" (UniqueName: \"kubernetes.io/projected/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-kube-api-access-bqd9k\") pod \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") "
Jul 10 14:33:07.285689 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.285567    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-oauth-config\") pod \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\" (UID: \"8ce9a916-9ee3-48c2-93b1-3852c92a3a48\") "
Jul 10 14:33:07.286198 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.286136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-config" (OuterVolumeSpecName: "console-config") pod "8ce9a916-9ee3-48c2-93b1-3852c92a3a48" (UID: "8ce9a916-9ee3-48c2-93b1-3852c92a3a48"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:33:07.286198 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.286150    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ce9a916-9ee3-48c2-93b1-3852c92a3a48" (UID: "8ce9a916-9ee3-48c2-93b1-3852c92a3a48"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:33:07.286346 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.286267    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8ce9a916-9ee3-48c2-93b1-3852c92a3a48" (UID: "8ce9a916-9ee3-48c2-93b1-3852c92a3a48"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:33:07.286567 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.286542    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ce9a916-9ee3-48c2-93b1-3852c92a3a48" (UID: "8ce9a916-9ee3-48c2-93b1-3852c92a3a48"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:33:07.290180 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.289096    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ce9a916-9ee3-48c2-93b1-3852c92a3a48" (UID: "8ce9a916-9ee3-48c2-93b1-3852c92a3a48"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:33:07.290180 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.290596    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-kube-api-access-bqd9k" (OuterVolumeSpecName: "kube-api-access-bqd9k") pod "8ce9a916-9ee3-48c2-93b1-3852c92a3a48" (UID: "8ce9a916-9ee3-48c2-93b1-3852c92a3a48"). InnerVolumeSpecName "kube-api-access-bqd9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:33:07.291461 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.291438    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ce9a916-9ee3-48c2-93b1-3852c92a3a48" (UID: "8ce9a916-9ee3-48c2-93b1-3852c92a3a48"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:33:07.387013 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.386979    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-oauth-serving-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:33:07.387013 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.387011    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-config\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:33:07.387013 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.387021    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:33:07.387180 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.387029    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-serving-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:33:07.387180 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.387037    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-trusted-ca-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:33:07.387180 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.387045    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqd9k\" (UniqueName: \"kubernetes.io/projected/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-kube-api-access-bqd9k\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:33:07.387180 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:07.387053    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ce9a916-9ee3-48c2-93b1-3852c92a3a48-console-oauth-config\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:33:08.008180 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:08.008149    2564 generic.go:356] "Generic (PLEG): container finished" podID="8ce9a916-9ee3-48c2-93b1-3852c92a3a48" containerID="882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d" exitCode=0
Jul 10 14:33:08.008568 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:08.008208    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ff49f464b-tzhdp"
Jul 10 14:33:08.008568 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:08.008238    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff49f464b-tzhdp" event={"ID":"8ce9a916-9ee3-48c2-93b1-3852c92a3a48","Type":"ContainerDied","Data":"882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d"}
Jul 10 14:33:08.008568 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:08.008288    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ff49f464b-tzhdp" event={"ID":"8ce9a916-9ee3-48c2-93b1-3852c92a3a48","Type":"ContainerDied","Data":"e4aad2a586da5893a6e8ccca291043abcfbc6783faee1c6e1e21b2ea37e8568f"}
Jul 10 14:33:08.008568 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:08.008308    2564 scope.go:117] "RemoveContainer" containerID="882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d"
Jul 10 14:33:08.017742 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:08.017724    2564 scope.go:117] "RemoveContainer" containerID="882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d"
Jul 10 14:33:08.018025 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:33:08.018005    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d\": container with ID starting with 882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d not found: ID does not exist" containerID="882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d"
Jul 10 14:33:08.018094 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:08.018037    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d"} err="failed to get container status \"882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d\": rpc error: code = NotFound desc = could not find container \"882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d\": container with ID starting with 882cb6e2e12900d68e5eb0afc6af2a82327324eb57979052d6d23d6c405d643d not found: ID does not exist"
Jul 10 14:33:08.029730 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:08.029709    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ff49f464b-tzhdp"]
Jul 10 14:33:08.036339 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:08.036320    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ff49f464b-tzhdp"]
Jul 10 14:33:08.564416 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:08.564386    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce9a916-9ee3-48c2-93b1-3852c92a3a48" path="/var/lib/kubelet/pods/8ce9a916-9ee3-48c2-93b1-3852c92a3a48/volumes"
Jul 10 14:33:10.802377 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:10.802353    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:33:10.806112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:10.806072    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c49c9ddcc-5cpxb"
Jul 10 14:33:11.917894 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:11.917857    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-h9266"
Jul 10 14:33:13.496225 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:13.496184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:13.548196 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:13.548161    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:45.283481 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:45.283448    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:45.523901 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:45.523858    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:53.536880 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:53.536844    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:55.084195 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.084162    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fdd8d7d48-2lxz9"]
Jul 10 14:33:55.084576 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.084397    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce9a916-9ee3-48c2-93b1-3852c92a3a48" containerName="console"
Jul 10 14:33:55.084576 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.084410    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce9a916-9ee3-48c2-93b1-3852c92a3a48" containerName="console"
Jul 10 14:33:55.084576 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.084468    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce9a916-9ee3-48c2-93b1-3852c92a3a48" containerName="console"
Jul 10 14:33:55.087347 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.087329    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.100369 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.100347    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdd8d7d48-2lxz9"]
Jul 10 14:33:55.148061 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.148032    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:55.206811 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.206780    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:55.213066 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.213034    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-trusted-ca-bundle\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.213151 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.213079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-serving-cert\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.213151 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.213128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-service-ca\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.213216 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.213179    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb4ct\" (UniqueName: \"kubernetes.io/projected/5e97f3af-0c09-4842-ac55-2150840f30af-kube-api-access-zb4ct\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.213248 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.213212    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-oauth-config\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.213248 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.213238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-console-config\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.213310 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.213256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-oauth-serving-cert\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.313511 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.313487    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-trusted-ca-bundle\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.313605 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.313517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-serving-cert\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.313605 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.313538    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-service-ca\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.313605 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.313570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb4ct\" (UniqueName: \"kubernetes.io/projected/5e97f3af-0c09-4842-ac55-2150840f30af-kube-api-access-zb4ct\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.313605 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.313593    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-oauth-config\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.313831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.313610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-console-config\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.313831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.313732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-oauth-serving-cert\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.314346 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.314326    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-console-config\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.314458 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.314436    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-oauth-serving-cert\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.314529 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.314514    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-trusted-ca-bundle\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.314563 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.314518    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-service-ca\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.316045 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.316018    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-oauth-config\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.316248 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.316229    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-serving-cert\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.322530 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.322511    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb4ct\" (UniqueName: \"kubernetes.io/projected/5e97f3af-0c09-4842-ac55-2150840f30af-kube-api-access-zb4ct\") pod \"console-fdd8d7d48-2lxz9\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") " pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.395757 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.395734    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:33:55.453890 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.453861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:55.525056 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.525026    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdd8d7d48-2lxz9"]
Jul 10 14:33:55.527741 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.527712    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:55.528737 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:33:55.528712    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e97f3af_0c09_4842_ac55_2150840f30af.slice/crio-45430deaf27a26d90038445d3706ad4b4d217842b789f983f51741a9864d89fd WatchSource:0}: Error finding container 45430deaf27a26d90038445d3706ad4b4d217842b789f983f51741a9864d89fd: Status 404 returned error can't find the container with id 45430deaf27a26d90038445d3706ad4b4d217842b789f983f51741a9864d89fd
Jul 10 14:33:55.889636 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.889605    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:55.952967 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:55.952934    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:33:56.175453 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:56.175363    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdd8d7d48-2lxz9" event={"ID":"5e97f3af-0c09-4842-ac55-2150840f30af","Type":"ContainerStarted","Data":"3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c"}
Jul 10 14:33:56.175453 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:56.175415    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdd8d7d48-2lxz9" event={"ID":"5e97f3af-0c09-4842-ac55-2150840f30af","Type":"ContainerStarted","Data":"45430deaf27a26d90038445d3706ad4b4d217842b789f983f51741a9864d89fd"}
Jul 10 14:33:56.195315 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:33:56.195268    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fdd8d7d48-2lxz9" podStartSLOduration=1.195253737 podStartE2EDuration="1.195253737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:33:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:33:56.194209765 +0000 UTC m=+148.147099835" watchObservedRunningTime="2026-07-10 14:33:56.195253737 +0000 UTC m=+148.148143814"
Jul 10 14:34:05.396085 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:05.396048    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:34:05.396478 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:05.396106    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:34:05.400837 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:05.400814    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:34:06.215372 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:06.215348    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:34:06.259602 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:06.259578    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f697c646-kn78f"]
Jul 10 14:34:06.349427 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:06.349391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:34:06.409406 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:06.409370    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:34:06.557417 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:06.557334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:34:06.658285 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:06.658250    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:34:22.407165 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:22.407079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:34:22.488378 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:22.488346    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:34:31.282880 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.282835    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55f697c646-kn78f" podUID="6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" containerName="console" containerID="cri-o://754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e" gracePeriod=15
Jul 10 14:34:31.521973 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.521946    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:34:31.660503 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.660474    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-oauth-config\") pod \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") "
Jul 10 14:34:31.660681 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.660516    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-config\") pod \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") "
Jul 10 14:34:31.660681 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.660559    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-oauth-serving-cert\") pod \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") "
Jul 10 14:34:31.660681 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.660574    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-trusted-ca-bundle\") pod \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") "
Jul 10 14:34:31.660845 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.660806    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-serving-cert\") pod \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") "
Jul 10 14:34:31.660886 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.660861    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-service-ca\") pod \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") "
Jul 10 14:34:31.660932 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.660898    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df7rt\" (UniqueName: \"kubernetes.io/projected/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-kube-api-access-df7rt\") pod \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\" (UID: \"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7\") "
Jul 10 14:34:31.660932 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.660917    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" (UID: "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:34:31.661033 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.660973    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" (UID: "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:34:31.661150 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.661127    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-oauth-serving-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:34:31.661259 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.661168    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-config" (OuterVolumeSpecName: "console-config") pod "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" (UID: "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:34:31.661259 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.661205    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-service-ca" (OuterVolumeSpecName: "service-ca") pod "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" (UID: "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:34:31.663130 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.663103    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" (UID: "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:34:31.663220 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.663167    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" (UID: "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:34:31.663220 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.663207    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-kube-api-access-df7rt" (OuterVolumeSpecName: "kube-api-access-df7rt") pod "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" (UID: "6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7"). InnerVolumeSpecName "kube-api-access-df7rt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:34:31.761560 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.761534    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-oauth-config\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:34:31.761560 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.761559    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-config\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:34:31.761724 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.761571    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-trusted-ca-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:34:31.761724 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.761583    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-console-serving-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:34:31.761724 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.761595    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:34:31.761724 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:31.761606    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df7rt\" (UniqueName: \"kubernetes.io/projected/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7-kube-api-access-df7rt\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:34:32.310659 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:32.310627    2564 generic.go:356] "Generic (PLEG): container finished" podID="6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" containerID="754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e" exitCode=0
Jul 10 14:34:32.311120 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:32.310668    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f697c646-kn78f"
Jul 10 14:34:32.311120 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:32.310689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f697c646-kn78f" event={"ID":"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7","Type":"ContainerDied","Data":"754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e"}
Jul 10 14:34:32.311120 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:32.310737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f697c646-kn78f" event={"ID":"6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7","Type":"ContainerDied","Data":"8d069df7fd5ee3c3f38406b494c40e544332849557799f5ead19c74c3e4cd8b3"}
Jul 10 14:34:32.311120 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:32.310789    2564 scope.go:117] "RemoveContainer" containerID="754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e"
Jul 10 14:34:32.319054 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:32.319041    2564 scope.go:117] "RemoveContainer" containerID="754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e"
Jul 10 14:34:32.319299 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:34:32.319282    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e\": container with ID starting with 754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e not found: ID does not exist" containerID="754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e"
Jul 10 14:34:32.319356 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:32.319307    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e"} err="failed to get container status \"754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e\": rpc error: code = NotFound desc = could not find container \"754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e\": container with ID starting with 754aefe3c28144453d858de897a85b87f5d3025ac482b9edbb355b8bf4ee4e7e not found: ID does not exist"
Jul 10 14:34:32.332646 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:32.332624    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f697c646-kn78f"]
Jul 10 14:34:32.334472 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:32.334452    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55f697c646-kn78f"]
Jul 10 14:34:32.562866 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:32.562805    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" path="/var/lib/kubelet/pods/6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7/volumes"
Jul 10 14:34:44.550581 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:44.550536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:34:44.650976 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:34:44.650942    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:00.528544 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:00.528502    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:00.630248 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:00.630218    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:06.277518 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.277482    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5694b9578f-xw2pd"]
Jul 10 14:35:06.277884 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.277734    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" containerName="console"
Jul 10 14:35:06.277884 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.277746    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" containerName="console"
Jul 10 14:35:06.277884 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.277810    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a99d4e2-6dd7-4b2b-ade0-c1c8ef4a72f7" containerName="console"
Jul 10 14:35:06.280623 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.280602    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.292692 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.292667    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5694b9578f-xw2pd"]
Jul 10 14:35:06.300723 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.300699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-serving-cert\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.300844 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.300726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-service-ca\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.300844 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.300747    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-config\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.300844 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.300782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-oauth-serving-cert\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.301007 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.300899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49r6p\" (UniqueName: \"kubernetes.io/projected/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-kube-api-access-49r6p\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.301007 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.300941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-oauth-config\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.301007 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.300997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-trusted-ca-bundle\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.338420 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.338390    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:06.391139 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.391111    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:06.402253 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.402230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-serving-cert\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.402325 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.402261    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-service-ca\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.402325 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.402287    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-config\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.402416 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.402400    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-oauth-serving-cert\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.402502 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.402476    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49r6p\" (UniqueName: \"kubernetes.io/projected/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-kube-api-access-49r6p\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.402658 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.402635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-oauth-config\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.402731 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.402715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-trusted-ca-bundle\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.402984 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.402960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-service-ca\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.403299 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.403044    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-config\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.403436 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.403056    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-oauth-serving-cert\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.403436 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.403387    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-trusted-ca-bundle\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.404931 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.404907    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-serving-cert\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.405006 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.404971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-oauth-config\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.411028 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.411007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49r6p\" (UniqueName: \"kubernetes.io/projected/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-kube-api-access-49r6p\") pod \"console-5694b9578f-xw2pd\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") " pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.589767 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.589692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:06.714809 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:06.714777    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5694b9578f-xw2pd"]
Jul 10 14:35:06.717535 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:35:06.717512    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc61cf5_a22c_43b3_8837_49b75bb1c0a8.slice/crio-0027b22ecf223a9a3fb82496af089f855b72986282cffce1a11d7ab5cfdaedb4 WatchSource:0}: Error finding container 0027b22ecf223a9a3fb82496af089f855b72986282cffce1a11d7ab5cfdaedb4: Status 404 returned error can't find the container with id 0027b22ecf223a9a3fb82496af089f855b72986282cffce1a11d7ab5cfdaedb4
Jul 10 14:35:07.428547 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:07.428516    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5694b9578f-xw2pd" event={"ID":"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8","Type":"ContainerStarted","Data":"884e43dd8e10916ede4a4c98415b58bf831bfa164ffbb654475dd0e60656a963"}
Jul 10 14:35:07.428919 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:07.428566    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5694b9578f-xw2pd" event={"ID":"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8","Type":"ContainerStarted","Data":"0027b22ecf223a9a3fb82496af089f855b72986282cffce1a11d7ab5cfdaedb4"}
Jul 10 14:35:07.450440 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:07.450394    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5694b9578f-xw2pd" podStartSLOduration=1.450381044 podStartE2EDuration="1.450381044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:35:07.449052763 +0000 UTC m=+219.401942843" watchObservedRunningTime="2026-07-10 14:35:07.450381044 +0000 UTC m=+219.403271121"
Jul 10 14:35:12.446286 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:12.446251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:12.498690 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:12.498660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:15.730133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:15.730093    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:15.830951 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:15.830913    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:16.590833 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:16.590803    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:16.590995 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:16.590911    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:16.595894 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:16.595875    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:17.465331 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:17.465307    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:35:17.511070 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:17.511033    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdd8d7d48-2lxz9"]
Jul 10 14:35:17.615375 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:17.615344    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:17.682299 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:17.682264    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:17.750258 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:17.750171    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:35:42.531475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.531376    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fdd8d7d48-2lxz9" podUID="5e97f3af-0c09-4842-ac55-2150840f30af" containerName="console" containerID="cri-o://3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c" gracePeriod=15
Jul 10 14:35:42.775467 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.775443    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:35:42.858083 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858064    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-oauth-config\") pod \"5e97f3af-0c09-4842-ac55-2150840f30af\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") "
Jul 10 14:35:42.858216 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858102    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-trusted-ca-bundle\") pod \"5e97f3af-0c09-4842-ac55-2150840f30af\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") "
Jul 10 14:35:42.858216 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858122    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb4ct\" (UniqueName: \"kubernetes.io/projected/5e97f3af-0c09-4842-ac55-2150840f30af-kube-api-access-zb4ct\") pod \"5e97f3af-0c09-4842-ac55-2150840f30af\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") "
Jul 10 14:35:42.858216 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858147    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-oauth-serving-cert\") pod \"5e97f3af-0c09-4842-ac55-2150840f30af\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") "
Jul 10 14:35:42.858216 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858182    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-console-config\") pod \"5e97f3af-0c09-4842-ac55-2150840f30af\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") "
Jul 10 14:35:42.858216 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858204    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-serving-cert\") pod \"5e97f3af-0c09-4842-ac55-2150840f30af\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") "
Jul 10 14:35:42.858475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858242    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-service-ca\") pod \"5e97f3af-0c09-4842-ac55-2150840f30af\" (UID: \"5e97f3af-0c09-4842-ac55-2150840f30af\") "
Jul 10 14:35:42.858611 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858573    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5e97f3af-0c09-4842-ac55-2150840f30af" (UID: "5e97f3af-0c09-4842-ac55-2150840f30af"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:35:42.858712 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858603    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-console-config" (OuterVolumeSpecName: "console-config") pod "5e97f3af-0c09-4842-ac55-2150840f30af" (UID: "5e97f3af-0c09-4842-ac55-2150840f30af"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:35:42.858712 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858617    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5e97f3af-0c09-4842-ac55-2150840f30af" (UID: "5e97f3af-0c09-4842-ac55-2150840f30af"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:35:42.858712 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.858625    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-service-ca" (OuterVolumeSpecName: "service-ca") pod "5e97f3af-0c09-4842-ac55-2150840f30af" (UID: "5e97f3af-0c09-4842-ac55-2150840f30af"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:35:42.860305 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.860287    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5e97f3af-0c09-4842-ac55-2150840f30af" (UID: "5e97f3af-0c09-4842-ac55-2150840f30af"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:35:42.860885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.860868    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e97f3af-0c09-4842-ac55-2150840f30af-kube-api-access-zb4ct" (OuterVolumeSpecName: "kube-api-access-zb4ct") pod "5e97f3af-0c09-4842-ac55-2150840f30af" (UID: "5e97f3af-0c09-4842-ac55-2150840f30af"). InnerVolumeSpecName "kube-api-access-zb4ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:35:42.860956 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.860913    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5e97f3af-0c09-4842-ac55-2150840f30af" (UID: "5e97f3af-0c09-4842-ac55-2150840f30af"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:35:42.958659 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.958635    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-serving-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:35:42.958659 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.958656    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:35:42.958813 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.958666    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5e97f3af-0c09-4842-ac55-2150840f30af-console-oauth-config\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:35:42.958813 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.958674    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-trusted-ca-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:35:42.958813 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.958682    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb4ct\" (UniqueName: \"kubernetes.io/projected/5e97f3af-0c09-4842-ac55-2150840f30af-kube-api-access-zb4ct\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:35:42.958813 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.958690    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-oauth-serving-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:35:42.958813 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:42.958698    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5e97f3af-0c09-4842-ac55-2150840f30af-console-config\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:35:43.548593 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:43.548557    2564 generic.go:356] "Generic (PLEG): container finished" podID="5e97f3af-0c09-4842-ac55-2150840f30af" containerID="3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c" exitCode=0
Jul 10 14:35:43.549021 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:43.548602    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdd8d7d48-2lxz9" event={"ID":"5e97f3af-0c09-4842-ac55-2150840f30af","Type":"ContainerDied","Data":"3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c"}
Jul 10 14:35:43.549021 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:43.548643    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdd8d7d48-2lxz9" event={"ID":"5e97f3af-0c09-4842-ac55-2150840f30af","Type":"ContainerDied","Data":"45430deaf27a26d90038445d3706ad4b4d217842b789f983f51741a9864d89fd"}
Jul 10 14:35:43.549021 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:43.548663    2564 scope.go:117] "RemoveContainer" containerID="3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c"
Jul 10 14:35:43.549021 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:43.548607    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdd8d7d48-2lxz9"
Jul 10 14:35:43.556888 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:43.556872    2564 scope.go:117] "RemoveContainer" containerID="3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c"
Jul 10 14:35:43.557160 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:35:43.557143    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c\": container with ID starting with 3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c not found: ID does not exist" containerID="3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c"
Jul 10 14:35:43.557205 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:43.557168    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c"} err="failed to get container status \"3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c\": rpc error: code = NotFound desc = could not find container \"3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c\": container with ID starting with 3b21c5eacd46ca8ec214fbe469eb39d23600dc9a0280b1345ffc952cefd4dc9c not found: ID does not exist"
Jul 10 14:35:43.568912 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:43.568892    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdd8d7d48-2lxz9"]
Jul 10 14:35:43.572820 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:43.572800    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fdd8d7d48-2lxz9"]
Jul 10 14:35:44.566694 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:44.566663    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e97f3af-0c09-4842-ac55-2150840f30af" path="/var/lib/kubelet/pods/5e97f3af-0c09-4842-ac55-2150840f30af/volumes"
Jul 10 14:35:59.903607 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:35:59.903524    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:00.667860 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.667830    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"]
Jul 10 14:36:00.668073 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.668062    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e97f3af-0c09-4842-ac55-2150840f30af" containerName="console"
Jul 10 14:36:00.668116 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.668075    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e97f3af-0c09-4842-ac55-2150840f30af" containerName="console"
Jul 10 14:36:00.668153 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.668118    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e97f3af-0c09-4842-ac55-2150840f30af" containerName="console"
Jul 10 14:36:00.671017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.671001    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:00.673972 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.673944    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 14:36:00.674115 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.673978    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 14:36:00.675211 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.675194    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgh55\""
Jul 10 14:36:00.681331 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.681311    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"]
Jul 10 14:36:00.774395 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.774369    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxsx8\" (UniqueName: \"kubernetes.io/projected/41399ee6-804a-452c-93e4-ac5f8beed346-kube-api-access-mxsx8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:00.774530 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.774428    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:00.774530 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.774478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:00.874884 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.874842    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsx8\" (UniqueName: \"kubernetes.io/projected/41399ee6-804a-452c-93e4-ac5f8beed346-kube-api-access-mxsx8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:00.875028 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.874900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:00.875028 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.874929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:00.875216 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.875199    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:00.875284 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.875249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:00.883833 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.883811    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxsx8\" (UniqueName: \"kubernetes.io/projected/41399ee6-804a-452c-93e4-ac5f8beed346-kube-api-access-mxsx8\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:00.979541 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:00.979482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:01.106106 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:01.106060    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"]
Jul 10 14:36:01.108704 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:36:01.108673    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41399ee6_804a_452c_93e4_ac5f8beed346.slice/crio-4644c4e46e1ec1d87de2e53b8e9ca22622b952b28b46e818d9efa6a29e978586 WatchSource:0}: Error finding container 4644c4e46e1ec1d87de2e53b8e9ca22622b952b28b46e818d9efa6a29e978586: Status 404 returned error can't find the container with id 4644c4e46e1ec1d87de2e53b8e9ca22622b952b28b46e818d9efa6a29e978586
Jul 10 14:36:01.606820 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:01.606784    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j" event={"ID":"41399ee6-804a-452c-93e4-ac5f8beed346","Type":"ContainerStarted","Data":"4644c4e46e1ec1d87de2e53b8e9ca22622b952b28b46e818d9efa6a29e978586"}
Jul 10 14:36:01.781052 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:01.781007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:09.636692 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:09.636656    2564 generic.go:356] "Generic (PLEG): container finished" podID="41399ee6-804a-452c-93e4-ac5f8beed346" containerID="9cd9aebe003b65effe889dd56ee806431742b8bdf4b4c55d3dec208b3291e18c" exitCode=0
Jul 10 14:36:09.637161 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:09.636745    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j" event={"ID":"41399ee6-804a-452c-93e4-ac5f8beed346","Type":"ContainerDied","Data":"9cd9aebe003b65effe889dd56ee806431742b8bdf4b4c55d3dec208b3291e18c"}
Jul 10 14:36:12.649442 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:12.649401    2564 generic.go:356] "Generic (PLEG): container finished" podID="41399ee6-804a-452c-93e4-ac5f8beed346" containerID="df009389c710dd665c0a660a37624a02fff9879d0e18d646502a7f33423b831f" exitCode=0
Jul 10 14:36:12.649842 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:12.649503    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j" event={"ID":"41399ee6-804a-452c-93e4-ac5f8beed346","Type":"ContainerDied","Data":"df009389c710dd665c0a660a37624a02fff9879d0e18d646502a7f33423b831f"}
Jul 10 14:36:22.685434 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:22.685394    2564 generic.go:356] "Generic (PLEG): container finished" podID="41399ee6-804a-452c-93e4-ac5f8beed346" containerID="32ba53d30be5596f45f7efb2dfa92a0962ff42cd52a7a25571baf16b7955783c" exitCode=0
Jul 10 14:36:22.685826 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:22.685436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j" event={"ID":"41399ee6-804a-452c-93e4-ac5f8beed346","Type":"ContainerDied","Data":"32ba53d30be5596f45f7efb2dfa92a0962ff42cd52a7a25571baf16b7955783c"}
Jul 10 14:36:23.817524 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:23.817501    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:23.961163 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:23.961087    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-util\") pod \"41399ee6-804a-452c-93e4-ac5f8beed346\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") "
Jul 10 14:36:23.961163 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:23.961157    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-bundle\") pod \"41399ee6-804a-452c-93e4-ac5f8beed346\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") "
Jul 10 14:36:23.961321 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:23.961177    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxsx8\" (UniqueName: \"kubernetes.io/projected/41399ee6-804a-452c-93e4-ac5f8beed346-kube-api-access-mxsx8\") pod \"41399ee6-804a-452c-93e4-ac5f8beed346\" (UID: \"41399ee6-804a-452c-93e4-ac5f8beed346\") "
Jul 10 14:36:23.961792 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:23.961733    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-bundle" (OuterVolumeSpecName: "bundle") pod "41399ee6-804a-452c-93e4-ac5f8beed346" (UID: "41399ee6-804a-452c-93e4-ac5f8beed346"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:36:23.963488 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:23.963459    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41399ee6-804a-452c-93e4-ac5f8beed346-kube-api-access-mxsx8" (OuterVolumeSpecName: "kube-api-access-mxsx8") pod "41399ee6-804a-452c-93e4-ac5f8beed346" (UID: "41399ee6-804a-452c-93e4-ac5f8beed346"). InnerVolumeSpecName "kube-api-access-mxsx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:36:23.965606 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:23.965586    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-util" (OuterVolumeSpecName: "util") pod "41399ee6-804a-452c-93e4-ac5f8beed346" (UID: "41399ee6-804a-452c-93e4-ac5f8beed346"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:36:24.062134 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:24.062104    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:36:24.062134 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:24.062130    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxsx8\" (UniqueName: \"kubernetes.io/projected/41399ee6-804a-452c-93e4-ac5f8beed346-kube-api-access-mxsx8\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:36:24.062134 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:24.062140    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41399ee6-804a-452c-93e4-ac5f8beed346-util\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:36:24.695626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:24.695593    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j" event={"ID":"41399ee6-804a-452c-93e4-ac5f8beed346","Type":"ContainerDied","Data":"4644c4e46e1ec1d87de2e53b8e9ca22622b952b28b46e818d9efa6a29e978586"}
Jul 10 14:36:24.695626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:24.695610    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540x6z2j"
Jul 10 14:36:24.695825 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:24.695646    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4644c4e46e1ec1d87de2e53b8e9ca22622b952b28b46e818d9efa6a29e978586"
Jul 10 14:36:26.739062 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:26.739021    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:27.509547 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:27.509508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:28.408329 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.408295    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:36:28.410637 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.410617    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:36:28.415842 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.415825    2564 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 14:36:28.712408 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.712342    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"]
Jul 10 14:36:28.714412 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.712594    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41399ee6-804a-452c-93e4-ac5f8beed346" containerName="util"
Jul 10 14:36:28.714412 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.712605    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="41399ee6-804a-452c-93e4-ac5f8beed346" containerName="util"
Jul 10 14:36:28.714412 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.712623    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41399ee6-804a-452c-93e4-ac5f8beed346" containerName="extract"
Jul 10 14:36:28.714412 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.712629    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="41399ee6-804a-452c-93e4-ac5f8beed346" containerName="extract"
Jul 10 14:36:28.714412 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.712637    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41399ee6-804a-452c-93e4-ac5f8beed346" containerName="pull"
Jul 10 14:36:28.714412 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.712642    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="41399ee6-804a-452c-93e4-ac5f8beed346" containerName="pull"
Jul 10 14:36:28.714412 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.712675    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="41399ee6-804a-452c-93e4-ac5f8beed346" containerName="extract"
Jul 10 14:36:28.715275 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.715261    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"
Jul 10 14:36:28.718083 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.718065    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 10 14:36:28.718156 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.718073    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j6rmh\""
Jul 10 14:36:28.718200 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.718077    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 10 14:36:28.735161 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.735139    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"]
Jul 10 14:36:28.896225 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.896200    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aff4309-a9dc-4244-b82c-c5d756772b23-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzvcg\" (UID: \"6aff4309-a9dc-4244-b82c-c5d756772b23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"
Jul 10 14:36:28.896392 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.896285    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrp5g\" (UniqueName: \"kubernetes.io/projected/6aff4309-a9dc-4244-b82c-c5d756772b23-kube-api-access-xrp5g\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzvcg\" (UID: \"6aff4309-a9dc-4244-b82c-c5d756772b23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"
Jul 10 14:36:28.996638 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.996566    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrp5g\" (UniqueName: \"kubernetes.io/projected/6aff4309-a9dc-4244-b82c-c5d756772b23-kube-api-access-xrp5g\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzvcg\" (UID: \"6aff4309-a9dc-4244-b82c-c5d756772b23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"
Jul 10 14:36:28.996638 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.996605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aff4309-a9dc-4244-b82c-c5d756772b23-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzvcg\" (UID: \"6aff4309-a9dc-4244-b82c-c5d756772b23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"
Jul 10 14:36:28.996987 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:28.996971    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aff4309-a9dc-4244-b82c-c5d756772b23-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzvcg\" (UID: \"6aff4309-a9dc-4244-b82c-c5d756772b23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"
Jul 10 14:36:29.007900 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:29.007877    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrp5g\" (UniqueName: \"kubernetes.io/projected/6aff4309-a9dc-4244-b82c-c5d756772b23-kube-api-access-xrp5g\") pod \"cert-manager-operator-controller-manager-55c444bf86-kzvcg\" (UID: \"6aff4309-a9dc-4244-b82c-c5d756772b23\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"
Jul 10 14:36:29.023656 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:29.023632    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"
Jul 10 14:36:29.153877 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:29.153849    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg"]
Jul 10 14:36:29.158060 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:36:29.158028    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aff4309_a9dc_4244_b82c_c5d756772b23.slice/crio-fe58bf9639ea57e3074f7891efa048f9512e0f336e680ca584798bb21fb7c9cc WatchSource:0}: Error finding container fe58bf9639ea57e3074f7891efa048f9512e0f336e680ca584798bb21fb7c9cc: Status 404 returned error can't find the container with id fe58bf9639ea57e3074f7891efa048f9512e0f336e680ca584798bb21fb7c9cc
Jul 10 14:36:29.714067 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:29.714025    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg" event={"ID":"6aff4309-a9dc-4244-b82c-c5d756772b23","Type":"ContainerStarted","Data":"fe58bf9639ea57e3074f7891efa048f9512e0f336e680ca584798bb21fb7c9cc"}
Jul 10 14:36:30.360946 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:30.360905    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:30.461323 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:30.461290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:31.723892 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:31.723852    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg" event={"ID":"6aff4309-a9dc-4244-b82c-c5d756772b23","Type":"ContainerStarted","Data":"ab4478e78fab8ac17630724719b23ae7daf054123bdda2ee727bc263aaf8e517"}
Jul 10 14:36:31.749947 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:31.749893    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-kzvcg" podStartSLOduration=1.9166531679999999 podStartE2EDuration="3.749876542s" totalImagesPullingTime="1.833223374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:36:31.748521386 +0000 UTC m=+303.701411463" watchObservedRunningTime="2026-07-10 14:36:31.749876542 +0000 UTC m=+303.702766618"
Jul 10 14:36:31.978716 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:31.978633    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:32.075392 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.075357    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:32.167451 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.167415    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mnx2l"]
Jul 10 14:36:32.170567 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.170545    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l"
Jul 10 14:36:32.173494 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.173470    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 10 14:36:32.174706 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.174689    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 10 14:36:32.174843 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.174730    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-pz6bt\""
Jul 10 14:36:32.179925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.179895    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:32.186728 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.186706    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mnx2l"]
Jul 10 14:36:32.284453 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.284340    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:32.321793 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.321739    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ee89c79-6d2d-487f-9606-cd410adfe0ae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mnx2l\" (UID: \"5ee89c79-6d2d-487f-9606-cd410adfe0ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l"
Jul 10 14:36:32.321955 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.321868    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l85f6\" (UniqueName: \"kubernetes.io/projected/5ee89c79-6d2d-487f-9606-cd410adfe0ae-kube-api-access-l85f6\") pod \"cert-manager-webhook-6486ffd997-mnx2l\" (UID: \"5ee89c79-6d2d-487f-9606-cd410adfe0ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l"
Jul 10 14:36:32.422363 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.422327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ee89c79-6d2d-487f-9606-cd410adfe0ae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mnx2l\" (UID: \"5ee89c79-6d2d-487f-9606-cd410adfe0ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l"
Jul 10 14:36:32.422556 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.422417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l85f6\" (UniqueName: \"kubernetes.io/projected/5ee89c79-6d2d-487f-9606-cd410adfe0ae-kube-api-access-l85f6\") pod \"cert-manager-webhook-6486ffd997-mnx2l\" (UID: \"5ee89c79-6d2d-487f-9606-cd410adfe0ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l"
Jul 10 14:36:32.443338 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.443302    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ee89c79-6d2d-487f-9606-cd410adfe0ae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-mnx2l\" (UID: \"5ee89c79-6d2d-487f-9606-cd410adfe0ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l"
Jul 10 14:36:32.443458 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.443418    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l85f6\" (UniqueName: \"kubernetes.io/projected/5ee89c79-6d2d-487f-9606-cd410adfe0ae-kube-api-access-l85f6\") pod \"cert-manager-webhook-6486ffd997-mnx2l\" (UID: \"5ee89c79-6d2d-487f-9606-cd410adfe0ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l"
Jul 10 14:36:32.490354 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.490324    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l"
Jul 10 14:36:32.623519 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.623491    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-mnx2l"]
Jul 10 14:36:32.626608 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:36:32.626572    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ee89c79_6d2d_487f_9606_cd410adfe0ae.slice/crio-1029569cc529d49c2f5d40d32a9273531259042b58bbd0107df0019da327065e WatchSource:0}: Error finding container 1029569cc529d49c2f5d40d32a9273531259042b58bbd0107df0019da327065e: Status 404 returned error can't find the container with id 1029569cc529d49c2f5d40d32a9273531259042b58bbd0107df0019da327065e
Jul 10 14:36:32.628485 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.628468    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 14:36:32.728368 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.728334    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l" event={"ID":"5ee89c79-6d2d-487f-9606-cd410adfe0ae","Type":"ContainerStarted","Data":"1029569cc529d49c2f5d40d32a9273531259042b58bbd0107df0019da327065e"}
Jul 10 14:36:32.973061 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.973025    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"]
Jul 10 14:36:32.977331 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.977316    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:32.980331 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.980306    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 14:36:32.980331 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.980322    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgh55\""
Jul 10 14:36:32.980487 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.980306    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 14:36:32.989873 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:32.989852    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"]
Jul 10 14:36:33.128017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.127985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:33.128158 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.128027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfg4\" (UniqueName: \"kubernetes.io/projected/ba633570-df0d-4137-bbdd-619731f859b6-kube-api-access-4dfg4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:33.128158 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.128052    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:33.229015 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.228939    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:33.229015 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.229003    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:33.229166 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.229030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfg4\" (UniqueName: \"kubernetes.io/projected/ba633570-df0d-4137-bbdd-619731f859b6-kube-api-access-4dfg4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:33.229444 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.229423    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:33.229484 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.229432    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:33.240371 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.240343    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfg4\" (UniqueName: \"kubernetes.io/projected/ba633570-df0d-4137-bbdd-619731f859b6-kube-api-access-4dfg4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:33.286159 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.286137    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:33.415514 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.415358    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"]
Jul 10 14:36:33.417851 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:36:33.417824    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba633570_df0d_4137_bbdd_619731f859b6.slice/crio-3908413ddfb2f21cb45d14ad0dc00194faf2c7942a0795c7d3ccea5d05eb5b2f WatchSource:0}: Error finding container 3908413ddfb2f21cb45d14ad0dc00194faf2c7942a0795c7d3ccea5d05eb5b2f: Status 404 returned error can't find the container with id 3908413ddfb2f21cb45d14ad0dc00194faf2c7942a0795c7d3ccea5d05eb5b2f
Jul 10 14:36:33.734818 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.734716    2564 generic.go:356] "Generic (PLEG): container finished" podID="ba633570-df0d-4137-bbdd-619731f859b6" containerID="97129fd53f7720e5942a60f928e5fb6dada790bd23581d03688a5bdd20401156" exitCode=0
Jul 10 14:36:33.734818 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.734771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d" event={"ID":"ba633570-df0d-4137-bbdd-619731f859b6","Type":"ContainerDied","Data":"97129fd53f7720e5942a60f928e5fb6dada790bd23581d03688a5bdd20401156"}
Jul 10 14:36:33.735285 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:33.734831    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d" event={"ID":"ba633570-df0d-4137-bbdd-619731f859b6","Type":"ContainerStarted","Data":"3908413ddfb2f21cb45d14ad0dc00194faf2c7942a0795c7d3ccea5d05eb5b2f"}
Jul 10 14:36:34.355115 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:34.355060    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:34.822402 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:34.822319    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:35.721777 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.721725    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"]
Jul 10 14:36:35.724994 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.724974    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"
Jul 10 14:36:35.727633 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.727609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9t7tw\""
Jul 10 14:36:35.735241 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.735210    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"]
Jul 10 14:36:35.744726 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.744703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l" event={"ID":"5ee89c79-6d2d-487f-9606-cd410adfe0ae","Type":"ContainerStarted","Data":"46b12a3664e6926621f3e074a601f724d8c4b425b041d243fb460af588acad81"}
Jul 10 14:36:35.744936 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.744900    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l"
Jul 10 14:36:35.747705 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.747660    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llkjs\" (UniqueName: \"kubernetes.io/projected/c4376f4d-314d-4619-8ec6-8c3b19edbc2f-kube-api-access-llkjs\") pod \"cert-manager-cainjector-559cdd8c87-zzztv\" (UID: \"c4376f4d-314d-4619-8ec6-8c3b19edbc2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"
Jul 10 14:36:35.747853 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.747782    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4376f4d-314d-4619-8ec6-8c3b19edbc2f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zzztv\" (UID: \"c4376f4d-314d-4619-8ec6-8c3b19edbc2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"
Jul 10 14:36:35.762516 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.762465    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l" podStartSLOduration=0.839475409 podStartE2EDuration="3.762447317s" totalImagesPullingTime="2.922971908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:36:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:36:35.760132834 +0000 UTC m=+307.713022927" watchObservedRunningTime="2026-07-10 14:36:35.762447317 +0000 UTC m=+307.715337396"
Jul 10 14:36:35.848885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.848810    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llkjs\" (UniqueName: \"kubernetes.io/projected/c4376f4d-314d-4619-8ec6-8c3b19edbc2f-kube-api-access-llkjs\") pod \"cert-manager-cainjector-559cdd8c87-zzztv\" (UID: \"c4376f4d-314d-4619-8ec6-8c3b19edbc2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"
Jul 10 14:36:35.848885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.848876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4376f4d-314d-4619-8ec6-8c3b19edbc2f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zzztv\" (UID: \"c4376f4d-314d-4619-8ec6-8c3b19edbc2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"
Jul 10 14:36:35.857770 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.857718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c4376f4d-314d-4619-8ec6-8c3b19edbc2f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zzztv\" (UID: \"c4376f4d-314d-4619-8ec6-8c3b19edbc2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"
Jul 10 14:36:35.858044 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:35.858020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llkjs\" (UniqueName: \"kubernetes.io/projected/c4376f4d-314d-4619-8ec6-8c3b19edbc2f-kube-api-access-llkjs\") pod \"cert-manager-cainjector-559cdd8c87-zzztv\" (UID: \"c4376f4d-314d-4619-8ec6-8c3b19edbc2f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"
Jul 10 14:36:36.036224 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:36.036188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"
Jul 10 14:36:36.187207 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:36.187174    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zzztv"]
Jul 10 14:36:36.871835 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:36:36.871791    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc4376f4d_314d_4619_8ec6_8c3b19edbc2f.slice/crio-2214291742a58b37fddc4b51214ee74870cd8da02efd265ed54483d28639e0f0 WatchSource:0}: Error finding container 2214291742a58b37fddc4b51214ee74870cd8da02efd265ed54483d28639e0f0: Status 404 returned error can't find the container with id 2214291742a58b37fddc4b51214ee74870cd8da02efd265ed54483d28639e0f0
Jul 10 14:36:37.145093 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:37.145006    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:37.205637 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:37.205603    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:37.756360 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:37.756298    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv" event={"ID":"c4376f4d-314d-4619-8ec6-8c3b19edbc2f","Type":"ContainerStarted","Data":"31a5ad41cb6fc9d2461e109d4a7965df9eb46c58c23a18c4ccdddbec2db45282"}
Jul 10 14:36:37.756360 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:37.756343    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv" event={"ID":"c4376f4d-314d-4619-8ec6-8c3b19edbc2f","Type":"ContainerStarted","Data":"2214291742a58b37fddc4b51214ee74870cd8da02efd265ed54483d28639e0f0"}
Jul 10 14:36:37.758281 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:37.758258    2564 generic.go:356] "Generic (PLEG): container finished" podID="ba633570-df0d-4137-bbdd-619731f859b6" containerID="bd2212cfa145f8a9e5bc377e3a14e64a423ecdbfc8d6d67883e2a623f24ce103" exitCode=0
Jul 10 14:36:37.758433 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:37.758302    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d" event={"ID":"ba633570-df0d-4137-bbdd-619731f859b6","Type":"ContainerDied","Data":"bd2212cfa145f8a9e5bc377e3a14e64a423ecdbfc8d6d67883e2a623f24ce103"}
Jul 10 14:36:37.773778 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:37.773716    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zzztv" podStartSLOduration=2.773700704 podStartE2EDuration="2.773700704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:36:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:36:37.772487608 +0000 UTC m=+309.725377686" watchObservedRunningTime="2026-07-10 14:36:37.773700704 +0000 UTC m=+309.726590781"
Jul 10 14:36:38.764216 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:38.764187    2564 generic.go:356] "Generic (PLEG): container finished" podID="ba633570-df0d-4137-bbdd-619731f859b6" containerID="d4d9eadf0585f63dbcb4abad40581a7680da328fe597e29551307b146a566b7d" exitCode=0
Jul 10 14:36:38.764684 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:38.764262    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d" event={"ID":"ba633570-df0d-4137-bbdd-619731f859b6","Type":"ContainerDied","Data":"d4d9eadf0585f63dbcb4abad40581a7680da328fe597e29551307b146a566b7d"}
Jul 10 14:36:39.887831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:39.887809    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:39.981408 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:39.981378    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-bundle\") pod \"ba633570-df0d-4137-bbdd-619731f859b6\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") "
Jul 10 14:36:39.981556 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:39.981419    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-util\") pod \"ba633570-df0d-4137-bbdd-619731f859b6\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") "
Jul 10 14:36:39.981556 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:39.981481    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dfg4\" (UniqueName: \"kubernetes.io/projected/ba633570-df0d-4137-bbdd-619731f859b6-kube-api-access-4dfg4\") pod \"ba633570-df0d-4137-bbdd-619731f859b6\" (UID: \"ba633570-df0d-4137-bbdd-619731f859b6\") "
Jul 10 14:36:39.981791 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:39.981736    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-bundle" (OuterVolumeSpecName: "bundle") pod "ba633570-df0d-4137-bbdd-619731f859b6" (UID: "ba633570-df0d-4137-bbdd-619731f859b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:36:39.983736 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:39.983710    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba633570-df0d-4137-bbdd-619731f859b6-kube-api-access-4dfg4" (OuterVolumeSpecName: "kube-api-access-4dfg4") pod "ba633570-df0d-4137-bbdd-619731f859b6" (UID: "ba633570-df0d-4137-bbdd-619731f859b6"). InnerVolumeSpecName "kube-api-access-4dfg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:36:39.985741 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:39.985720    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-util" (OuterVolumeSpecName: "util") pod "ba633570-df0d-4137-bbdd-619731f859b6" (UID: "ba633570-df0d-4137-bbdd-619731f859b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:36:40.082321 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:40.082247    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dfg4\" (UniqueName: \"kubernetes.io/projected/ba633570-df0d-4137-bbdd-619731f859b6-kube-api-access-4dfg4\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:36:40.082321 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:40.082275    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:36:40.082321 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:40.082285    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba633570-df0d-4137-bbdd-619731f859b6-util\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:36:40.773812 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:40.773777    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d" event={"ID":"ba633570-df0d-4137-bbdd-619731f859b6","Type":"ContainerDied","Data":"3908413ddfb2f21cb45d14ad0dc00194faf2c7942a0795c7d3ccea5d05eb5b2f"}
Jul 10 14:36:40.773962 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:40.773828    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3908413ddfb2f21cb45d14ad0dc00194faf2c7942a0795c7d3ccea5d05eb5b2f"
Jul 10 14:36:40.773962 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:40.773792    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6s54d"
Jul 10 14:36:41.752341 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:41.752308    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-mnx2l"
Jul 10 14:36:41.818144 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:41.818112    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:42.917979 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.917943    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-twcgs"]
Jul 10 14:36:42.918464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.918317    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba633570-df0d-4137-bbdd-619731f859b6" containerName="pull"
Jul 10 14:36:42.918464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.918336    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba633570-df0d-4137-bbdd-619731f859b6" containerName="pull"
Jul 10 14:36:42.918464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.918348    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba633570-df0d-4137-bbdd-619731f859b6" containerName="extract"
Jul 10 14:36:42.918464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.918355    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba633570-df0d-4137-bbdd-619731f859b6" containerName="extract"
Jul 10 14:36:42.918464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.918368    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba633570-df0d-4137-bbdd-619731f859b6" containerName="util"
Jul 10 14:36:42.918464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.918375    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba633570-df0d-4137-bbdd-619731f859b6" containerName="util"
Jul 10 14:36:42.918464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.918441    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba633570-df0d-4137-bbdd-619731f859b6" containerName="extract"
Jul 10 14:36:42.920860 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.920840    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-twcgs"
Jul 10 14:36:42.923409 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.923387    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-p75pq\""
Jul 10 14:36:42.928953 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:42.928933    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-twcgs"]
Jul 10 14:36:43.003728 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.003704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sskp\" (UniqueName: \"kubernetes.io/projected/bb485a2c-2396-45d9-bef0-4019657e6a7c-kube-api-access-5sskp\") pod \"cert-manager-55b4d954d5-twcgs\" (UID: \"bb485a2c-2396-45d9-bef0-4019657e6a7c\") " pod="cert-manager/cert-manager-55b4d954d5-twcgs"
Jul 10 14:36:43.003830 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.003788    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb485a2c-2396-45d9-bef0-4019657e6a7c-bound-sa-token\") pod \"cert-manager-55b4d954d5-twcgs\" (UID: \"bb485a2c-2396-45d9-bef0-4019657e6a7c\") " pod="cert-manager/cert-manager-55b4d954d5-twcgs"
Jul 10 14:36:43.104442 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.104420    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sskp\" (UniqueName: \"kubernetes.io/projected/bb485a2c-2396-45d9-bef0-4019657e6a7c-kube-api-access-5sskp\") pod \"cert-manager-55b4d954d5-twcgs\" (UID: \"bb485a2c-2396-45d9-bef0-4019657e6a7c\") " pod="cert-manager/cert-manager-55b4d954d5-twcgs"
Jul 10 14:36:43.104542 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.104468    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb485a2c-2396-45d9-bef0-4019657e6a7c-bound-sa-token\") pod \"cert-manager-55b4d954d5-twcgs\" (UID: \"bb485a2c-2396-45d9-bef0-4019657e6a7c\") " pod="cert-manager/cert-manager-55b4d954d5-twcgs"
Jul 10 14:36:43.112973 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.112948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb485a2c-2396-45d9-bef0-4019657e6a7c-bound-sa-token\") pod \"cert-manager-55b4d954d5-twcgs\" (UID: \"bb485a2c-2396-45d9-bef0-4019657e6a7c\") " pod="cert-manager/cert-manager-55b4d954d5-twcgs"
Jul 10 14:36:43.113060 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.113023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sskp\" (UniqueName: \"kubernetes.io/projected/bb485a2c-2396-45d9-bef0-4019657e6a7c-kube-api-access-5sskp\") pod \"cert-manager-55b4d954d5-twcgs\" (UID: \"bb485a2c-2396-45d9-bef0-4019657e6a7c\") " pod="cert-manager/cert-manager-55b4d954d5-twcgs"
Jul 10 14:36:43.229660 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.229608    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-twcgs"
Jul 10 14:36:43.353964 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.353944    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-twcgs"]
Jul 10 14:36:43.356326 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:36:43.356296    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb485a2c_2396_45d9_bef0_4019657e6a7c.slice/crio-477e46ba38d4706c46c1f97ec13105e69de632a9378a86e4135b1c30a80d4360 WatchSource:0}: Error finding container 477e46ba38d4706c46c1f97ec13105e69de632a9378a86e4135b1c30a80d4360: Status 404 returned error can't find the container with id 477e46ba38d4706c46c1f97ec13105e69de632a9378a86e4135b1c30a80d4360
Jul 10 14:36:43.786889 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.786858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-twcgs" event={"ID":"bb485a2c-2396-45d9-bef0-4019657e6a7c","Type":"ContainerStarted","Data":"ec01a3f65f27024fbe35741e0081d01c0bbd0e4c521ca5896bf7e53682a7b49f"}
Jul 10 14:36:43.787040 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.786901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-twcgs" event={"ID":"bb485a2c-2396-45d9-bef0-4019657e6a7c","Type":"ContainerStarted","Data":"477e46ba38d4706c46c1f97ec13105e69de632a9378a86e4135b1c30a80d4360"}
Jul 10 14:36:43.804951 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:43.804903    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-twcgs" podStartSLOduration=1.8048895200000001 podStartE2EDuration="1.80488952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:36:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:36:43.802945003 +0000 UTC m=+315.755835081" watchObservedRunningTime="2026-07-10 14:36:43.80488952 +0000 UTC m=+315.757779597"
Jul 10 14:36:48.774095 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:48.774059    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:48.864866 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:48.864827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:52.845876 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:52.845841    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:54.791242 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:54.791210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:54.892680 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:54.892646    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:57.111165 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:57.111132    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:36:59.421435 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.421402    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"]
Jul 10 14:36:59.423889 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.423871    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.427072 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.427042    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 10 14:36:59.427183 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.427066    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 10 14:36:59.427183 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.427144    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kgh55\""
Jul 10 14:36:59.433432 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.433411    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"]
Jul 10 14:36:59.516646 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.516622    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.516743 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.516651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgtvw\" (UniqueName: \"kubernetes.io/projected/2f404124-dc17-472b-9444-72b7cef2ce88-kube-api-access-mgtvw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.516743 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.516675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.617860 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.617839    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.617950 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.617867    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgtvw\" (UniqueName: \"kubernetes.io/projected/2f404124-dc17-472b-9444-72b7cef2ce88-kube-api-access-mgtvw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.617950 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.617891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.618209 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.618194    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.618244 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.618222    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.626609 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.626584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgtvw\" (UniqueName: \"kubernetes.io/projected/2f404124-dc17-472b-9444-72b7cef2ce88-kube-api-access-mgtvw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.734958 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.734895    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:36:59.861986 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:36:59.861957    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"]
Jul 10 14:36:59.864932 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:36:59.864905    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f404124_dc17_472b_9444_72b7cef2ce88.slice/crio-2d63145615a14810cd6daec70e84ab2e545e912fe00bb837278b65f22d6066b0 WatchSource:0}: Error finding container 2d63145615a14810cd6daec70e84ab2e545e912fe00bb837278b65f22d6066b0: Status 404 returned error can't find the container with id 2d63145615a14810cd6daec70e84ab2e545e912fe00bb837278b65f22d6066b0
Jul 10 14:37:00.857776 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:00.857727    2564 generic.go:356] "Generic (PLEG): container finished" podID="2f404124-dc17-472b-9444-72b7cef2ce88" containerID="d1053d8f514d4d4120857d14a6cfa9400526393bafe69a9e6045d0d15811f565" exitCode=0
Jul 10 14:37:00.858117 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:00.857782    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48" event={"ID":"2f404124-dc17-472b-9444-72b7cef2ce88","Type":"ContainerDied","Data":"d1053d8f514d4d4120857d14a6cfa9400526393bafe69a9e6045d0d15811f565"}
Jul 10 14:37:00.858117 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:00.857834    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48" event={"ID":"2f404124-dc17-472b-9444-72b7cef2ce88","Type":"ContainerStarted","Data":"2d63145615a14810cd6daec70e84ab2e545e912fe00bb837278b65f22d6066b0"}
Jul 10 14:37:01.863483 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:01.863445    2564 generic.go:356] "Generic (PLEG): container finished" podID="2f404124-dc17-472b-9444-72b7cef2ce88" containerID="9e6b5245621d5c0c19a69c8f042f626e0ac989a946cb1550919abd9791c31073" exitCode=0
Jul 10 14:37:01.863867 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:01.863506    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48" event={"ID":"2f404124-dc17-472b-9444-72b7cef2ce88","Type":"ContainerDied","Data":"9e6b5245621d5c0c19a69c8f042f626e0ac989a946cb1550919abd9791c31073"}
Jul 10 14:37:02.869056 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:02.869024    2564 generic.go:356] "Generic (PLEG): container finished" podID="2f404124-dc17-472b-9444-72b7cef2ce88" containerID="f1439ca03c9b6b6b0c6ed4bf914d257a77d90410b5c062c4d8214836df613cca" exitCode=0
Jul 10 14:37:02.869426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:02.869101    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48" event={"ID":"2f404124-dc17-472b-9444-72b7cef2ce88","Type":"ContainerDied","Data":"f1439ca03c9b6b6b0c6ed4bf914d257a77d90410b5c062c4d8214836df613cca"}
Jul 10 14:37:03.993864 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:03.993839    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:37:04.048149 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.048126    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-util\") pod \"2f404124-dc17-472b-9444-72b7cef2ce88\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") "
Jul 10 14:37:04.048276 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.048164    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-bundle\") pod \"2f404124-dc17-472b-9444-72b7cef2ce88\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") "
Jul 10 14:37:04.048276 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.048198    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgtvw\" (UniqueName: \"kubernetes.io/projected/2f404124-dc17-472b-9444-72b7cef2ce88-kube-api-access-mgtvw\") pod \"2f404124-dc17-472b-9444-72b7cef2ce88\" (UID: \"2f404124-dc17-472b-9444-72b7cef2ce88\") "
Jul 10 14:37:04.049037 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.049006    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-bundle" (OuterVolumeSpecName: "bundle") pod "2f404124-dc17-472b-9444-72b7cef2ce88" (UID: "2f404124-dc17-472b-9444-72b7cef2ce88"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:37:04.050497 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.050476    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f404124-dc17-472b-9444-72b7cef2ce88-kube-api-access-mgtvw" (OuterVolumeSpecName: "kube-api-access-mgtvw") pod "2f404124-dc17-472b-9444-72b7cef2ce88" (UID: "2f404124-dc17-472b-9444-72b7cef2ce88"). InnerVolumeSpecName "kube-api-access-mgtvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:37:04.054393 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.054372    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-util" (OuterVolumeSpecName: "util") pod "2f404124-dc17-472b-9444-72b7cef2ce88" (UID: "2f404124-dc17-472b-9444-72b7cef2ce88"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:37:04.149006 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.148946    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-util\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:37:04.149006 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.148968    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f404124-dc17-472b-9444-72b7cef2ce88-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:37:04.149006 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.148978    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgtvw\" (UniqueName: \"kubernetes.io/projected/2f404124-dc17-472b-9444-72b7cef2ce88-kube-api-access-mgtvw\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:37:04.626892 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.626861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:04.728212 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.728178    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:04.879459 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.879430    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48"
Jul 10 14:37:04.879608 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.879434    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmsk48" event={"ID":"2f404124-dc17-472b-9444-72b7cef2ce88","Type":"ContainerDied","Data":"2d63145615a14810cd6daec70e84ab2e545e912fe00bb837278b65f22d6066b0"}
Jul 10 14:37:04.879608 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:04.879549    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d63145615a14810cd6daec70e84ab2e545e912fe00bb837278b65f22d6066b0"
Jul 10 14:37:11.215929 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:11.215887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:11.320136 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:11.320105    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:12.029039 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.029007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:12.259664 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.259616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:12.369155 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.369108    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:12.407861 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.407837    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"]
Jul 10 14:37:12.408107 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.408093    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f404124-dc17-472b-9444-72b7cef2ce88" containerName="extract"
Jul 10 14:37:12.408107 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.408107    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f404124-dc17-472b-9444-72b7cef2ce88" containerName="extract"
Jul 10 14:37:12.408195 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.408121    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f404124-dc17-472b-9444-72b7cef2ce88" containerName="util"
Jul 10 14:37:12.408195 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.408126    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f404124-dc17-472b-9444-72b7cef2ce88" containerName="util"
Jul 10 14:37:12.408195 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.408134    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f404124-dc17-472b-9444-72b7cef2ce88" containerName="pull"
Jul 10 14:37:12.408195 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.408140    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f404124-dc17-472b-9444-72b7cef2ce88" containerName="pull"
Jul 10 14:37:12.408195 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.408188    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f404124-dc17-472b-9444-72b7cef2ce88" containerName="extract"
Jul 10 14:37:12.414271 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.414248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.420006 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.419981    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 14:37:12.420006 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.420006    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 14:37:12.420215 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.420158    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 14:37:12.420215 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.420161    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 14:37:12.421325 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.421307    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6fv7g\""
Jul 10 14:37:12.427300 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.427275    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"]
Jul 10 14:37:12.508930 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.508895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk4n7\" (UniqueName: \"kubernetes.io/projected/57cfab74-0237-4755-911e-f81e5c7d56a1-kube-api-access-sk4n7\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.509041 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.508940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57cfab74-0237-4755-911e-f81e5c7d56a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.509041 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.508962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57cfab74-0237-4755-911e-f81e5c7d56a1-manifests\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.509113 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.509048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57cfab74-0237-4755-911e-f81e5c7d56a1-tmp\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.509113 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.509080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57cfab74-0237-4755-911e-f81e5c7d56a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.599004 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.598977    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:12.609559 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.609539    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk4n7\" (UniqueName: \"kubernetes.io/projected/57cfab74-0237-4755-911e-f81e5c7d56a1-kube-api-access-sk4n7\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.609634 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.609570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57cfab74-0237-4755-911e-f81e5c7d56a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.609634 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.609592    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57cfab74-0237-4755-911e-f81e5c7d56a1-manifests\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.609634 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.609629    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57cfab74-0237-4755-911e-f81e5c7d56a1-tmp\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.609727 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.609661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57cfab74-0237-4755-911e-f81e5c7d56a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.610051 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.610020    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/57cfab74-0237-4755-911e-f81e5c7d56a1-manifests\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.612329 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.612303    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/57cfab74-0237-4755-911e-f81e5c7d56a1-webhook-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.612477 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.612458    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57cfab74-0237-4755-911e-f81e5c7d56a1-tmp\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.612570 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.612554    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/57cfab74-0237-4755-911e-f81e5c7d56a1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.618306 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.618285    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk4n7\" (UniqueName: \"kubernetes.io/projected/57cfab74-0237-4755-911e-f81e5c7d56a1-kube-api-access-sk4n7\") pod \"opendatahub-operator-controller-manager-547957cd78-6ncbf\" (UID: \"57cfab74-0237-4755-911e-f81e5c7d56a1\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.699379 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.699311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:12.724405 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.724386    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:12.800710 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.800681    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:12.855992 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.855969    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"]
Jul 10 14:37:12.858720 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:37:12.858696    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57cfab74_0237_4755_911e_f81e5c7d56a1.slice/crio-085543265bf5584ffd965800fe0cf5571014d48b53aae2118bfff1c803a65db0 WatchSource:0}: Error finding container 085543265bf5584ffd965800fe0cf5571014d48b53aae2118bfff1c803a65db0: Status 404 returned error can't find the container with id 085543265bf5584ffd965800fe0cf5571014d48b53aae2118bfff1c803a65db0
Jul 10 14:37:12.886626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.886597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:12.912096 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.912068    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf" event={"ID":"57cfab74-0237-4755-911e-f81e5c7d56a1","Type":"ContainerStarted","Data":"085543265bf5584ffd965800fe0cf5571014d48b53aae2118bfff1c803a65db0"}
Jul 10 14:37:12.957465 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:12.957406    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:13.107884 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:13.107857    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:13.210272 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:13.210169    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:13.420085 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:13.420061    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:13.521401 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:13.521307    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:16.933384 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:16.933352    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf" event={"ID":"57cfab74-0237-4755-911e-f81e5c7d56a1","Type":"ContainerStarted","Data":"f3e6ad02146cfc16042a66b2dcf8133d4d765daf4692e428ecb1e292aa88e891"}
Jul 10 14:37:17.939012 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:17.938971    2564 generic.go:356] "Generic (PLEG): container finished" podID="57cfab74-0237-4755-911e-f81e5c7d56a1" containerID="f3e6ad02146cfc16042a66b2dcf8133d4d765daf4692e428ecb1e292aa88e891" exitCode=0
Jul 10 14:37:17.939361 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:17.939038    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf" event={"ID":"57cfab74-0237-4755-911e-f81e5c7d56a1","Type":"ContainerDied","Data":"f3e6ad02146cfc16042a66b2dcf8133d4d765daf4692e428ecb1e292aa88e891"}
Jul 10 14:37:18.945591 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:18.945545    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf" event={"ID":"57cfab74-0237-4755-911e-f81e5c7d56a1","Type":"ContainerStarted","Data":"d9d2ec8b889540b1f9d89ed0fb9b18299b5ade214c2c0711669f30b650838298"}
Jul 10 14:37:18.945997 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:18.945637    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:18.968743 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:18.968693    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf" podStartSLOduration=2.317294961 podStartE2EDuration="6.968680117s" totalImagesPullingTime="3.571999954s" totalInitContainerRuntime="1.079385202s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:18.966530145 +0000 UTC m=+350.919420223" watchObservedRunningTime="2026-07-10 14:37:18.968680117 +0000 UTC m=+350.921570193"
Jul 10 14:37:23.343695 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:23.343653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:23.671682 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:23.671652    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:23.826077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:23.826038    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:25.041366 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:25.041328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:29.951925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:29.951895    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-6ncbf"
Jul 10 14:37:31.943250 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:31.943218    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:32.094517 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:32.094484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:37.878159 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:37.878121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:37.894713 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:37.894684    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"]
Jul 10 14:37:37.903154 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:37.903130    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:37.906168 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:37.906149    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 14:37:37.906257 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:37.906212    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 14:37:37.906496 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:37.906472    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 14:37:37.907283 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:37.907268    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 14:37:37.912046 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:37.912026    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"]
Jul 10 14:37:37.998624 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:37.998597    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:38.003587 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.003568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8743cee-ba5f-4fac-9f4a-9b2b831c1f14-tmp\") pod \"kube-auth-proxy-65d766598b-7f7tq\" (UID: \"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:38.003649 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.003608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22kh6\" (UniqueName: \"kubernetes.io/projected/a8743cee-ba5f-4fac-9f4a-9b2b831c1f14-kube-api-access-22kh6\") pod \"kube-auth-proxy-65d766598b-7f7tq\" (UID: \"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:38.003649 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.003638    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8743cee-ba5f-4fac-9f4a-9b2b831c1f14-tls-certs\") pod \"kube-auth-proxy-65d766598b-7f7tq\" (UID: \"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:38.030059 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.030027    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lzj5g"]
Jul 10 14:37:38.033275 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.033256    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:37:38.036027 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.036010    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 10 14:37:38.036116 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.036048    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tkzft\""
Jul 10 14:37:38.044261 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.044242    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lzj5g"]
Jul 10 14:37:38.104627 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.104596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8743cee-ba5f-4fac-9f4a-9b2b831c1f14-tmp\") pod \"kube-auth-proxy-65d766598b-7f7tq\" (UID: \"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:38.104803 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.104638    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22kh6\" (UniqueName: \"kubernetes.io/projected/a8743cee-ba5f-4fac-9f4a-9b2b831c1f14-kube-api-access-22kh6\") pod \"kube-auth-proxy-65d766598b-7f7tq\" (UID: \"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:38.104803 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.104660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8743cee-ba5f-4fac-9f4a-9b2b831c1f14-tls-certs\") pod \"kube-auth-proxy-65d766598b-7f7tq\" (UID: \"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:38.107100 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.107070    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8743cee-ba5f-4fac-9f4a-9b2b831c1f14-tmp\") pod \"kube-auth-proxy-65d766598b-7f7tq\" (UID: \"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:38.107335 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.107314    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8743cee-ba5f-4fac-9f4a-9b2b831c1f14-tls-certs\") pod \"kube-auth-proxy-65d766598b-7f7tq\" (UID: \"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:38.113410 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.113384    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:38.114207 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.114187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22kh6\" (UniqueName: \"kubernetes.io/projected/a8743cee-ba5f-4fac-9f4a-9b2b831c1f14-kube-api-access-22kh6\") pod \"kube-auth-proxy-65d766598b-7f7tq\" (UID: \"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:38.205940 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.205861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdc79147-acf9-4840-a97e-59cd7c790ce7-cert\") pod \"odh-model-controller-7998c67dc4-lzj5g\" (UID: \"fdc79147-acf9-4840-a97e-59cd7c790ce7\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:37:38.205940 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.205908    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cxcl\" (UniqueName: \"kubernetes.io/projected/fdc79147-acf9-4840-a97e-59cd7c790ce7-kube-api-access-7cxcl\") pod \"odh-model-controller-7998c67dc4-lzj5g\" (UID: \"fdc79147-acf9-4840-a97e-59cd7c790ce7\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:37:38.213173 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.213144    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"
Jul 10 14:37:38.214033 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.213992    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:38.307415 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.307381    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdc79147-acf9-4840-a97e-59cd7c790ce7-cert\") pod \"odh-model-controller-7998c67dc4-lzj5g\" (UID: \"fdc79147-acf9-4840-a97e-59cd7c790ce7\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:37:38.307579 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.307551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cxcl\" (UniqueName: \"kubernetes.io/projected/fdc79147-acf9-4840-a97e-59cd7c790ce7-kube-api-access-7cxcl\") pod \"odh-model-controller-7998c67dc4-lzj5g\" (UID: \"fdc79147-acf9-4840-a97e-59cd7c790ce7\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:37:38.307657 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:37:38.307577    2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 10 14:37:38.307708 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:37:38.307673    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdc79147-acf9-4840-a97e-59cd7c790ce7-cert podName:fdc79147-acf9-4840-a97e-59cd7c790ce7 nodeName:}" failed. No retries permitted until 2026-07-10 14:37:38.807647356 +0000 UTC m=+370.760537414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fdc79147-acf9-4840-a97e-59cd7c790ce7-cert") pod "odh-model-controller-7998c67dc4-lzj5g" (UID: "fdc79147-acf9-4840-a97e-59cd7c790ce7") : secret "odh-model-controller-webhook-cert" not found
Jul 10 14:37:38.319772 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.319710    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:38.321040 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.321019    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cxcl\" (UniqueName: \"kubernetes.io/projected/fdc79147-acf9-4840-a97e-59cd7c790ce7-kube-api-access-7cxcl\") pod \"odh-model-controller-7998c67dc4-lzj5g\" (UID: \"fdc79147-acf9-4840-a97e-59cd7c790ce7\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:37:38.344917 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.344896    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65d766598b-7f7tq"]
Jul 10 14:37:38.347255 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:37:38.347233    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8743cee_ba5f_4fac_9f4a_9b2b831c1f14.slice/crio-13c13d751337eb6a81c36563a7e1f2bd9aaef8c461c0ab40d54b839bf281d65f WatchSource:0}: Error finding container 13c13d751337eb6a81c36563a7e1f2bd9aaef8c461c0ab40d54b839bf281d65f: Status 404 returned error can't find the container with id 13c13d751337eb6a81c36563a7e1f2bd9aaef8c461c0ab40d54b839bf281d65f
Jul 10 14:37:38.588179 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.588091    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:38.813303 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.813273    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdc79147-acf9-4840-a97e-59cd7c790ce7-cert\") pod \"odh-model-controller-7998c67dc4-lzj5g\" (UID: \"fdc79147-acf9-4840-a97e-59cd7c790ce7\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:37:38.815647 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.815626    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fdc79147-acf9-4840-a97e-59cd7c790ce7-cert\") pod \"odh-model-controller-7998c67dc4-lzj5g\" (UID: \"fdc79147-acf9-4840-a97e-59cd7c790ce7\") " pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:37:38.847796 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.847723    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6dqdp"]
Jul 10 14:37:38.852274 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.852254    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp"
Jul 10 14:37:38.856907 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.856888    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 10 14:37:38.880109 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.880086    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6dqdp"]
Jul 10 14:37:38.936527 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.936499    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:38.943440 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:38.943418    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:37:39.015466 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.015438    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4gqs\" (UniqueName: \"kubernetes.io/projected/21b5624d-af8e-43a1-9c08-bff53f83a926-kube-api-access-r4gqs\") pod \"model-serving-api-54d89bd5fc-6dqdp\" (UID: \"21b5624d-af8e-43a1-9c08-bff53f83a926\") " pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp"
Jul 10 14:37:39.015610 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.015495    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b5624d-af8e-43a1-9c08-bff53f83a926-tls-certs\") pod \"model-serving-api-54d89bd5fc-6dqdp\" (UID: \"21b5624d-af8e-43a1-9c08-bff53f83a926\") " pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp"
Jul 10 14:37:39.033626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.033595    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:39.035708 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.035686    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq" event={"ID":"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14","Type":"ContainerStarted","Data":"13c13d751337eb6a81c36563a7e1f2bd9aaef8c461c0ab40d54b839bf281d65f"}
Jul 10 14:37:39.075112 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.075091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-lzj5g"]
Jul 10 14:37:39.077057 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:37:39.077025    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc79147_acf9_4840_a97e_59cd7c790ce7.slice/crio-cfe392024994e21909bff342b892368b5fe4fa25f9ab3c4e6fc00edf976fa1d8 WatchSource:0}: Error finding container cfe392024994e21909bff342b892368b5fe4fa25f9ab3c4e6fc00edf976fa1d8: Status 404 returned error can't find the container with id cfe392024994e21909bff342b892368b5fe4fa25f9ab3c4e6fc00edf976fa1d8
Jul 10 14:37:39.116286 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.116263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4gqs\" (UniqueName: \"kubernetes.io/projected/21b5624d-af8e-43a1-9c08-bff53f83a926-kube-api-access-r4gqs\") pod \"model-serving-api-54d89bd5fc-6dqdp\" (UID: \"21b5624d-af8e-43a1-9c08-bff53f83a926\") " pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp"
Jul 10 14:37:39.116384 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.116332    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b5624d-af8e-43a1-9c08-bff53f83a926-tls-certs\") pod \"model-serving-api-54d89bd5fc-6dqdp\" (UID: \"21b5624d-af8e-43a1-9c08-bff53f83a926\") " pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp"
Jul 10 14:37:39.118945 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.118915    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21b5624d-af8e-43a1-9c08-bff53f83a926-tls-certs\") pod \"model-serving-api-54d89bd5fc-6dqdp\" (UID: \"21b5624d-af8e-43a1-9c08-bff53f83a926\") " pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp"
Jul 10 14:37:39.125069 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.125041    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4gqs\" (UniqueName: \"kubernetes.io/projected/21b5624d-af8e-43a1-9c08-bff53f83a926-kube-api-access-r4gqs\") pod \"model-serving-api-54d89bd5fc-6dqdp\" (UID: \"21b5624d-af8e-43a1-9c08-bff53f83a926\") " pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp"
Jul 10 14:37:39.161851 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.161826    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp"
Jul 10 14:37:39.307770 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.307363    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6dqdp"]
Jul 10 14:37:39.310849 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:37:39.310816    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b5624d_af8e_43a1_9c08_bff53f83a926.slice/crio-e6fc08f576730ff5b138a1e0a4d6787a3ab5b774cd3a37cbd84efaccfeedcb8b WatchSource:0}: Error finding container e6fc08f576730ff5b138a1e0a4d6787a3ab5b774cd3a37cbd84efaccfeedcb8b: Status 404 returned error can't find the container with id e6fc08f576730ff5b138a1e0a4d6787a3ab5b774cd3a37cbd84efaccfeedcb8b
Jul 10 14:37:39.336065 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.336038    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"]
Jul 10 14:37:39.339591 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.339570    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.342362 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.342331    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 10 14:37:39.342454 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.342408    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 10 14:37:39.342454 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.342438    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 10 14:37:39.342564 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.342478    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vktqs\""
Jul 10 14:37:39.342613 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.342583    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 14:37:39.343419 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.343391    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:39.352587 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.352567    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"]
Jul 10 14:37:39.407169 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.407092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:39.519459 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.519425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4bml\" (UniqueName: \"kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-kube-api-access-w4bml\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.519601 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.519492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.519601 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.519533    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/40fcaa39-051d-4120-ab59-67a042b5d584-local-certs\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.519601 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.519559    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.519789 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.519606    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-istio-token\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.519789 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.519643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-cacerts\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.519789 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.519669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.621023 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.620994    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.621159 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.621027    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/40fcaa39-051d-4120-ab59-67a042b5d584-local-certs\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.621159 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.621046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.621274 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.621177    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-istio-token\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.621274 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.621220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-cacerts\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.621274 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.621242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.621414 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.621291    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4bml\" (UniqueName: \"kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-kube-api-access-w4bml\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.621921 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.621894    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.623690 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.623670    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.623809 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.623703    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.623959 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.623940    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/40fcaa39-051d-4120-ab59-67a042b5d584-local-certs\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.624051 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.624007    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-cacerts\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.630805 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.630778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-istio-token\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.631059 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.631040    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4bml\" (UniqueName: \"kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-kube-api-access-w4bml\") pod \"istiod-openshift-gateway-7574459656-vwpbw\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.651047 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.651024    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:39.794522 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:39.794489    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"]
Jul 10 14:37:39.797464 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:37:39.797430    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40fcaa39_051d_4120_ab59_67a042b5d584.slice/crio-edc08a4e923cf8f8e89bcfa6b528edbe2fc09abb32ce0545c7d18c8a985e0fca WatchSource:0}: Error finding container edc08a4e923cf8f8e89bcfa6b528edbe2fc09abb32ce0545c7d18c8a985e0fca: Status 404 returned error can't find the container with id edc08a4e923cf8f8e89bcfa6b528edbe2fc09abb32ce0545c7d18c8a985e0fca
Jul 10 14:37:40.041871 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:40.041792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp" event={"ID":"21b5624d-af8e-43a1-9c08-bff53f83a926","Type":"ContainerStarted","Data":"e6fc08f576730ff5b138a1e0a4d6787a3ab5b774cd3a37cbd84efaccfeedcb8b"}
Jul 10 14:37:40.043101 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:40.043071    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g" event={"ID":"fdc79147-acf9-4840-a97e-59cd7c790ce7","Type":"ContainerStarted","Data":"cfe392024994e21909bff342b892368b5fe4fa25f9ab3c4e6fc00edf976fa1d8"}
Jul 10 14:37:40.044379 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:40.044318    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw" event={"ID":"40fcaa39-051d-4120-ab59-67a042b5d584","Type":"ContainerStarted","Data":"edc08a4e923cf8f8e89bcfa6b528edbe2fc09abb32ce0545c7d18c8a985e0fca"}
Jul 10 14:37:40.352961 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:40.352868    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:44.464373 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:44.464342    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:37:44.464700 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:44.464404    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:37:44.978271 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:44.978232    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:45.082540 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.082501    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw" event={"ID":"40fcaa39-051d-4120-ab59-67a042b5d584","Type":"ContainerStarted","Data":"d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67"}
Jul 10 14:37:45.082795 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.082774    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:45.084379 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.084351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq" event={"ID":"a8743cee-ba5f-4fac-9f4a-9b2b831c1f14","Type":"ContainerStarted","Data":"02a40ba1d8b027e16a203b891d2413ec9443a49f663a2bc012bda158907791f5"}
Jul 10 14:37:45.084496 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.084409    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-vwpbw container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 10 14:37:45.084496 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.084452    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw" podUID="40fcaa39-051d-4120-ab59-67a042b5d584" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 10 14:37:45.085890 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.085864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp" event={"ID":"21b5624d-af8e-43a1-9c08-bff53f83a926","Type":"ContainerStarted","Data":"dab2edd6b2f73328c9657e677b14dedbb25d2c93c5884fd9d8f297e8a79dbc36"}
Jul 10 14:37:45.085994 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.085918    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp"
Jul 10 14:37:45.087150 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.087128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g" event={"ID":"fdc79147-acf9-4840-a97e-59cd7c790ce7","Type":"ContainerStarted","Data":"27be03479912a3ff9df613eb3d45c92d99964c1b9d46e6d2a8fdf3e8e990ed50"}
Jul 10 14:37:45.087224 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.087188    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:37:45.124142 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.124102    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw" podStartSLOduration=1.459911053 podStartE2EDuration="6.12408817s" totalImagesPullingTime="4.664177117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:45.122226361 +0000 UTC m=+377.075116437" watchObservedRunningTime="2026-07-10 14:37:45.12408817 +0000 UTC m=+377.076978248"
Jul 10 14:37:45.129302 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.129279    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:45.173096 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.173054    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65d766598b-7f7tq" podStartSLOduration=2.059981551 podStartE2EDuration="8.173038122s" totalImagesPullingTime="6.113056571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:45.171731375 +0000 UTC m=+377.124621453" watchObservedRunningTime="2026-07-10 14:37:45.173038122 +0000 UTC m=+377.125928240"
Jul 10 14:37:45.263091 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.262991    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp" podStartSLOduration=2.118132076 podStartE2EDuration="7.262969486s" totalImagesPullingTime="5.14483741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:45.235080973 +0000 UTC m=+377.187971048" watchObservedRunningTime="2026-07-10 14:37:45.262969486 +0000 UTC m=+377.215859563"
Jul 10 14:37:45.263288 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.263263    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g" podStartSLOduration=1.870851095 podStartE2EDuration="7.263255997s" totalImagesPullingTime="5.392404902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:45.261807941 +0000 UTC m=+377.214698041" watchObservedRunningTime="2026-07-10 14:37:45.263255997 +0000 UTC m=+377.216146099"
Jul 10 14:37:45.901479 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:45.901445    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:46.021226 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:46.021199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:46.092741 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:46.092714    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:46.117075 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:46.117042    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:46.216906 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:46.216820    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:46.364684 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:46.364650    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:48.382187 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.382150    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:48.470779 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.470733    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"]
Jul 10 14:37:48.478797 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.478746    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:48.481972 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.481949    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 10 14:37:48.481972 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.481963    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8qjnp\""
Jul 10 14:37:48.482903 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.482881    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"]
Jul 10 14:37:48.486534 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.486517    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:37:48.489029 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.489012    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 10 14:37:48.489857 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.489837    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rmd6d\""
Jul 10 14:37:48.490947 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.490928    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"]
Jul 10 14:37:48.498879 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.498851    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:48.500012 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.499989    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"]
Jul 10 14:37:48.500800 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.500783    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90712a9e-d8f7-4672-9f0c-cf135c490015-cert\") pod \"kserve-controller-manager-d6f4b65b8-8jjbr\" (UID: \"90712a9e-d8f7-4672-9f0c-cf135c490015\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:48.500869 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.500809    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c030ca8-d04a-4e18-91fc-70bd31711bfe-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t9xg8\" (UID: \"3c030ca8-d04a-4e18-91fc-70bd31711bfe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:37:48.500907 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.500884    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bnrm\" (UniqueName: \"kubernetes.io/projected/3c030ca8-d04a-4e18-91fc-70bd31711bfe-kube-api-access-2bnrm\") pod \"llmisvc-controller-manager-777c6bd7d5-t9xg8\" (UID: \"3c030ca8-d04a-4e18-91fc-70bd31711bfe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:37:48.500977 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.500963    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d4qc\" (UniqueName: \"kubernetes.io/projected/90712a9e-d8f7-4672-9f0c-cf135c490015-kube-api-access-8d4qc\") pod \"kserve-controller-manager-d6f4b65b8-8jjbr\" (UID: \"90712a9e-d8f7-4672-9f0c-cf135c490015\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:48.602108 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.602072    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90712a9e-d8f7-4672-9f0c-cf135c490015-cert\") pod \"kserve-controller-manager-d6f4b65b8-8jjbr\" (UID: \"90712a9e-d8f7-4672-9f0c-cf135c490015\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:48.602108 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.602107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c030ca8-d04a-4e18-91fc-70bd31711bfe-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t9xg8\" (UID: \"3c030ca8-d04a-4e18-91fc-70bd31711bfe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:37:48.602315 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.602178    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bnrm\" (UniqueName: \"kubernetes.io/projected/3c030ca8-d04a-4e18-91fc-70bd31711bfe-kube-api-access-2bnrm\") pod \"llmisvc-controller-manager-777c6bd7d5-t9xg8\" (UID: \"3c030ca8-d04a-4e18-91fc-70bd31711bfe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:37:48.602315 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:37:48.602228    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 10 14:37:48.602315 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.602232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d4qc\" (UniqueName: \"kubernetes.io/projected/90712a9e-d8f7-4672-9f0c-cf135c490015-kube-api-access-8d4qc\") pod \"kserve-controller-manager-d6f4b65b8-8jjbr\" (UID: \"90712a9e-d8f7-4672-9f0c-cf135c490015\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:48.602315 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:37:48.602289    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90712a9e-d8f7-4672-9f0c-cf135c490015-cert podName:90712a9e-d8f7-4672-9f0c-cf135c490015 nodeName:}" failed. No retries permitted until 2026-07-10 14:37:49.102268695 +0000 UTC m=+381.055158764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/90712a9e-d8f7-4672-9f0c-cf135c490015-cert") pod "kserve-controller-manager-d6f4b65b8-8jjbr" (UID: "90712a9e-d8f7-4672-9f0c-cf135c490015") : secret "kserve-webhook-server-cert" not found
Jul 10 14:37:48.602523 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:37:48.602349    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 10 14:37:48.602523 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:37:48.602423    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c030ca8-d04a-4e18-91fc-70bd31711bfe-cert podName:3c030ca8-d04a-4e18-91fc-70bd31711bfe nodeName:}" failed. No retries permitted until 2026-07-10 14:37:49.102405673 +0000 UTC m=+381.055295735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3c030ca8-d04a-4e18-91fc-70bd31711bfe-cert") pod "llmisvc-controller-manager-777c6bd7d5-t9xg8" (UID: "3c030ca8-d04a-4e18-91fc-70bd31711bfe") : secret "llmisvc-webhook-server-cert" not found
Jul 10 14:37:48.611462 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.611435    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d4qc\" (UniqueName: \"kubernetes.io/projected/90712a9e-d8f7-4672-9f0c-cf135c490015-kube-api-access-8d4qc\") pod \"kserve-controller-manager-d6f4b65b8-8jjbr\" (UID: \"90712a9e-d8f7-4672-9f0c-cf135c490015\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:48.612042 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.612024    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bnrm\" (UniqueName: \"kubernetes.io/projected/3c030ca8-d04a-4e18-91fc-70bd31711bfe-kube-api-access-2bnrm\") pod \"llmisvc-controller-manager-777c6bd7d5-t9xg8\" (UID: \"3c030ca8-d04a-4e18-91fc-70bd31711bfe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:37:48.721182 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:48.721090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:49.106274 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.106248    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90712a9e-d8f7-4672-9f0c-cf135c490015-cert\") pod \"kserve-controller-manager-d6f4b65b8-8jjbr\" (UID: \"90712a9e-d8f7-4672-9f0c-cf135c490015\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:49.106407 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.106279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c030ca8-d04a-4e18-91fc-70bd31711bfe-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t9xg8\" (UID: \"3c030ca8-d04a-4e18-91fc-70bd31711bfe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:37:49.106407 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:37:49.106384    2564 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 10 14:37:49.106479 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:37:49.106441    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90712a9e-d8f7-4672-9f0c-cf135c490015-cert podName:90712a9e-d8f7-4672-9f0c-cf135c490015 nodeName:}" failed. No retries permitted until 2026-07-10 14:37:50.106424712 +0000 UTC m=+382.059314767 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/90712a9e-d8f7-4672-9f0c-cf135c490015-cert") pod "kserve-controller-manager-d6f4b65b8-8jjbr" (UID: "90712a9e-d8f7-4672-9f0c-cf135c490015") : secret "kserve-webhook-server-cert" not found
Jul 10 14:37:49.108734 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.108712    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3c030ca8-d04a-4e18-91fc-70bd31711bfe-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-t9xg8\" (UID: \"3c030ca8-d04a-4e18-91fc-70bd31711bfe\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:37:49.261671 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.261634    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"]
Jul 10 14:37:49.261907 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.261871    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw" podUID="40fcaa39-051d-4120-ab59-67a042b5d584" containerName="discovery" containerID="cri-o://d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67" gracePeriod=30
Jul 10 14:37:49.400221 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.400188    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:37:49.430628 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.429911    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:49.500271 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.500247    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:49.509879 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.509853    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-kubeconfig\") pod \"40fcaa39-051d-4120-ab59-67a042b5d584\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") "
Jul 10 14:37:49.509988 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.509895    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-ca-configmap\") pod \"40fcaa39-051d-4120-ab59-67a042b5d584\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") "
Jul 10 14:37:49.509988 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.509931    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/40fcaa39-051d-4120-ab59-67a042b5d584-local-certs\") pod \"40fcaa39-051d-4120-ab59-67a042b5d584\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") "
Jul 10 14:37:49.510100 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.510037    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4bml\" (UniqueName: \"kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-kube-api-access-w4bml\") pod \"40fcaa39-051d-4120-ab59-67a042b5d584\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") "
Jul 10 14:37:49.510100 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.510094    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-dns-cert\") pod \"40fcaa39-051d-4120-ab59-67a042b5d584\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") "
Jul 10 14:37:49.510211 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.510121    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-istio-token\") pod \"40fcaa39-051d-4120-ab59-67a042b5d584\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") "
Jul 10 14:37:49.510211 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.510158    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-cacerts\") pod \"40fcaa39-051d-4120-ab59-67a042b5d584\" (UID: \"40fcaa39-051d-4120-ab59-67a042b5d584\") "
Jul 10 14:37:49.510692 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.510459    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "40fcaa39-051d-4120-ab59-67a042b5d584" (UID: "40fcaa39-051d-4120-ab59-67a042b5d584"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:37:49.513078 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.513044    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "40fcaa39-051d-4120-ab59-67a042b5d584" (UID: "40fcaa39-051d-4120-ab59-67a042b5d584"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:37:49.513199 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.513085    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "40fcaa39-051d-4120-ab59-67a042b5d584" (UID: "40fcaa39-051d-4120-ab59-67a042b5d584"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:37:49.513199 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.513110    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40fcaa39-051d-4120-ab59-67a042b5d584-local-certs" (OuterVolumeSpecName: "local-certs") pod "40fcaa39-051d-4120-ab59-67a042b5d584" (UID: "40fcaa39-051d-4120-ab59-67a042b5d584"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:37:49.513315 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.513270    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-istio-token" (OuterVolumeSpecName: "istio-token") pod "40fcaa39-051d-4120-ab59-67a042b5d584" (UID: "40fcaa39-051d-4120-ab59-67a042b5d584"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:37:49.513401 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.513380    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-kube-api-access-w4bml" (OuterVolumeSpecName: "kube-api-access-w4bml") pod "40fcaa39-051d-4120-ab59-67a042b5d584" (UID: "40fcaa39-051d-4120-ab59-67a042b5d584"). InnerVolumeSpecName "kube-api-access-w4bml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:37:49.514444 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.514422    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-cacerts" (OuterVolumeSpecName: "cacerts") pod "40fcaa39-051d-4120-ab59-67a042b5d584" (UID: "40fcaa39-051d-4120-ab59-67a042b5d584"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:37:49.560968 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.560876    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"]
Jul 10 14:37:49.563689 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:37:49.563655    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3c030ca8_d04a_4e18_91fc_70bd31711bfe.slice/crio-33e41ebf7dcbf1994160c9e2fd5fb4d88f199a4507c9cef5c3589e8e4ef1824b WatchSource:0}: Error finding container 33e41ebf7dcbf1994160c9e2fd5fb4d88f199a4507c9cef5c3589e8e4ef1824b: Status 404 returned error can't find the container with id 33e41ebf7dcbf1994160c9e2fd5fb4d88f199a4507c9cef5c3589e8e4ef1824b
Jul 10 14:37:49.611816 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.611782    2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-kubeconfig\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:37:49.611816 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.611813    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-ca-configmap\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:37:49.612008 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.611829    2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/40fcaa39-051d-4120-ab59-67a042b5d584-local-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:37:49.612008 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.611843    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4bml\" (UniqueName: \"kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-kube-api-access-w4bml\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:37:49.612008 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.611858    2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-istio-csr-dns-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:37:49.612008 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.611870    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40fcaa39-051d-4120-ab59-67a042b5d584-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:37:49.612008 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.611882    2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/40fcaa39-051d-4120-ab59-67a042b5d584-cacerts\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:37:49.711722 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.711640    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:49.810054 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:49.810007    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:37:50.110672 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.110641    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8" event={"ID":"3c030ca8-d04a-4e18-91fc-70bd31711bfe","Type":"ContainerStarted","Data":"33e41ebf7dcbf1994160c9e2fd5fb4d88f199a4507c9cef5c3589e8e4ef1824b"}
Jul 10 14:37:50.111795 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.111772    2564 generic.go:356] "Generic (PLEG): container finished" podID="40fcaa39-051d-4120-ab59-67a042b5d584" containerID="d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67" exitCode=0
Jul 10 14:37:50.111844 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.111827    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw" event={"ID":"40fcaa39-051d-4120-ab59-67a042b5d584","Type":"ContainerDied","Data":"d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67"}
Jul 10 14:37:50.111883 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.111845    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"
Jul 10 14:37:50.111883 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.111869    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw" event={"ID":"40fcaa39-051d-4120-ab59-67a042b5d584","Type":"ContainerDied","Data":"edc08a4e923cf8f8e89bcfa6b528edbe2fc09abb32ce0545c7d18c8a985e0fca"}
Jul 10 14:37:50.111944 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.111897    2564 scope.go:117] "RemoveContainer" containerID="d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67"
Jul 10 14:37:50.115635 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.115608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90712a9e-d8f7-4672-9f0c-cf135c490015-cert\") pod \"kserve-controller-manager-d6f4b65b8-8jjbr\" (UID: \"90712a9e-d8f7-4672-9f0c-cf135c490015\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:50.118232 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.118204    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90712a9e-d8f7-4672-9f0c-cf135c490015-cert\") pod \"kserve-controller-manager-d6f4b65b8-8jjbr\" (UID: \"90712a9e-d8f7-4672-9f0c-cf135c490015\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:50.120377 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.120357    2564 scope.go:117] "RemoveContainer" containerID="d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67"
Jul 10 14:37:50.120640 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:37:50.120620    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67\": container with ID starting with d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67 not found: ID does not exist" containerID="d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67"
Jul 10 14:37:50.120704 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.120652    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67"} err="failed to get container status \"d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67\": rpc error: code = NotFound desc = could not find container \"d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67\": container with ID starting with d83443dafb68750ba0e9460433d98cf7d0e181c5017e8fe0baac0a7312771c67 not found: ID does not exist"
Jul 10 14:37:50.142893 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.142870    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"]
Jul 10 14:37:50.149784 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.149734    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vwpbw"]
Jul 10 14:37:50.290290 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.290259    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:50.566938 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.566906    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40fcaa39-051d-4120-ab59-67a042b5d584" path="/var/lib/kubelet/pods/40fcaa39-051d-4120-ab59-67a042b5d584/volumes"
Jul 10 14:37:50.616426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:50.616397    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"]
Jul 10 14:37:50.726250 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:37:50.726219    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90712a9e_d8f7_4672_9f0c_cf135c490015.slice/crio-a75e88c9aa2c881506e4d4c733fa4cd385389c969fec0d81aa6730d3993e6fd9 WatchSource:0}: Error finding container a75e88c9aa2c881506e4d4c733fa4cd385389c969fec0d81aa6730d3993e6fd9: Status 404 returned error can't find the container with id a75e88c9aa2c881506e4d4c733fa4cd385389c969fec0d81aa6730d3993e6fd9
Jul 10 14:37:51.119814 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:51.119783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr" event={"ID":"90712a9e-d8f7-4672-9f0c-cf135c490015","Type":"ContainerStarted","Data":"a75e88c9aa2c881506e4d4c733fa4cd385389c969fec0d81aa6730d3993e6fd9"}
Jul 10 14:37:53.132080 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:53.132043    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8" event={"ID":"3c030ca8-d04a-4e18-91fc-70bd31711bfe","Type":"ContainerStarted","Data":"7d9bdab698f25767968ae2ecdc13522287e6fe9fe670095faa07d3283da557b6"}
Jul 10 14:37:53.132525 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:53.132202    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:37:53.150185 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:53.150129    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8" podStartSLOduration=1.914830853 podStartE2EDuration="5.150108296s" totalImagesPullingTime="3.235277443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:53.149046626 +0000 UTC m=+385.101936705" watchObservedRunningTime="2026-07-10 14:37:53.150108296 +0000 UTC m=+385.102998373"
Jul 10 14:37:54.138726 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:54.138689    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr" event={"ID":"90712a9e-d8f7-4672-9f0c-cf135c490015","Type":"ContainerStarted","Data":"d75978c5c3730a3ee70555989a12bd217600760c6307acdc3f553117b7d1c3f0"}
Jul 10 14:37:54.139210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:54.138950    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:37:54.160280 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:54.160231    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr" podStartSLOduration=3.339573171 podStartE2EDuration="6.160217388s" totalImagesPullingTime="2.820644217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:54.15853182 +0000 UTC m=+386.111421908" watchObservedRunningTime="2026-07-10 14:37:54.160217388 +0000 UTC m=+386.113107464"
Jul 10 14:37:56.096961 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:56.096930    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6dqdp"
Jul 10 14:37:56.136263 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:37:56.136235    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-lzj5g"
Jul 10 14:38:00.722524 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:00.722486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:38:00.779101 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:00.779073    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:38:11.708069 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:11.708039    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:38:11.808872 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:11.808841    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:38:24.140790 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:24.140743    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-t9xg8"
Jul 10 14:38:25.148176 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:25.148148    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-8jjbr"
Jul 10 14:38:33.517192 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.517151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:38:33.615990 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.615937    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:38:33.670630 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.670602    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b25js"]
Jul 10 14:38:33.670939 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.670927    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40fcaa39-051d-4120-ab59-67a042b5d584" containerName="discovery"
Jul 10 14:38:33.670986 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.670940    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="40fcaa39-051d-4120-ab59-67a042b5d584" containerName="discovery"
Jul 10 14:38:33.671020 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.671008    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="40fcaa39-051d-4120-ab59-67a042b5d584" containerName="discovery"
Jul 10 14:38:33.677502 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.677478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b25js"
Jul 10 14:38:33.680369 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.680342    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-st2z6\""
Jul 10 14:38:33.680513 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.680381    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 14:38:33.681568 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.681544    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 14:38:33.684475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.684447    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b25js"]
Jul 10 14:38:33.720370 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.720341    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:38:33.758892 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.758861    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jjp4\" (UniqueName: \"kubernetes.io/projected/974832be-4b25-4865-ade6-693a1efe6f06-kube-api-access-8jjp4\") pod \"kuadrant-operator-catalog-b25js\" (UID: \"974832be-4b25-4865-ade6-693a1efe6f06\") " pod="kuadrant-system/kuadrant-operator-catalog-b25js"
Jul 10 14:38:33.859334 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.859296    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jjp4\" (UniqueName: \"kubernetes.io/projected/974832be-4b25-4865-ade6-693a1efe6f06-kube-api-access-8jjp4\") pod \"kuadrant-operator-catalog-b25js\" (UID: \"974832be-4b25-4865-ade6-693a1efe6f06\") " pod="kuadrant-system/kuadrant-operator-catalog-b25js"
Jul 10 14:38:33.868737 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.868705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jjp4\" (UniqueName: \"kubernetes.io/projected/974832be-4b25-4865-ade6-693a1efe6f06-kube-api-access-8jjp4\") pod \"kuadrant-operator-catalog-b25js\" (UID: \"974832be-4b25-4865-ade6-693a1efe6f06\") " pod="kuadrant-system/kuadrant-operator-catalog-b25js"
Jul 10 14:38:33.989080 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:33.989038    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b25js"
Jul 10 14:38:34.029549 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.029517    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b25js"]
Jul 10 14:38:34.120829 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.120775    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b25js"]
Jul 10 14:38:34.123547 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:38:34.123520    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod974832be_4b25_4865_ade6_693a1efe6f06.slice/crio-3a926227bafae1578f99edbc704e68fc615ab6f0cd174f7ab585d9b3ca6a4a3a WatchSource:0}: Error finding container 3a926227bafae1578f99edbc704e68fc615ab6f0cd174f7ab585d9b3ca6a4a3a: Status 404 returned error can't find the container with id 3a926227bafae1578f99edbc704e68fc615ab6f0cd174f7ab585d9b3ca6a4a3a
Jul 10 14:38:34.242842 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.242820    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s4scn"]
Jul 10 14:38:34.247143 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.247128    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s4scn"
Jul 10 14:38:34.256121 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.256091    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s4scn"]
Jul 10 14:38:34.313822 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.313795    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b25js" event={"ID":"974832be-4b25-4865-ade6-693a1efe6f06","Type":"ContainerStarted","Data":"3a926227bafae1578f99edbc704e68fc615ab6f0cd174f7ab585d9b3ca6a4a3a"}
Jul 10 14:38:34.364262 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.364239    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6k7j\" (UniqueName: \"kubernetes.io/projected/5474441b-e5f9-4637-a6ec-9f0a677d52db-kube-api-access-j6k7j\") pod \"kuadrant-operator-catalog-s4scn\" (UID: \"5474441b-e5f9-4637-a6ec-9f0a677d52db\") " pod="kuadrant-system/kuadrant-operator-catalog-s4scn"
Jul 10 14:38:34.464833 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.464766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6k7j\" (UniqueName: \"kubernetes.io/projected/5474441b-e5f9-4637-a6ec-9f0a677d52db-kube-api-access-j6k7j\") pod \"kuadrant-operator-catalog-s4scn\" (UID: \"5474441b-e5f9-4637-a6ec-9f0a677d52db\") " pod="kuadrant-system/kuadrant-operator-catalog-s4scn"
Jul 10 14:38:34.476125 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.476094    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6k7j\" (UniqueName: \"kubernetes.io/projected/5474441b-e5f9-4637-a6ec-9f0a677d52db-kube-api-access-j6k7j\") pod \"kuadrant-operator-catalog-s4scn\" (UID: \"5474441b-e5f9-4637-a6ec-9f0a677d52db\") " pod="kuadrant-system/kuadrant-operator-catalog-s4scn"
Jul 10 14:38:34.557729 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.557695    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-s4scn"
Jul 10 14:38:34.686902 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:34.686880    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-s4scn"]
Jul 10 14:38:34.689436 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:38:34.689407    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5474441b_e5f9_4637_a6ec_9f0a677d52db.slice/crio-723b911b8fc0a68ea71cb76f1b7b78335173c96ead4e7d04db08dd32d3355ac3 WatchSource:0}: Error finding container 723b911b8fc0a68ea71cb76f1b7b78335173c96ead4e7d04db08dd32d3355ac3: Status 404 returned error can't find the container with id 723b911b8fc0a68ea71cb76f1b7b78335173c96ead4e7d04db08dd32d3355ac3
Jul 10 14:38:35.323401 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:35.323363    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s4scn" event={"ID":"5474441b-e5f9-4637-a6ec-9f0a677d52db","Type":"ContainerStarted","Data":"723b911b8fc0a68ea71cb76f1b7b78335173c96ead4e7d04db08dd32d3355ac3"}
Jul 10 14:38:36.330194 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:36.330156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b25js" event={"ID":"974832be-4b25-4865-ade6-693a1efe6f06","Type":"ContainerStarted","Data":"8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28"}
Jul 10 14:38:36.330643 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:36.330223    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-b25js" podUID="974832be-4b25-4865-ade6-693a1efe6f06" containerName="registry-server" containerID="cri-o://8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28" gracePeriod=2
Jul 10 14:38:36.331961 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:36.331937    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-s4scn" event={"ID":"5474441b-e5f9-4637-a6ec-9f0a677d52db","Type":"ContainerStarted","Data":"e8d0c8a4707a0533a5126e4864852f34bc79d01e99b0bfb6094ff9140c6eaee7"}
Jul 10 14:38:36.362384 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:36.362343    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-b25js" podStartSLOduration=1.245550766 podStartE2EDuration="3.362329528s" totalImagesPullingTime="2.116778762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:38:36.361783845 +0000 UTC m=+428.314673922" watchObservedRunningTime="2026-07-10 14:38:36.362329528 +0000 UTC m=+428.315219605"
Jul 10 14:38:36.379583 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:36.379539    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-s4scn" podStartSLOduration=0.832516841 podStartE2EDuration="2.379524122s" totalImagesPullingTime="1.547007281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:38:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:38:36.378575386 +0000 UTC m=+428.331465463" watchObservedRunningTime="2026-07-10 14:38:36.379524122 +0000 UTC m=+428.332414198"
Jul 10 14:38:36.572110 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:36.572088    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-b25js_974832be-4b25-4865-ade6-693a1efe6f06/registry-server/0.log"
Jul 10 14:38:36.574478 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:36.574462    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b25js"
Jul 10 14:38:36.682781 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:36.682736    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jjp4\" (UniqueName: \"kubernetes.io/projected/974832be-4b25-4865-ade6-693a1efe6f06-kube-api-access-8jjp4\") pod \"974832be-4b25-4865-ade6-693a1efe6f06\" (UID: \"974832be-4b25-4865-ade6-693a1efe6f06\") "
Jul 10 14:38:36.684940 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:36.684917    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/974832be-4b25-4865-ade6-693a1efe6f06-kube-api-access-8jjp4" (OuterVolumeSpecName: "kube-api-access-8jjp4") pod "974832be-4b25-4865-ade6-693a1efe6f06" (UID: "974832be-4b25-4865-ade6-693a1efe6f06"). InnerVolumeSpecName "kube-api-access-8jjp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:38:36.783275 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:36.783212    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jjp4\" (UniqueName: \"kubernetes.io/projected/974832be-4b25-4865-ade6-693a1efe6f06-kube-api-access-8jjp4\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:37.342838 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:37.342811    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-b25js_974832be-4b25-4865-ade6-693a1efe6f06/registry-server/0.log"
Jul 10 14:38:37.343202 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:37.342847    2564 generic.go:356] "Generic (PLEG): container finished" podID="974832be-4b25-4865-ade6-693a1efe6f06" containerID="8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28" exitCode=2
Jul 10 14:38:37.343202 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:37.342923    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b25js"
Jul 10 14:38:37.343202 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:37.342946    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b25js" event={"ID":"974832be-4b25-4865-ade6-693a1efe6f06","Type":"ContainerDied","Data":"8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28"}
Jul 10 14:38:37.343202 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:37.343020    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b25js" event={"ID":"974832be-4b25-4865-ade6-693a1efe6f06","Type":"ContainerDied","Data":"3a926227bafae1578f99edbc704e68fc615ab6f0cd174f7ab585d9b3ca6a4a3a"}
Jul 10 14:38:37.343202 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:37.343043    2564 scope.go:117] "RemoveContainer" containerID="8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28"
Jul 10 14:38:37.352036 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:37.352017    2564 scope.go:117] "RemoveContainer" containerID="8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28"
Jul 10 14:38:37.352361 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:38:37.352329    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28\": container with ID starting with 8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28 not found: ID does not exist" containerID="8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28"
Jul 10 14:38:37.352448 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:37.352423    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28"} err="failed to get container status \"8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28\": rpc error: code = NotFound desc = could not find container \"8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28\": container with ID starting with 8315bc2a57b8eb37d6d74597d686386a95f616e116d1a178f3738b5ce8d51f28 not found: ID does not exist"
Jul 10 14:38:37.364979 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:37.364949    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b25js"]
Jul 10 14:38:37.368303 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:37.368283    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b25js"]
Jul 10 14:38:38.564004 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:38.563968    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="974832be-4b25-4865-ade6-693a1efe6f06" path="/var/lib/kubelet/pods/974832be-4b25-4865-ade6-693a1efe6f06/volumes"
Jul 10 14:38:44.558192 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:44.558162    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-s4scn"
Jul 10 14:38:44.563977 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:44.563952    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-s4scn"
Jul 10 14:38:44.581503 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:44.581475    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-s4scn"
Jul 10 14:38:45.405804 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:45.405779    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-s4scn"
Jul 10 14:38:45.596219 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:45.596187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:38:49.451810 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.451705    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"]
Jul 10 14:38:49.452170 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.452042    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="974832be-4b25-4865-ade6-693a1efe6f06" containerName="registry-server"
Jul 10 14:38:49.452170 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.452053    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="974832be-4b25-4865-ade6-693a1efe6f06" containerName="registry-server"
Jul 10 14:38:49.452170 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.452130    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="974832be-4b25-4865-ade6-693a1efe6f06" containerName="registry-server"
Jul 10 14:38:49.455200 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.455184    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.457699 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.457678    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k26rn\""
Jul 10 14:38:49.463888 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.463862    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"]
Jul 10 14:38:49.582604 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.582571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.582792 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.582608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.582792 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.582689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9nzr\" (UniqueName: \"kubernetes.io/projected/8521f8c6-ed6b-400d-8673-244061bbd0e1-kube-api-access-k9nzr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.683538 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.683509    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9nzr\" (UniqueName: \"kubernetes.io/projected/8521f8c6-ed6b-400d-8673-244061bbd0e1-kube-api-access-k9nzr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.683695 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.683555    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.683695 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.683578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.683894 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.683876    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.683933 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.683918    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.693642 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.693619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9nzr\" (UniqueName: \"kubernetes.io/projected/8521f8c6-ed6b-400d-8673-244061bbd0e1-kube-api-access-k9nzr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.765278 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.765215    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:49.897332 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:49.897303    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"]
Jul 10 14:38:49.899699 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:38:49.899675    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8521f8c6_ed6b_400d_8673_244061bbd0e1.slice/crio-776957938dd34b90559c77cdca575f908a22c75bee3909a8e7079e6d8b6fa660 WatchSource:0}: Error finding container 776957938dd34b90559c77cdca575f908a22c75bee3909a8e7079e6d8b6fa660: Status 404 returned error can't find the container with id 776957938dd34b90559c77cdca575f908a22c75bee3909a8e7079e6d8b6fa660
Jul 10 14:38:50.052123 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.052053    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"]
Jul 10 14:38:50.055448 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.055426    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.064560 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.064539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"]
Jul 10 14:38:50.188462 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.188425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.188640 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.188481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.188640 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.188538    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpwps\" (UniqueName: \"kubernetes.io/projected/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-kube-api-access-tpwps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.289690 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.289654    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.289690 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.289691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpwps\" (UniqueName: \"kubernetes.io/projected/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-kube-api-access-tpwps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.289908 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.289735    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.290055 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.290036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.290111 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.290060    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.299230 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.299205    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpwps\" (UniqueName: \"kubernetes.io/projected/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-kube-api-access-tpwps\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.364954 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.364928    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:50.409570 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.409537    2564 generic.go:356] "Generic (PLEG): container finished" podID="8521f8c6-ed6b-400d-8673-244061bbd0e1" containerID="a098db89d0471ab57531577747b49ae5ee140e94b82665a30fe6c6b31f468774" exitCode=0
Jul 10 14:38:50.409705 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.409623    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8" event={"ID":"8521f8c6-ed6b-400d-8673-244061bbd0e1","Type":"ContainerDied","Data":"a098db89d0471ab57531577747b49ae5ee140e94b82665a30fe6c6b31f468774"}
Jul 10 14:38:50.409705 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.409681    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8" event={"ID":"8521f8c6-ed6b-400d-8673-244061bbd0e1","Type":"ContainerStarted","Data":"776957938dd34b90559c77cdca575f908a22c75bee3909a8e7079e6d8b6fa660"}
Jul 10 14:38:50.452928 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.452889    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"]
Jul 10 14:38:50.457502 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.457484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.465069 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.465040    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"]
Jul 10 14:38:50.526966 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.526945    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"]
Jul 10 14:38:50.528812 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:38:50.528787    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36da4f3_9ae5_45b3_9273_6e87ecd9d908.slice/crio-0c9336bbdfeebacc38a75cb2032f0f56e818fddb5ef2b8a44cc2557a0b3896cf WatchSource:0}: Error finding container 0c9336bbdfeebacc38a75cb2032f0f56e818fddb5ef2b8a44cc2557a0b3896cf: Status 404 returned error can't find the container with id 0c9336bbdfeebacc38a75cb2032f0f56e818fddb5ef2b8a44cc2557a0b3896cf
Jul 10 14:38:50.591644 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.591621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.591775 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.591657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.591872 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.591843    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8bpn\" (UniqueName: \"kubernetes.io/projected/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-kube-api-access-c8bpn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.693083 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.693051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8bpn\" (UniqueName: \"kubernetes.io/projected/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-kube-api-access-c8bpn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.693213 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.693088    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.693213 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.693116    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.693466 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.693447    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.693526 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.693453    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.703268 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.703244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8bpn\" (UniqueName: \"kubernetes.io/projected/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-kube-api-access-c8bpn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.768039 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.767993    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:50.863469 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.863439    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"]
Jul 10 14:38:50.868109 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.868078    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:50.883400 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.883372    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"]
Jul 10 14:38:50.904176 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.904152    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"]
Jul 10 14:38:50.905951 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:38:50.905925    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8f06e6_09d3_4e79_9db1_7f43b2ca4d61.slice/crio-03cb4e9e0fc7e89c45db21e16434507050511e2ef63ed27a3479247592c5246c WatchSource:0}: Error finding container 03cb4e9e0fc7e89c45db21e16434507050511e2ef63ed27a3479247592c5246c: Status 404 returned error can't find the container with id 03cb4e9e0fc7e89c45db21e16434507050511e2ef63ed27a3479247592c5246c
Jul 10 14:38:50.995665 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.995633    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:50.995819 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.995686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqmvd\" (UniqueName: \"kubernetes.io/projected/0d895ceb-92c8-48b4-8a19-cd410a882a97-kube-api-access-gqmvd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:50.995819 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:50.995804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:51.097012 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.096985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:51.097129 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.097030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqmvd\" (UniqueName: \"kubernetes.io/projected/0d895ceb-92c8-48b4-8a19-cd410a882a97-kube-api-access-gqmvd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:51.097129 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.097073    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:51.097327 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.097309    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:51.097372 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.097356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:51.106098 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.106074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqmvd\" (UniqueName: \"kubernetes.io/projected/0d895ceb-92c8-48b4-8a19-cd410a882a97-kube-api-access-gqmvd\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:51.181474 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.181398    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:51.347540 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.346436    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"]
Jul 10 14:38:51.366566 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:38:51.366540    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d895ceb_92c8_48b4_8a19_cd410a882a97.slice/crio-52041be5cf66aec1abe31f43e2da99b63b07643ab44ee1d4dbcd0d560c0f2231 WatchSource:0}: Error finding container 52041be5cf66aec1abe31f43e2da99b63b07643ab44ee1d4dbcd0d560c0f2231: Status 404 returned error can't find the container with id 52041be5cf66aec1abe31f43e2da99b63b07643ab44ee1d4dbcd0d560c0f2231
Jul 10 14:38:51.415205 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.415171    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4" event={"ID":"0d895ceb-92c8-48b4-8a19-cd410a882a97","Type":"ContainerStarted","Data":"52041be5cf66aec1abe31f43e2da99b63b07643ab44ee1d4dbcd0d560c0f2231"}
Jul 10 14:38:51.416629 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.416604    2564 generic.go:356] "Generic (PLEG): container finished" podID="e36da4f3-9ae5-45b3-9273-6e87ecd9d908" containerID="4bb0f75dbbb8ab89b41c6188d3decf99777c9f8047d851c862b6785f07ba281d" exitCode=0
Jul 10 14:38:51.416735 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.416696    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq" event={"ID":"e36da4f3-9ae5-45b3-9273-6e87ecd9d908","Type":"ContainerDied","Data":"4bb0f75dbbb8ab89b41c6188d3decf99777c9f8047d851c862b6785f07ba281d"}
Jul 10 14:38:51.416826 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.416741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq" event={"ID":"e36da4f3-9ae5-45b3-9273-6e87ecd9d908","Type":"ContainerStarted","Data":"0c9336bbdfeebacc38a75cb2032f0f56e818fddb5ef2b8a44cc2557a0b3896cf"}
Jul 10 14:38:51.418915 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.418890    2564 generic.go:356] "Generic (PLEG): container finished" podID="8521f8c6-ed6b-400d-8673-244061bbd0e1" containerID="9a8b58515453f0ec9ab949301b4d32e97a8b6d15ba80e9eb0c826b59109ddce6" exitCode=0
Jul 10 14:38:51.419009 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.418969    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8" event={"ID":"8521f8c6-ed6b-400d-8673-244061bbd0e1","Type":"ContainerDied","Data":"9a8b58515453f0ec9ab949301b4d32e97a8b6d15ba80e9eb0c826b59109ddce6"}
Jul 10 14:38:51.420873 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.420849    2564 generic.go:356] "Generic (PLEG): container finished" podID="6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" containerID="0f55c64f398a9f50dbd0f580033f9c1b01b8475c9742cb58f9227395b7378130" exitCode=0
Jul 10 14:38:51.420983 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.420897    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c" event={"ID":"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61","Type":"ContainerDied","Data":"0f55c64f398a9f50dbd0f580033f9c1b01b8475c9742cb58f9227395b7378130"}
Jul 10 14:38:51.420983 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:51.420928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c" event={"ID":"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61","Type":"ContainerStarted","Data":"03cb4e9e0fc7e89c45db21e16434507050511e2ef63ed27a3479247592c5246c"}
Jul 10 14:38:52.429695 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:52.429664    2564 generic.go:356] "Generic (PLEG): container finished" podID="0d895ceb-92c8-48b4-8a19-cd410a882a97" containerID="1f06b43bde35040e1f9965150e6d2f2458ef99356f0bf5b7c1fb58b247b50a7a" exitCode=0
Jul 10 14:38:52.430140 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:52.429768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4" event={"ID":"0d895ceb-92c8-48b4-8a19-cd410a882a97","Type":"ContainerDied","Data":"1f06b43bde35040e1f9965150e6d2f2458ef99356f0bf5b7c1fb58b247b50a7a"}
Jul 10 14:38:52.431709 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:52.431690    2564 generic.go:356] "Generic (PLEG): container finished" podID="e36da4f3-9ae5-45b3-9273-6e87ecd9d908" containerID="81e950304eb7c117f0038968fbcfb146ecd688202804c8edf93415840dc0585b" exitCode=0
Jul 10 14:38:52.431825 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:52.431766    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq" event={"ID":"e36da4f3-9ae5-45b3-9273-6e87ecd9d908","Type":"ContainerDied","Data":"81e950304eb7c117f0038968fbcfb146ecd688202804c8edf93415840dc0585b"}
Jul 10 14:38:52.433969 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:52.433951    2564 generic.go:356] "Generic (PLEG): container finished" podID="8521f8c6-ed6b-400d-8673-244061bbd0e1" containerID="9b1144efa26b5bf000892f4d7ca112f20fa2aa3b1c6a05084744f4dc47468f41" exitCode=0
Jul 10 14:38:52.434078 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:52.434034    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8" event={"ID":"8521f8c6-ed6b-400d-8673-244061bbd0e1","Type":"ContainerDied","Data":"9b1144efa26b5bf000892f4d7ca112f20fa2aa3b1c6a05084744f4dc47468f41"}
Jul 10 14:38:52.435799 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:52.435781    2564 generic.go:356] "Generic (PLEG): container finished" podID="6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" containerID="b417e70a411d881a91c0cede5f8ca788783867ea20d101abb342332c8fb7902c" exitCode=0
Jul 10 14:38:52.435886 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:52.435823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c" event={"ID":"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61","Type":"ContainerDied","Data":"b417e70a411d881a91c0cede5f8ca788783867ea20d101abb342332c8fb7902c"}
Jul 10 14:38:53.442352 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.442322    2564 generic.go:356] "Generic (PLEG): container finished" podID="6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" containerID="adb7ce138755c080827b3e9c215f92ae7bdef3531095ded713f876f24c25d893" exitCode=0
Jul 10 14:38:53.442771 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.442401    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c" event={"ID":"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61","Type":"ContainerDied","Data":"adb7ce138755c080827b3e9c215f92ae7bdef3531095ded713f876f24c25d893"}
Jul 10 14:38:53.444146 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.444127    2564 generic.go:356] "Generic (PLEG): container finished" podID="0d895ceb-92c8-48b4-8a19-cd410a882a97" containerID="fc170fe4cb47997a5ab5330ee9f62e76618dfd4d62fca74119f6c7eb4fe765cb" exitCode=0
Jul 10 14:38:53.444254 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.444212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4" event={"ID":"0d895ceb-92c8-48b4-8a19-cd410a882a97","Type":"ContainerDied","Data":"fc170fe4cb47997a5ab5330ee9f62e76618dfd4d62fca74119f6c7eb4fe765cb"}
Jul 10 14:38:53.446277 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.446253    2564 generic.go:356] "Generic (PLEG): container finished" podID="e36da4f3-9ae5-45b3-9273-6e87ecd9d908" containerID="04f0a8d955fac67d9fc1cea5839b32dc90e2d060b9c3e4e20392a2277eede52c" exitCode=0
Jul 10 14:38:53.446390 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.446337    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq" event={"ID":"e36da4f3-9ae5-45b3-9273-6e87ecd9d908","Type":"ContainerDied","Data":"04f0a8d955fac67d9fc1cea5839b32dc90e2d060b9c3e4e20392a2277eede52c"}
Jul 10 14:38:53.619613 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.619591    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:53.720534 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.720510    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9nzr\" (UniqueName: \"kubernetes.io/projected/8521f8c6-ed6b-400d-8673-244061bbd0e1-kube-api-access-k9nzr\") pod \"8521f8c6-ed6b-400d-8673-244061bbd0e1\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") "
Jul 10 14:38:53.720647 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.720557    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-util\") pod \"8521f8c6-ed6b-400d-8673-244061bbd0e1\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") "
Jul 10 14:38:53.720647 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.720597    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-bundle\") pod \"8521f8c6-ed6b-400d-8673-244061bbd0e1\" (UID: \"8521f8c6-ed6b-400d-8673-244061bbd0e1\") "
Jul 10 14:38:53.721192 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.721166    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-bundle" (OuterVolumeSpecName: "bundle") pod "8521f8c6-ed6b-400d-8673-244061bbd0e1" (UID: "8521f8c6-ed6b-400d-8673-244061bbd0e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:38:53.722646 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.722620    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8521f8c6-ed6b-400d-8673-244061bbd0e1-kube-api-access-k9nzr" (OuterVolumeSpecName: "kube-api-access-k9nzr") pod "8521f8c6-ed6b-400d-8673-244061bbd0e1" (UID: "8521f8c6-ed6b-400d-8673-244061bbd0e1"). InnerVolumeSpecName "kube-api-access-k9nzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:38:53.725523 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.725505    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-util" (OuterVolumeSpecName: "util") pod "8521f8c6-ed6b-400d-8673-244061bbd0e1" (UID: "8521f8c6-ed6b-400d-8673-244061bbd0e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:38:53.821999 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.821924    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-util\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:53.821999 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.821948    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8521f8c6-ed6b-400d-8673-244061bbd0e1-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:53.821999 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:53.821960    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9nzr\" (UniqueName: \"kubernetes.io/projected/8521f8c6-ed6b-400d-8673-244061bbd0e1-kube-api-access-k9nzr\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:54.452575 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.452548    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8"
Jul 10 14:38:54.453094 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.452574    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8" event={"ID":"8521f8c6-ed6b-400d-8673-244061bbd0e1","Type":"ContainerDied","Data":"776957938dd34b90559c77cdca575f908a22c75bee3909a8e7079e6d8b6fa660"}
Jul 10 14:38:54.453094 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.452631    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="776957938dd34b90559c77cdca575f908a22c75bee3909a8e7079e6d8b6fa660"
Jul 10 14:38:54.454823 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.454794    2564 generic.go:356] "Generic (PLEG): container finished" podID="0d895ceb-92c8-48b4-8a19-cd410a882a97" containerID="830cee3e8d3759b7316f2bac88fd0afa589e5477e618da14c3fa40c38f4e43bc" exitCode=0
Jul 10 14:38:54.454959 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.454823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4" event={"ID":"0d895ceb-92c8-48b4-8a19-cd410a882a97","Type":"ContainerDied","Data":"830cee3e8d3759b7316f2bac88fd0afa589e5477e618da14c3fa40c38f4e43bc"}
Jul 10 14:38:54.612631 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.612605    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:54.614664 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.614642    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:54.729849 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.729747    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-bundle\") pod \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") "
Jul 10 14:38:54.729849 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.729815    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpwps\" (UniqueName: \"kubernetes.io/projected/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-kube-api-access-tpwps\") pod \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") "
Jul 10 14:38:54.730055 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.729856    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-bundle\") pod \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") "
Jul 10 14:38:54.730055 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.729873    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-util\") pod \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\" (UID: \"e36da4f3-9ae5-45b3-9273-6e87ecd9d908\") "
Jul 10 14:38:54.730055 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.729906    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-util\") pod \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") "
Jul 10 14:38:54.730055 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.729956    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8bpn\" (UniqueName: \"kubernetes.io/projected/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-kube-api-access-c8bpn\") pod \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\" (UID: \"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61\") "
Jul 10 14:38:54.730438 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.730339    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-bundle" (OuterVolumeSpecName: "bundle") pod "6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" (UID: "6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:38:54.730438 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.730413    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-bundle" (OuterVolumeSpecName: "bundle") pod "e36da4f3-9ae5-45b3-9273-6e87ecd9d908" (UID: "e36da4f3-9ae5-45b3-9273-6e87ecd9d908"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:38:54.732327 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.732299    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-kube-api-access-c8bpn" (OuterVolumeSpecName: "kube-api-access-c8bpn") pod "6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" (UID: "6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61"). InnerVolumeSpecName "kube-api-access-c8bpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:38:54.732420 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.732335    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-kube-api-access-tpwps" (OuterVolumeSpecName: "kube-api-access-tpwps") pod "e36da4f3-9ae5-45b3-9273-6e87ecd9d908" (UID: "e36da4f3-9ae5-45b3-9273-6e87ecd9d908"). InnerVolumeSpecName "kube-api-access-tpwps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:38:54.735537 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.735514    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-util" (OuterVolumeSpecName: "util") pod "6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" (UID: "6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:38:54.737746 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.737718    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-util" (OuterVolumeSpecName: "util") pod "e36da4f3-9ae5-45b3-9273-6e87ecd9d908" (UID: "e36da4f3-9ae5-45b3-9273-6e87ecd9d908"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:38:54.831354 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.831324    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:54.831354 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.831348    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-util\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:54.831354 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.831357    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-util\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:54.831544 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.831364    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8bpn\" (UniqueName: \"kubernetes.io/projected/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-kube-api-access-c8bpn\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:54.831544 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.831375    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:54.831544 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:54.831385    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpwps\" (UniqueName: \"kubernetes.io/projected/e36da4f3-9ae5-45b3-9273-6e87ecd9d908-kube-api-access-tpwps\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:55.462222 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.462190    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c"
Jul 10 14:38:55.462222 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.462212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c" event={"ID":"6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61","Type":"ContainerDied","Data":"03cb4e9e0fc7e89c45db21e16434507050511e2ef63ed27a3479247592c5246c"}
Jul 10 14:38:55.462678 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.462267    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03cb4e9e0fc7e89c45db21e16434507050511e2ef63ed27a3479247592c5246c"
Jul 10 14:38:55.464173 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.464154    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq"
Jul 10 14:38:55.464277 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.464185    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq" event={"ID":"e36da4f3-9ae5-45b3-9273-6e87ecd9d908","Type":"ContainerDied","Data":"0c9336bbdfeebacc38a75cb2032f0f56e818fddb5ef2b8a44cc2557a0b3896cf"}
Jul 10 14:38:55.464277 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.464232    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c9336bbdfeebacc38a75cb2032f0f56e818fddb5ef2b8a44cc2557a0b3896cf"
Jul 10 14:38:55.592843 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.592823    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:55.737173 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.737091    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-util\") pod \"0d895ceb-92c8-48b4-8a19-cd410a882a97\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") "
Jul 10 14:38:55.737173 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.737152    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-bundle\") pod \"0d895ceb-92c8-48b4-8a19-cd410a882a97\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") "
Jul 10 14:38:55.737389 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.737178    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqmvd\" (UniqueName: \"kubernetes.io/projected/0d895ceb-92c8-48b4-8a19-cd410a882a97-kube-api-access-gqmvd\") pod \"0d895ceb-92c8-48b4-8a19-cd410a882a97\" (UID: \"0d895ceb-92c8-48b4-8a19-cd410a882a97\") "
Jul 10 14:38:55.737696 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.737672    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-bundle" (OuterVolumeSpecName: "bundle") pod "0d895ceb-92c8-48b4-8a19-cd410a882a97" (UID: "0d895ceb-92c8-48b4-8a19-cd410a882a97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:38:55.739363 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.739340    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d895ceb-92c8-48b4-8a19-cd410a882a97-kube-api-access-gqmvd" (OuterVolumeSpecName: "kube-api-access-gqmvd") pod "0d895ceb-92c8-48b4-8a19-cd410a882a97" (UID: "0d895ceb-92c8-48b4-8a19-cd410a882a97"). InnerVolumeSpecName "kube-api-access-gqmvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:38:55.742633 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.742594    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-util" (OuterVolumeSpecName: "util") pod "0d895ceb-92c8-48b4-8a19-cd410a882a97" (UID: "0d895ceb-92c8-48b4-8a19-cd410a882a97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:38:55.838066 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.838040    2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:55.838066 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.838061    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqmvd\" (UniqueName: \"kubernetes.io/projected/0d895ceb-92c8-48b4-8a19-cd410a882a97-kube-api-access-gqmvd\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:55.838066 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:55.838071    2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d895ceb-92c8-48b4-8a19-cd410a882a97-util\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:38:56.470121 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:56.470092    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4"
Jul 10 14:38:56.470461 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:56.470091    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4" event={"ID":"0d895ceb-92c8-48b4-8a19-cd410a882a97","Type":"ContainerDied","Data":"52041be5cf66aec1abe31f43e2da99b63b07643ab44ee1d4dbcd0d560c0f2231"}
Jul 10 14:38:56.470461 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:38:56.470214    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52041be5cf66aec1abe31f43e2da99b63b07643ab44ee1d4dbcd0d560c0f2231"
Jul 10 14:39:02.878363 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:02.878325    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:05.503153 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503120    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"]
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503420    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d895ceb-92c8-48b4-8a19-cd410a882a97" containerName="util"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503430    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d895ceb-92c8-48b4-8a19-cd410a882a97" containerName="util"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503441    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" containerName="util"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503446    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" containerName="util"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503453    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e36da4f3-9ae5-45b3-9273-6e87ecd9d908" containerName="util"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503458    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36da4f3-9ae5-45b3-9273-6e87ecd9d908" containerName="util"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503467    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8521f8c6-ed6b-400d-8673-244061bbd0e1" containerName="extract"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503474    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8521f8c6-ed6b-400d-8673-244061bbd0e1" containerName="extract"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503487    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" containerName="pull"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503494    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" containerName="pull"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503501    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e36da4f3-9ae5-45b3-9273-6e87ecd9d908" containerName="extract"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503506    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36da4f3-9ae5-45b3-9273-6e87ecd9d908" containerName="extract"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503515    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8521f8c6-ed6b-400d-8673-244061bbd0e1" containerName="util"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503519    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8521f8c6-ed6b-400d-8673-244061bbd0e1" containerName="util"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503525    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" containerName="extract"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503530    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" containerName="extract"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503538    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e36da4f3-9ae5-45b3-9273-6e87ecd9d908" containerName="pull"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503543    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36da4f3-9ae5-45b3-9273-6e87ecd9d908" containerName="pull"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503549    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8521f8c6-ed6b-400d-8673-244061bbd0e1" containerName="pull"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503553    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8521f8c6-ed6b-400d-8673-244061bbd0e1" containerName="pull"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503560    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d895ceb-92c8-48b4-8a19-cd410a882a97" containerName="extract"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503564    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d895ceb-92c8-48b4-8a19-cd410a882a97" containerName="extract"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503571    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d895ceb-92c8-48b4-8a19-cd410a882a97" containerName="pull"
Jul 10 14:39:05.503585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503575    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d895ceb-92c8-48b4-8a19-cd410a882a97" containerName="pull"
Jul 10 14:39:05.504292 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503622    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d895ceb-92c8-48b4-8a19-cd410a882a97" containerName="extract"
Jul 10 14:39:05.504292 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503631    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8521f8c6-ed6b-400d-8673-244061bbd0e1" containerName="extract"
Jul 10 14:39:05.504292 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503638    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e36da4f3-9ae5-45b3-9273-6e87ecd9d908" containerName="extract"
Jul 10 14:39:05.504292 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.503643    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61" containerName="extract"
Jul 10 14:39:05.507882 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.507865    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:05.510644 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.510623    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tpm6j\""
Jul 10 14:39:05.518835 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.518811    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"]
Jul 10 14:39:05.605776 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.605722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjkxm\" (UniqueName: \"kubernetes.io/projected/af1fbb79-78cd-4122-b835-935f4088d456-kube-api-access-kjkxm\") pod \"limitador-operator-controller-manager-859d7b78bd-qvr8q\" (UID: \"af1fbb79-78cd-4122-b835-935f4088d456\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:05.707090 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.707051    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjkxm\" (UniqueName: \"kubernetes.io/projected/af1fbb79-78cd-4122-b835-935f4088d456-kube-api-access-kjkxm\") pod \"limitador-operator-controller-manager-859d7b78bd-qvr8q\" (UID: \"af1fbb79-78cd-4122-b835-935f4088d456\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:05.719167 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.719136    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjkxm\" (UniqueName: \"kubernetes.io/projected/af1fbb79-78cd-4122-b835-935f4088d456-kube-api-access-kjkxm\") pod \"limitador-operator-controller-manager-859d7b78bd-qvr8q\" (UID: \"af1fbb79-78cd-4122-b835-935f4088d456\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:05.818478 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.818382    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:05.952091 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:05.952065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"]
Jul 10 14:39:05.953922 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:39:05.953895    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1fbb79_78cd_4122_b835_935f4088d456.slice/crio-0f14d759c1e632e1e92787ef9116ad020f5ce16d92823515583f59aef4af1ac2 WatchSource:0}: Error finding container 0f14d759c1e632e1e92787ef9116ad020f5ce16d92823515583f59aef4af1ac2: Status 404 returned error can't find the container with id 0f14d759c1e632e1e92787ef9116ad020f5ce16d92823515583f59aef4af1ac2
Jul 10 14:39:06.470085 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:06.470055    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:06.525822 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:06.525790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q" event={"ID":"af1fbb79-78cd-4122-b835-935f4088d456","Type":"ContainerStarted","Data":"0f14d759c1e632e1e92787ef9116ad020f5ce16d92823515583f59aef4af1ac2"}
Jul 10 14:39:06.643185 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:06.643153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:06.965979 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:06.965943    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cc8787fbf-lb9j6"]
Jul 10 14:39:06.969707 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:06.969688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:06.984930 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:06.984909    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc8787fbf-lb9j6"]
Jul 10 14:39:07.019426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.019144    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dbf00e7-26c9-4aff-a794-8b7886ce636d-console-oauth-config\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.019426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.019182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-console-config\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.019426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.019226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-service-ca\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.019426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.019257    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-oauth-serving-cert\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.019426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.019300    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dbf00e7-26c9-4aff-a794-8b7886ce636d-console-serving-cert\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.019426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.019377    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xkk4\" (UniqueName: \"kubernetes.io/projected/3dbf00e7-26c9-4aff-a794-8b7886ce636d-kube-api-access-7xkk4\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.019426 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.019404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-trusted-ca-bundle\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.045592 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.045558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:07.120049 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.120014    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dbf00e7-26c9-4aff-a794-8b7886ce636d-console-oauth-config\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.120049 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.120052    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-console-config\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.120263 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.120082    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-service-ca\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.120263 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.120106    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-oauth-serving-cert\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.120263 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.120148    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dbf00e7-26c9-4aff-a794-8b7886ce636d-console-serving-cert\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.120263 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.120243    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xkk4\" (UniqueName: \"kubernetes.io/projected/3dbf00e7-26c9-4aff-a794-8b7886ce636d-kube-api-access-7xkk4\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.120537 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.120297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-trusted-ca-bundle\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.120902 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.120877    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-console-config\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.121029 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.120900    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-service-ca\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.121029 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.120937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-oauth-serving-cert\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.121211 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.121187    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3dbf00e7-26c9-4aff-a794-8b7886ce636d-trusted-ca-bundle\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.122762 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.122732    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3dbf00e7-26c9-4aff-a794-8b7886ce636d-console-oauth-config\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.122914 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.122893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3dbf00e7-26c9-4aff-a794-8b7886ce636d-console-serving-cert\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.128643 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.128625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xkk4\" (UniqueName: \"kubernetes.io/projected/3dbf00e7-26c9-4aff-a794-8b7886ce636d-kube-api-access-7xkk4\") pod \"console-5cc8787fbf-lb9j6\" (UID: \"3dbf00e7-26c9-4aff-a794-8b7886ce636d\") " pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.147116 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.147089    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:07.246145 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.246054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:07.280263 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.280231    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:07.386680 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.386645    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:07.458577 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.458508    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cc8787fbf-lb9j6"]
Jul 10 14:39:07.459049 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:39:07.459018    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dbf00e7_26c9_4aff_a794_8b7886ce636d.slice/crio-56d688209bea189aa50634cd8a87f18fec27a1e7a23fec67959f0e68eebe6703 WatchSource:0}: Error finding container 56d688209bea189aa50634cd8a87f18fec27a1e7a23fec67959f0e68eebe6703: Status 404 returned error can't find the container with id 56d688209bea189aa50634cd8a87f18fec27a1e7a23fec67959f0e68eebe6703
Jul 10 14:39:07.531878 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.531844    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc8787fbf-lb9j6" event={"ID":"3dbf00e7-26c9-4aff-a794-8b7886ce636d","Type":"ContainerStarted","Data":"4c8ddf47cafc7a11d01fd1211c0b4464197e58722397da8119707fdf801695c6"}
Jul 10 14:39:07.532257 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.531915    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cc8787fbf-lb9j6" event={"ID":"3dbf00e7-26c9-4aff-a794-8b7886ce636d","Type":"ContainerStarted","Data":"56d688209bea189aa50634cd8a87f18fec27a1e7a23fec67959f0e68eebe6703"}
Jul 10 14:39:07.558704 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.558647    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cc8787fbf-lb9j6" podStartSLOduration=1.558625711 podStartE2EDuration="1.558625711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:39:07.557820264 +0000 UTC m=+459.510710361" watchObservedRunningTime="2026-07-10 14:39:07.558625711 +0000 UTC m=+459.511515791"
Jul 10 14:39:07.748292 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.748253    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:07.847880 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:07.847800    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:08.538391 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:08.538309    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q" event={"ID":"af1fbb79-78cd-4122-b835-935f4088d456","Type":"ContainerStarted","Data":"d98d4d7d9f8a9a699a15b64427c5c746aa2711d985fb02f7b5446cd3bb599f22"}
Jul 10 14:39:08.560547 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:08.560499    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q" podStartSLOduration=1.319555113 podStartE2EDuration="3.56048519s" totalImagesPullingTime="2.240930077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:39:08.55862819 +0000 UTC m=+460.511518268" watchObservedRunningTime="2026-07-10 14:39:08.56048519 +0000 UTC m=+460.513375335"
Jul 10 14:39:09.543570 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:09.543536    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:10.674448 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.674419    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"]
Jul 10 14:39:10.682599 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.682578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:10.685442 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.685423    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68hvr\""
Jul 10 14:39:10.689367 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.689112    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"]
Jul 10 14:39:10.747976 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.747940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e29567c-a592-4152-8022-b1e4edeecd1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" (UID: \"0e29567c-a592-4152-8022-b1e4edeecd1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:10.747976 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.747986    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9ccm\" (UniqueName: \"kubernetes.io/projected/0e29567c-a592-4152-8022-b1e4edeecd1f-kube-api-access-h9ccm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" (UID: \"0e29567c-a592-4152-8022-b1e4edeecd1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:10.849118 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.849090    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e29567c-a592-4152-8022-b1e4edeecd1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" (UID: \"0e29567c-a592-4152-8022-b1e4edeecd1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:10.849249 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.849126    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9ccm\" (UniqueName: \"kubernetes.io/projected/0e29567c-a592-4152-8022-b1e4edeecd1f-kube-api-access-h9ccm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" (UID: \"0e29567c-a592-4152-8022-b1e4edeecd1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:10.849528 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.849509    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e29567c-a592-4152-8022-b1e4edeecd1f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" (UID: \"0e29567c-a592-4152-8022-b1e4edeecd1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:10.859513 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.859487    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9ccm\" (UniqueName: \"kubernetes.io/projected/0e29567c-a592-4152-8022-b1e4edeecd1f-kube-api-access-h9ccm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" (UID: \"0e29567c-a592-4152-8022-b1e4edeecd1f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:10.993551 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:10.993490    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:11.066330 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:11.066283    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:11.137866 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:11.137835    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"]
Jul 10 14:39:11.141004 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:39:11.140973    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e29567c_a592_4152_8022_b1e4edeecd1f.slice/crio-6ea5d6de468d64c4c4577200b05b65501c509b05c9fa8fec6d344fa0d297e5c7 WatchSource:0}: Error finding container 6ea5d6de468d64c4c4577200b05b65501c509b05c9fa8fec6d344fa0d297e5c7: Status 404 returned error can't find the container with id 6ea5d6de468d64c4c4577200b05b65501c509b05c9fa8fec6d344fa0d297e5c7
Jul 10 14:39:11.532064 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:11.532037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:11.555163 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:11.555131    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj" event={"ID":"0e29567c-a592-4152-8022-b1e4edeecd1f","Type":"ContainerStarted","Data":"6ea5d6de468d64c4c4577200b05b65501c509b05c9fa8fec6d344fa0d297e5c7"}
Jul 10 14:39:12.917186 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:12.917148    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:13.266465 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:13.266374    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq"]
Jul 10 14:39:13.270228 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:13.270198    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq"
Jul 10 14:39:13.273601 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:13.273549    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wbhks\""
Jul 10 14:39:13.284265 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:13.284235    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq"]
Jul 10 14:39:13.369641 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:13.369611    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnqtt\" (UniqueName: \"kubernetes.io/projected/3bbba577-ab58-4f88-a821-dbc644c6371d-kube-api-access-vnqtt\") pod \"authorino-operator-75cc8d5cb7-xn6pq\" (UID: \"3bbba577-ab58-4f88-a821-dbc644c6371d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq"
Jul 10 14:39:13.470993 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:13.470959    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnqtt\" (UniqueName: \"kubernetes.io/projected/3bbba577-ab58-4f88-a821-dbc644c6371d-kube-api-access-vnqtt\") pod \"authorino-operator-75cc8d5cb7-xn6pq\" (UID: \"3bbba577-ab58-4f88-a821-dbc644c6371d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq"
Jul 10 14:39:13.482842 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:13.482818    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnqtt\" (UniqueName: \"kubernetes.io/projected/3bbba577-ab58-4f88-a821-dbc644c6371d-kube-api-access-vnqtt\") pod \"authorino-operator-75cc8d5cb7-xn6pq\" (UID: \"3bbba577-ab58-4f88-a821-dbc644c6371d\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq"
Jul 10 14:39:13.585643 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:13.585569    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq"
Jul 10 14:39:13.727293 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:13.727268    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq"]
Jul 10 14:39:13.729774 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:39:13.729731    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbba577_ab58_4f88_a821_dbc644c6371d.slice/crio-48af1619832bebae76afc474e120e35e2b86413345f5fba596cb1cc86bcae80e WatchSource:0}: Error finding container 48af1619832bebae76afc474e120e35e2b86413345f5fba596cb1cc86bcae80e: Status 404 returned error can't find the container with id 48af1619832bebae76afc474e120e35e2b86413345f5fba596cb1cc86bcae80e
Jul 10 14:39:14.476313 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:14.476277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:14.574108 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:14.574041    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq" event={"ID":"3bbba577-ab58-4f88-a821-dbc644c6371d","Type":"ContainerStarted","Data":"48af1619832bebae76afc474e120e35e2b86413345f5fba596cb1cc86bcae80e"}
Jul 10 14:39:15.338689 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:15.338654    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:17.280943 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.280910    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:17.281423 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.281002    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:17.287597 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.287560    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:17.312538 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.312507    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:17.591146 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.591113    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj" event={"ID":"0e29567c-a592-4152-8022-b1e4edeecd1f","Type":"ContainerStarted","Data":"0dd55fd23672c16a96eac5ff75f774a231550c2b3f50751b1663f1070dff64de"}
Jul 10 14:39:17.591312 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.591289    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:17.592671 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.592638    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq" event={"ID":"3bbba577-ab58-4f88-a821-dbc644c6371d","Type":"ContainerStarted","Data":"3c796a6bcdc427ff9e4a6d637d23612b4bbe66289c40eeb99ac66b9b29e3d26b"}
Jul 10 14:39:17.592795 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.592777    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq"
Jul 10 14:39:17.596343 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.596327    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cc8787fbf-lb9j6"
Jul 10 14:39:17.610288 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.610248    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj" podStartSLOduration=1.251366052 podStartE2EDuration="7.610235651s" totalImagesPullingTime="6.358869599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:39:17.609489122 +0000 UTC m=+469.562379198" watchObservedRunningTime="2026-07-10 14:39:17.610235651 +0000 UTC m=+469.563125802"
Jul 10 14:39:17.650029 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.649959    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq" podStartSLOduration=0.891721063 podStartE2EDuration="4.649937704s" totalImagesPullingTime="3.758216641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:39:17.647891045 +0000 UTC m=+469.600781152" watchObservedRunningTime="2026-07-10 14:39:17.649937704 +0000 UTC m=+469.602827783"
Jul 10 14:39:17.666940 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.666907    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5694b9578f-xw2pd"]
Jul 10 14:39:17.779347 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.779317    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:17.880326 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.880293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:17.981145 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:17.981116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:18.674054 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:18.674017    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:18.772738 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:18.772701    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:20.443504 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.443469    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"]
Jul 10 14:39:20.446850 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.446833    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.450698 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.450680    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-k26rn\""
Jul 10 14:39:20.450909 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.450895    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 10 14:39:20.451287 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.451269    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 10 14:39:20.458017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.457993    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"]
Jul 10 14:39:20.462436 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.462406    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:20.533663 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.533632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gd47v\" (UID: \"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.533825 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.533681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gd47v\" (UID: \"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.533825 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.533712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4dzl\" (UniqueName: \"kubernetes.io/projected/657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7-kube-api-access-x4dzl\") pod \"kuadrant-console-plugin-66b5774985-gd47v\" (UID: \"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.551638 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.551613    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:20.623537 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.623504    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:20.634604 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.634584    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gd47v\" (UID: \"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.634683 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.634636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gd47v\" (UID: \"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.634735 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.634694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4dzl\" (UniqueName: \"kubernetes.io/projected/657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7-kube-api-access-x4dzl\") pod \"kuadrant-console-plugin-66b5774985-gd47v\" (UID: \"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.635271 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.635249    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gd47v\" (UID: \"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.637255 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.637237    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gd47v\" (UID: \"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.644526 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.644502    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4dzl\" (UniqueName: \"kubernetes.io/projected/657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7-kube-api-access-x4dzl\") pod \"kuadrant-console-plugin-66b5774985-gd47v\" (UID: \"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.756057 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.755969    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"
Jul 10 14:39:20.894657 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:20.894625    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v"]
Jul 10 14:39:20.897434 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:39:20.897410    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod657f1e58_bf9e_48c0_8c61_9d6c8cc0dfd7.slice/crio-cb75079fd12ef5cd8872104fe2d856738679e0d0e20fd1808b78ea0666356608 WatchSource:0}: Error finding container cb75079fd12ef5cd8872104fe2d856738679e0d0e20fd1808b78ea0666356608: Status 404 returned error can't find the container with id cb75079fd12ef5cd8872104fe2d856738679e0d0e20fd1808b78ea0666356608
Jul 10 14:39:21.619695 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:21.619659    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v" event={"ID":"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7","Type":"ContainerStarted","Data":"cb75079fd12ef5cd8872104fe2d856738679e0d0e20fd1808b78ea0666356608"}
Jul 10 14:39:21.877845 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:21.877768    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:21.978540 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:21.978496    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:28.600201 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:28.600166    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:28.600632 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:28.600300    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-xn6pq"
Jul 10 14:39:30.320637 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.320603    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"]
Jul 10 14:39:30.327738 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.327712    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:30.337688 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.337626    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"]
Jul 10 14:39:30.430328 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.430279    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0bb026-784f-4634-b589-55e5e26f073b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" (UID: \"9e0bb026-784f-4634-b589-55e5e26f073b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:30.430496 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.430349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2hfn\" (UniqueName: \"kubernetes.io/projected/9e0bb026-784f-4634-b589-55e5e26f073b-kube-api-access-p2hfn\") pod \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" (UID: \"9e0bb026-784f-4634-b589-55e5e26f073b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:30.531359 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.531322    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2hfn\" (UniqueName: \"kubernetes.io/projected/9e0bb026-784f-4634-b589-55e5e26f073b-kube-api-access-p2hfn\") pod \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" (UID: \"9e0bb026-784f-4634-b589-55e5e26f073b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:30.531549 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.531450    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0bb026-784f-4634-b589-55e5e26f073b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" (UID: \"9e0bb026-784f-4634-b589-55e5e26f073b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:30.531847 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.531822    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0bb026-784f-4634-b589-55e5e26f073b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" (UID: \"9e0bb026-784f-4634-b589-55e5e26f073b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:30.542037 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.542012    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2hfn\" (UniqueName: \"kubernetes.io/projected/9e0bb026-784f-4634-b589-55e5e26f073b-kube-api-access-p2hfn\") pod \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" (UID: \"9e0bb026-784f-4634-b589-55e5e26f073b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:30.612225 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.612194    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"]
Jul 10 14:39:30.612536 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.612513    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:30.616893 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.616829    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"]
Jul 10 14:39:30.627859 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.627836    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"]
Jul 10 14:39:30.628071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.628037    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" containerName="manager" containerID="cri-o://0dd55fd23672c16a96eac5ff75f774a231550c2b3f50751b1663f1070dff64de" gracePeriod=2
Jul 10 14:39:30.644495 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.644454    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"]
Jul 10 14:39:30.661260 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:30.661200    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0e29567c-a592-4152-8022-b1e4edeecd1f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\": pods \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:30.665444 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.665418    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"]
Jul 10 14:39:30.665935 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.665917    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" containerName="manager"
Jul 10 14:39:30.666036 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.665939    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" containerName="manager"
Jul 10 14:39:30.666091 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.666062    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" containerName="manager"
Jul 10 14:39:30.669250 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.669231    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:39:30.676041 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.676019    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"]
Jul 10 14:39:30.676282 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.676253    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q" podUID="af1fbb79-78cd-4122-b835-935f4088d456" containerName="manager" containerID="cri-o://d98d4d7d9f8a9a699a15b64427c5c746aa2711d985fb02f7b5446cd3bb599f22" gracePeriod=2
Jul 10 14:39:30.693118 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.693092    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"]
Jul 10 14:39:30.697029 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.696978    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"]
Jul 10 14:39:30.697124 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.697085    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:30.705646 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.705621    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"]
Jul 10 14:39:30.713218 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.713194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"]
Jul 10 14:39:30.718355 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:30.718295    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:30.722960 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:30.722897    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:30.733145 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.733116    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrk78\" (UniqueName: \"kubernetes.io/projected/0c2004dd-3e30-4b31-8f41-d6a386181c38-kube-api-access-zrk78\") pod \"kuadrant-operator-controller-manager-55467d9f7-gdqz7\" (UID: \"0c2004dd-3e30-4b31-8f41-d6a386181c38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:39:30.733310 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.733241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c2004dd-3e30-4b31-8f41-d6a386181c38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gdqz7\" (UID: \"0c2004dd-3e30-4b31-8f41-d6a386181c38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:39:30.756269 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:30.756058    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvr8q\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="af1fbb79-78cd-4122-b835-935f4088d456" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:30.770903 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.770874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:30.834491 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.834437    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c2004dd-3e30-4b31-8f41-d6a386181c38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gdqz7\" (UID: \"0c2004dd-3e30-4b31-8f41-d6a386181c38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:39:30.834646 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.834542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsqdg\" (UID: \"b8987a26-8e47-42ab-b1c7-e05f68dbdd40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:30.834646 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.834590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrk78\" (UniqueName: \"kubernetes.io/projected/0c2004dd-3e30-4b31-8f41-d6a386181c38-kube-api-access-zrk78\") pod \"kuadrant-operator-controller-manager-55467d9f7-gdqz7\" (UID: \"0c2004dd-3e30-4b31-8f41-d6a386181c38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:39:30.834646 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.834620    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngnvx\" (UniqueName: \"kubernetes.io/projected/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-kube-api-access-ngnvx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsqdg\" (UID: \"b8987a26-8e47-42ab-b1c7-e05f68dbdd40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:30.834900 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.834870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c2004dd-3e30-4b31-8f41-d6a386181c38-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gdqz7\" (UID: \"0c2004dd-3e30-4b31-8f41-d6a386181c38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:39:30.844858 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.844828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrk78\" (UniqueName: \"kubernetes.io/projected/0c2004dd-3e30-4b31-8f41-d6a386181c38-kube-api-access-zrk78\") pod \"kuadrant-operator-controller-manager-55467d9f7-gdqz7\" (UID: \"0c2004dd-3e30-4b31-8f41-d6a386181c38\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:39:30.872331 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.872262    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:30.936149 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.936118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsqdg\" (UID: \"b8987a26-8e47-42ab-b1c7-e05f68dbdd40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:30.936318 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.936168    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngnvx\" (UniqueName: \"kubernetes.io/projected/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-kube-api-access-ngnvx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsqdg\" (UID: \"b8987a26-8e47-42ab-b1c7-e05f68dbdd40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:30.936538 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.936513    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsqdg\" (UID: \"b8987a26-8e47-42ab-b1c7-e05f68dbdd40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:30.947031 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.947004    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngnvx\" (UniqueName: \"kubernetes.io/projected/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-kube-api-access-ngnvx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jsqdg\" (UID: \"b8987a26-8e47-42ab-b1c7-e05f68dbdd40\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:30.970079 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:30.970052    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:31.045841 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:31.045796    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:39:31.055420 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:31.055396    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:33.167418 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:33.167364    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:33.269020 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:33.268976    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:37.475036 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:37.475002    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:37.580267 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:37.580203    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:39.697104 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:39.697068    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:39.759605 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:39.759575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:42.695107 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:42.695060    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5694b9578f-xw2pd" podUID="9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" containerName="console" containerID="cri-o://884e43dd8e10916ede4a4c98415b58bf831bfa164ffbb654475dd0e60656a963" gracePeriod=15
Jul 10 14:39:43.764673 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.764411    2564 generic.go:356] "Generic (PLEG): container finished" podID="0e29567c-a592-4152-8022-b1e4edeecd1f" containerID="0dd55fd23672c16a96eac5ff75f774a231550c2b3f50751b1663f1070dff64de" exitCode=0
Jul 10 14:39:43.767166 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.767135    2564 generic.go:356] "Generic (PLEG): container finished" podID="af1fbb79-78cd-4122-b835-935f4088d456" containerID="d98d4d7d9f8a9a699a15b64427c5c746aa2711d985fb02f7b5446cd3bb599f22" exitCode=0
Jul 10 14:39:43.769252 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.769155    2564 generic.go:356] "Generic (PLEG): container finished" podID="9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" containerID="884e43dd8e10916ede4a4c98415b58bf831bfa164ffbb654475dd0e60656a963" exitCode=0
Jul 10 14:39:43.769252 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.769188    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5694b9578f-xw2pd" event={"ID":"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8","Type":"ContainerDied","Data":"884e43dd8e10916ede4a4c98415b58bf831bfa164ffbb654475dd0e60656a963"}
Jul 10 14:39:43.793925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.793392    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:43.796045 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:43.795959    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:43.803645 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.803620    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:39:43.806515 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:43.806488    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:43.807290 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.807245    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:43.811042 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.811018    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"]
Jul 10 14:39:43.812990 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:39:43.812963    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8987a26_8e47_42ab_b1c7_e05f68dbdd40.slice/crio-059c0d7a06fc38a3bf201eaf3ddf1080dbee5f4a330a444b3a4c045c4053eb21 WatchSource:0}: Error finding container 059c0d7a06fc38a3bf201eaf3ddf1080dbee5f4a330a444b3a4c045c4053eb21: Status 404 returned error can't find the container with id 059c0d7a06fc38a3bf201eaf3ddf1080dbee5f4a330a444b3a4c045c4053eb21
Jul 10 14:39:43.828320 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:43.828126    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvr8q\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="af1fbb79-78cd-4122-b835-935f4088d456" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:43.830665 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:43.830628    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:43.831703 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.831671    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"]
Jul 10 14:39:43.832733 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:39:43.832708    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c2004dd_3e30_4b31_8f41_d6a386181c38.slice/crio-942426b70e128b8690b16cadbfadd9fa89d02b4373e2ed257371e311efa38198 WatchSource:0}: Error finding container 942426b70e128b8690b16cadbfadd9fa89d02b4373e2ed257371e311efa38198: Status 404 returned error can't find the container with id 942426b70e128b8690b16cadbfadd9fa89d02b4373e2ed257371e311efa38198
Jul 10 14:39:43.963591 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.963560    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9ccm\" (UniqueName: \"kubernetes.io/projected/0e29567c-a592-4152-8022-b1e4edeecd1f-kube-api-access-h9ccm\") pod \"0e29567c-a592-4152-8022-b1e4edeecd1f\" (UID: \"0e29567c-a592-4152-8022-b1e4edeecd1f\") "
Jul 10 14:39:43.963785 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.963609    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-oauth-serving-cert\") pod \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") "
Jul 10 14:39:43.963785 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.963627    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-oauth-config\") pod \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") "
Jul 10 14:39:43.963785 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.963648    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-trusted-ca-bundle\") pod \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") "
Jul 10 14:39:43.963785 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.963680    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e29567c-a592-4152-8022-b1e4edeecd1f-extensions-socket-volume\") pod \"0e29567c-a592-4152-8022-b1e4edeecd1f\" (UID: \"0e29567c-a592-4152-8022-b1e4edeecd1f\") "
Jul 10 14:39:43.963785 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.963709    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-service-ca\") pod \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") "
Jul 10 14:39:43.963785 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.963788    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-config\") pod \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") "
Jul 10 14:39:43.964123 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.963974    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" (UID: "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:39:43.964123 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.964044    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjkxm\" (UniqueName: \"kubernetes.io/projected/af1fbb79-78cd-4122-b835-935f4088d456-kube-api-access-kjkxm\") pod \"af1fbb79-78cd-4122-b835-935f4088d456\" (UID: \"af1fbb79-78cd-4122-b835-935f4088d456\") "
Jul 10 14:39:43.964123 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.964091    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-serving-cert\") pod \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") "
Jul 10 14:39:43.964123 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.964117    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49r6p\" (UniqueName: \"kubernetes.io/projected/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-kube-api-access-49r6p\") pod \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\" (UID: \"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8\") "
Jul 10 14:39:43.964470 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.964108    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e29567c-a592-4152-8022-b1e4edeecd1f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0e29567c-a592-4152-8022-b1e4edeecd1f" (UID: "0e29567c-a592-4152-8022-b1e4edeecd1f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:39:43.964470 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.964138    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-config" (OuterVolumeSpecName: "console-config") pod "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" (UID: "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:39:43.964470 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.964257    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" (UID: "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:39:43.964470 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.964439    2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-oauth-serving-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:43.964931 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.964768    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-service-ca" (OuterVolumeSpecName: "service-ca") pod "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" (UID: "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:39:43.966237 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.966213    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" (UID: "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:39:43.966496 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.966467    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e29567c-a592-4152-8022-b1e4edeecd1f-kube-api-access-h9ccm" (OuterVolumeSpecName: "kube-api-access-h9ccm") pod "0e29567c-a592-4152-8022-b1e4edeecd1f" (UID: "0e29567c-a592-4152-8022-b1e4edeecd1f"). InnerVolumeSpecName "kube-api-access-h9ccm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:39:43.966604 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.966526    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af1fbb79-78cd-4122-b835-935f4088d456-kube-api-access-kjkxm" (OuterVolumeSpecName: "kube-api-access-kjkxm") pod "af1fbb79-78cd-4122-b835-935f4088d456" (UID: "af1fbb79-78cd-4122-b835-935f4088d456"). InnerVolumeSpecName "kube-api-access-kjkxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:39:43.966604 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.966552    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" (UID: "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:39:43.966686 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:43.966645    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-kube-api-access-49r6p" (OuterVolumeSpecName: "kube-api-access-49r6p") pod "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" (UID: "9cc61cf5-a22c-43b3-8837-49b75bb1c0a8"). InnerVolumeSpecName "kube-api-access-49r6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:39:44.065022 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.064995    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjkxm\" (UniqueName: \"kubernetes.io/projected/af1fbb79-78cd-4122-b835-935f4088d456-kube-api-access-kjkxm\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:44.065022 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.065020    2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-serving-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:44.065022 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.065029    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49r6p\" (UniqueName: \"kubernetes.io/projected/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-kube-api-access-49r6p\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:44.065205 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.065038    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9ccm\" (UniqueName: \"kubernetes.io/projected/0e29567c-a592-4152-8022-b1e4edeecd1f-kube-api-access-h9ccm\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:44.065205 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.065047    2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-oauth-config\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:44.065205 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.065055    2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-trusted-ca-bundle\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:44.065205 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.065063    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e29567c-a592-4152-8022-b1e4edeecd1f-extensions-socket-volume\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:44.065205 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.065071    2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:44.065205 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.065079    2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8-console-config\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:44.565127 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.565094    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" path="/var/lib/kubelet/pods/0e29567c-a592-4152-8022-b1e4edeecd1f/volumes"
Jul 10 14:39:44.565569 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.565551    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af1fbb79-78cd-4122-b835-935f4088d456" path="/var/lib/kubelet/pods/af1fbb79-78cd-4122-b835-935f4088d456/volumes"
Jul 10 14:39:44.776193 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.776159    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg" event={"ID":"b8987a26-8e47-42ab-b1c7-e05f68dbdd40","Type":"ContainerStarted","Data":"33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7"}
Jul 10 14:39:44.776642 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.776216    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg" event={"ID":"b8987a26-8e47-42ab-b1c7-e05f68dbdd40","Type":"ContainerStarted","Data":"059c0d7a06fc38a3bf201eaf3ddf1080dbee5f4a330a444b3a4c045c4053eb21"}
Jul 10 14:39:44.776642 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.776262    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:44.777473 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.777454    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:44.777599 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.777458    2564 scope.go:117] "RemoveContainer" containerID="d98d4d7d9f8a9a699a15b64427c5c746aa2711d985fb02f7b5446cd3bb599f22"
Jul 10 14:39:44.778963 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.778944    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5694b9578f-xw2pd"
Jul 10 14:39:44.778963 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.778955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5694b9578f-xw2pd" event={"ID":"9cc61cf5-a22c-43b3-8837-49b75bb1c0a8","Type":"ContainerDied","Data":"0027b22ecf223a9a3fb82496af089f855b72986282cffce1a11d7ab5cfdaedb4"}
Jul 10 14:39:44.780715 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.780690    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:44.782844 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.782815    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v" event={"ID":"657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7","Type":"ContainerStarted","Data":"bcce76b7818351d7ec0f87aa1cf8960e3dfcef27041bbcd9fb6fb08c858bcfa4"}
Jul 10 14:39:44.784799 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.784779    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7" event={"ID":"0c2004dd-3e30-4b31-8f41-d6a386181c38","Type":"ContainerStarted","Data":"3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743"}
Jul 10 14:39:44.784878 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.784817    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7" event={"ID":"0c2004dd-3e30-4b31-8f41-d6a386181c38","Type":"ContainerStarted","Data":"942426b70e128b8690b16cadbfadd9fa89d02b4373e2ed257371e311efa38198"}
Jul 10 14:39:44.784927 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.784881    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:39:44.787664 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.787648    2564 scope.go:117] "RemoveContainer" containerID="884e43dd8e10916ede4a4c98415b58bf831bfa164ffbb654475dd0e60656a963"
Jul 10 14:39:44.795026 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.795010    2564 scope.go:117] "RemoveContainer" containerID="0dd55fd23672c16a96eac5ff75f774a231550c2b3f50751b1663f1070dff64de"
Jul 10 14:39:44.800539 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.800493    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg" podStartSLOduration=14.800480334 podStartE2EDuration="14.800480334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:39:44.797375267 +0000 UTC m=+496.750265347" watchObservedRunningTime="2026-07-10 14:39:44.800480334 +0000 UTC m=+496.753370405"
Jul 10 14:39:44.815186 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.815140    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5694b9578f-xw2pd"]
Jul 10 14:39:44.819424 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.819404    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5694b9578f-xw2pd"]
Jul 10 14:39:44.838917 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:44.838887    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvr8q\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="af1fbb79-78cd-4122-b835-935f4088d456" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvr8q"
Jul 10 14:39:44.839340 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.839305    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gd47v" podStartSLOduration=2.016857127 podStartE2EDuration="24.839293882s" totalImagesPullingTime="22.822436755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:39:44.836370565 +0000 UTC m=+496.789260644" watchObservedRunningTime="2026-07-10 14:39:44.839293882 +0000 UTC m=+496.792183959"
Jul 10 14:39:44.860301 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:44.860245    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7" podStartSLOduration=14.860227595 podStartE2EDuration="14.860227595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:39:44.858929223 +0000 UTC m=+496.811819301" watchObservedRunningTime="2026-07-10 14:39:44.860227595 +0000 UTC m=+496.813117672"
Jul 10 14:39:44.862423 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:44.862402    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5pnhj\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="0e29567c-a592-4152-8022-b1e4edeecd1f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5pnhj"
Jul 10 14:39:46.126264 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:46.126230    2564 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-vvrw4_kuadrant-system_9e0bb026-784f-4634-b589-55e5e26f073b_0(c02e2531dc13cb6881c8663c1d2d76a0d516648eef3e3e16e31087845dfe5dcd): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-vvrw4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 10 14:39:46.126529 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:46.126295    2564 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-vvrw4_kuadrant-system_9e0bb026-784f-4634-b589-55e5e26f073b_0(c02e2531dc13cb6881c8663c1d2d76a0d516648eef3e3e16e31087845dfe5dcd): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-vvrw4 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:46.563682 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:46.563605    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" path="/var/lib/kubelet/pods/9cc61cf5-a22c-43b3-8837-49b75bb1c0a8/volumes"
Jul 10 14:39:46.797094 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:46.797066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:46.799554 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:46.799522    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="9e0bb026-784f-4634-b589-55e5e26f073b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:46.809395 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:46.809369    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:46.812070 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:46.812047    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="9e0bb026-784f-4634-b589-55e5e26f073b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:46.988867 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:46.988836    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0bb026-784f-4634-b589-55e5e26f073b-extensions-socket-volume\") pod \"9e0bb026-784f-4634-b589-55e5e26f073b\" (UID: \"9e0bb026-784f-4634-b589-55e5e26f073b\") "
Jul 10 14:39:46.989035 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:46.988922    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2hfn\" (UniqueName: \"kubernetes.io/projected/9e0bb026-784f-4634-b589-55e5e26f073b-kube-api-access-p2hfn\") pod \"9e0bb026-784f-4634-b589-55e5e26f073b\" (UID: \"9e0bb026-784f-4634-b589-55e5e26f073b\") "
Jul 10 14:39:46.989121 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:46.989094    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e0bb026-784f-4634-b589-55e5e26f073b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9e0bb026-784f-4634-b589-55e5e26f073b" (UID: "9e0bb026-784f-4634-b589-55e5e26f073b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:39:46.989206 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:46.989189    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e0bb026-784f-4634-b589-55e5e26f073b-extensions-socket-volume\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:46.991129 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:46.991108    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0bb026-784f-4634-b589-55e5e26f073b-kube-api-access-p2hfn" (OuterVolumeSpecName: "kube-api-access-p2hfn") pod "9e0bb026-784f-4634-b589-55e5e26f073b" (UID: "9e0bb026-784f-4634-b589-55e5e26f073b"). InnerVolumeSpecName "kube-api-access-p2hfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:39:47.089930 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:47.089905    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2hfn\" (UniqueName: \"kubernetes.io/projected/9e0bb026-784f-4634-b589-55e5e26f073b-kube-api-access-p2hfn\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:47.802515 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:47.802483    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:47.805123 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:47.805094    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="9e0bb026-784f-4634-b589-55e5e26f073b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:47.810472 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:47.810446    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="9e0bb026-784f-4634-b589-55e5e26f073b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:48.430061 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:48.430026    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:48.539464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:48.539421    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:48.563386 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:48.563354    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-vvrw4\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="9e0bb026-784f-4634-b589-55e5e26f073b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-vvrw4"
Jul 10 14:39:48.564531 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:48.564511    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e0bb026-784f-4634-b589-55e5e26f073b" path="/var/lib/kubelet/pods/9e0bb026-784f-4634-b589-55e5e26f073b/volumes"
Jul 10 14:39:50.902881 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:50.902848    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:51.001156 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:51.001124    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:55.238595 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:55.238553    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:55.339887 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:55.339854    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:55.794850 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:55.794821    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:55.795018 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:55.794951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:39:55.880819 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:55.880791    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"]
Jul 10 14:39:55.880976 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:55.880958    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg" podUID="b8987a26-8e47-42ab-b1c7-e05f68dbdd40" containerName="manager" containerID="cri-o://33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7" gracePeriod=10
Jul 10 14:39:56.131912 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.131892    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:56.160286 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.160262    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngnvx\" (UniqueName: \"kubernetes.io/projected/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-kube-api-access-ngnvx\") pod \"b8987a26-8e47-42ab-b1c7-e05f68dbdd40\" (UID: \"b8987a26-8e47-42ab-b1c7-e05f68dbdd40\") "
Jul 10 14:39:56.160386 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.160303    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-extensions-socket-volume\") pod \"b8987a26-8e47-42ab-b1c7-e05f68dbdd40\" (UID: \"b8987a26-8e47-42ab-b1c7-e05f68dbdd40\") "
Jul 10 14:39:56.160704 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.160677    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b8987a26-8e47-42ab-b1c7-e05f68dbdd40" (UID: "b8987a26-8e47-42ab-b1c7-e05f68dbdd40"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:39:56.162534 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.162510    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-kube-api-access-ngnvx" (OuterVolumeSpecName: "kube-api-access-ngnvx") pod "b8987a26-8e47-42ab-b1c7-e05f68dbdd40" (UID: "b8987a26-8e47-42ab-b1c7-e05f68dbdd40"). InnerVolumeSpecName "kube-api-access-ngnvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:39:56.170136 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.170115    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"]
Jul 10 14:39:56.170434 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.170423    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" containerName="console"
Jul 10 14:39:56.170475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.170436    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" containerName="console"
Jul 10 14:39:56.170475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.170443    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af1fbb79-78cd-4122-b835-935f4088d456" containerName="manager"
Jul 10 14:39:56.170475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.170449    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="af1fbb79-78cd-4122-b835-935f4088d456" containerName="manager"
Jul 10 14:39:56.170475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.170466    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8987a26-8e47-42ab-b1c7-e05f68dbdd40" containerName="manager"
Jul 10 14:39:56.170475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.170471    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8987a26-8e47-42ab-b1c7-e05f68dbdd40" containerName="manager"
Jul 10 14:39:56.170626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.170527    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cc61cf5-a22c-43b3-8837-49b75bb1c0a8" containerName="console"
Jul 10 14:39:56.170626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.170537    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8987a26-8e47-42ab-b1c7-e05f68dbdd40" containerName="manager"
Jul 10 14:39:56.170626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.170543    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="af1fbb79-78cd-4122-b835-935f4088d456" containerName="manager"
Jul 10 14:39:56.172503 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.172487    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:39:56.187234 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.187212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"]
Jul 10 14:39:56.261425 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.261390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gtst\" (UniqueName: \"kubernetes.io/projected/40c302c8-5f10-4e62-b02d-d66954a68979-kube-api-access-7gtst\") pod \"kuadrant-operator-controller-manager-86878c769f-f7zzw\" (UID: \"40c302c8-5f10-4e62-b02d-d66954a68979\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:39:56.261804 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.261445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40c302c8-5f10-4e62-b02d-d66954a68979-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f7zzw\" (UID: \"40c302c8-5f10-4e62-b02d-d66954a68979\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:39:56.261804 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.261502    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngnvx\" (UniqueName: \"kubernetes.io/projected/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-kube-api-access-ngnvx\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:56.261804 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.261518    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8987a26-8e47-42ab-b1c7-e05f68dbdd40-extensions-socket-volume\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:39:56.362561 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.362529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gtst\" (UniqueName: \"kubernetes.io/projected/40c302c8-5f10-4e62-b02d-d66954a68979-kube-api-access-7gtst\") pod \"kuadrant-operator-controller-manager-86878c769f-f7zzw\" (UID: \"40c302c8-5f10-4e62-b02d-d66954a68979\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:39:56.362699 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.362575    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40c302c8-5f10-4e62-b02d-d66954a68979-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f7zzw\" (UID: \"40c302c8-5f10-4e62-b02d-d66954a68979\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:39:56.362922 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.362904    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40c302c8-5f10-4e62-b02d-d66954a68979-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-f7zzw\" (UID: \"40c302c8-5f10-4e62-b02d-d66954a68979\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:39:56.373815 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.373795    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gtst\" (UniqueName: \"kubernetes.io/projected/40c302c8-5f10-4e62-b02d-d66954a68979-kube-api-access-7gtst\") pod \"kuadrant-operator-controller-manager-86878c769f-f7zzw\" (UID: \"40c302c8-5f10-4e62-b02d-d66954a68979\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:39:56.483615 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.483588    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:39:56.617970 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.617920    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"]
Jul 10 14:39:56.622528 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:39:56.622501    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c302c8_5f10_4e62_b02d_d66954a68979.slice/crio-34cfc9b136bde0a359979405bfaa005c0c1d088b7aa4bdf5f24d2a11acc790d4 WatchSource:0}: Error finding container 34cfc9b136bde0a359979405bfaa005c0c1d088b7aa4bdf5f24d2a11acc790d4: Status 404 returned error can't find the container with id 34cfc9b136bde0a359979405bfaa005c0c1d088b7aa4bdf5f24d2a11acc790d4
Jul 10 14:39:56.849624 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.849585    2564 generic.go:356] "Generic (PLEG): container finished" podID="b8987a26-8e47-42ab-b1c7-e05f68dbdd40" containerID="33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7" exitCode=0
Jul 10 14:39:56.849814 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.849679    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg" event={"ID":"b8987a26-8e47-42ab-b1c7-e05f68dbdd40","Type":"ContainerDied","Data":"33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7"}
Jul 10 14:39:56.849814 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.849687    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"
Jul 10 14:39:56.849814 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.849739    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg" event={"ID":"b8987a26-8e47-42ab-b1c7-e05f68dbdd40","Type":"ContainerDied","Data":"059c0d7a06fc38a3bf201eaf3ddf1080dbee5f4a330a444b3a4c045c4053eb21"}
Jul 10 14:39:56.849814 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.849786    2564 scope.go:117] "RemoveContainer" containerID="33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7"
Jul 10 14:39:56.851588 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.851556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw" event={"ID":"40c302c8-5f10-4e62-b02d-d66954a68979","Type":"ContainerStarted","Data":"1061604a1bc458bc1c16785b9c8781061445625d260ada4b9336724bca564d8b"}
Jul 10 14:39:56.851697 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.851607    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw" event={"ID":"40c302c8-5f10-4e62-b02d-d66954a68979","Type":"ContainerStarted","Data":"34cfc9b136bde0a359979405bfaa005c0c1d088b7aa4bdf5f24d2a11acc790d4"}
Jul 10 14:39:56.851780 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.851713    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:39:56.859406 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.859387    2564 scope.go:117] "RemoveContainer" containerID="33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7"
Jul 10 14:39:56.859656 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:39:56.859635    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7\": container with ID starting with 33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7 not found: ID does not exist" containerID="33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7"
Jul 10 14:39:56.859712 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.859666    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7"} err="failed to get container status \"33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7\": rpc error: code = NotFound desc = could not find container \"33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7\": container with ID starting with 33095932a7dc8c13d1a3d1593c648a59d48b8c9d2ab95cfc6ff0cd6e1c0d3bc7 not found: ID does not exist"
Jul 10 14:39:56.868782 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.868719    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"]
Jul 10 14:39:56.872173 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.872154    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jsqdg"]
Jul 10 14:39:56.891158 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:56.891118    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw" podStartSLOduration=0.891107141 podStartE2EDuration="891.107141ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:39:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:39:56.88942487 +0000 UTC m=+508.842314957" watchObservedRunningTime="2026-07-10 14:39:56.891107141 +0000 UTC m=+508.843997218"
Jul 10 14:39:58.564389 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:58.564351    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8987a26-8e47-42ab-b1c7-e05f68dbdd40" path="/var/lib/kubelet/pods/b8987a26-8e47-42ab-b1c7-e05f68dbdd40/volumes"
Jul 10 14:39:58.860912 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:58.860876    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:39:58.960665 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:39:58.960635    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:06.070380 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:06.070339    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:07.861221 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:07.861191    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:40:07.912489 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:07.912456    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"]
Jul 10 14:40:07.912682 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:07.912656    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7" podUID="0c2004dd-3e30-4b31-8f41-d6a386181c38" containerName="manager" containerID="cri-o://3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743" gracePeriod=10
Jul 10 14:40:08.278778 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.278727    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:40:08.359336 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.359306    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c2004dd-3e30-4b31-8f41-d6a386181c38-extensions-socket-volume\") pod \"0c2004dd-3e30-4b31-8f41-d6a386181c38\" (UID: \"0c2004dd-3e30-4b31-8f41-d6a386181c38\") "
Jul 10 14:40:08.359509 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.359437    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrk78\" (UniqueName: \"kubernetes.io/projected/0c2004dd-3e30-4b31-8f41-d6a386181c38-kube-api-access-zrk78\") pod \"0c2004dd-3e30-4b31-8f41-d6a386181c38\" (UID: \"0c2004dd-3e30-4b31-8f41-d6a386181c38\") "
Jul 10 14:40:08.359656 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.359635    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c2004dd-3e30-4b31-8f41-d6a386181c38-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0c2004dd-3e30-4b31-8f41-d6a386181c38" (UID: "0c2004dd-3e30-4b31-8f41-d6a386181c38"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:40:08.361608 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.361578    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c2004dd-3e30-4b31-8f41-d6a386181c38-kube-api-access-zrk78" (OuterVolumeSpecName: "kube-api-access-zrk78") pod "0c2004dd-3e30-4b31-8f41-d6a386181c38" (UID: "0c2004dd-3e30-4b31-8f41-d6a386181c38"). InnerVolumeSpecName "kube-api-access-zrk78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:40:08.443132 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.443058    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:08.460908 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.460881    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrk78\" (UniqueName: \"kubernetes.io/projected/0c2004dd-3e30-4b31-8f41-d6a386181c38-kube-api-access-zrk78\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:40:08.460908 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.460905    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c2004dd-3e30-4b31-8f41-d6a386181c38-extensions-socket-volume\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:40:08.543931 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.543900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:08.882539 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.882509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:08.916074 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.916045    2564 generic.go:356] "Generic (PLEG): container finished" podID="0c2004dd-3e30-4b31-8f41-d6a386181c38" containerID="3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743" exitCode=0
Jul 10 14:40:08.916218 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.916075    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7" event={"ID":"0c2004dd-3e30-4b31-8f41-d6a386181c38","Type":"ContainerDied","Data":"3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743"}
Jul 10 14:40:08.916218 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.916100    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"
Jul 10 14:40:08.916218 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.916128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7" event={"ID":"0c2004dd-3e30-4b31-8f41-d6a386181c38","Type":"ContainerDied","Data":"942426b70e128b8690b16cadbfadd9fa89d02b4373e2ed257371e311efa38198"}
Jul 10 14:40:08.916218 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.916152    2564 scope.go:117] "RemoveContainer" containerID="3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743"
Jul 10 14:40:08.924557 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.924540    2564 scope.go:117] "RemoveContainer" containerID="3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743"
Jul 10 14:40:08.924827 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:40:08.924806    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743\": container with ID starting with 3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743 not found: ID does not exist" containerID="3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743"
Jul 10 14:40:08.924887 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.924836    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743"} err="failed to get container status \"3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743\": rpc error: code = NotFound desc = could not find container \"3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743\": container with ID starting with 3c30da78ee179698c4d8cdecdeb4c5209c8e1437ae97f65c7655f06e93b64743 not found: ID does not exist"
Jul 10 14:40:08.938308 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.938286    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"]
Jul 10 14:40:08.942692 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.942669    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gdqz7"]
Jul 10 14:40:08.985800 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:08.985778    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:10.563706 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:10.563678    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c2004dd-3e30-4b31-8f41-d6a386181c38" path="/var/lib/kubelet/pods/0c2004dd-3e30-4b31-8f41-d6a386181c38/volumes"
Jul 10 14:40:12.249065 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.249035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:12.301842 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.301811    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"]
Jul 10 14:40:12.302228 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.302212    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c2004dd-3e30-4b31-8f41-d6a386181c38" containerName="manager"
Jul 10 14:40:12.302278 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.302230    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c2004dd-3e30-4b31-8f41-d6a386181c38" containerName="manager"
Jul 10 14:40:12.302314 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.302305    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c2004dd-3e30-4b31-8f41-d6a386181c38" containerName="manager"
Jul 10 14:40:12.309268 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.309248    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.312276 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.312252    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-slchf\""
Jul 10 14:40:12.312573 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.312555    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 14:40:12.321480 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.321456    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"]
Jul 10 14:40:12.338906 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.338882    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:12.394464 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.394437    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.394602 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.394479    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.394602 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.394516    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e5cd76b-5232-479b-8568-ce9eaa22d341-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.394602 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.394542    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vkk2\" (UniqueName: \"kubernetes.io/projected/3e5cd76b-5232-479b-8568-ce9eaa22d341-kube-api-access-8vkk2\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.394602 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.394574    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.394799 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.394605    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.394799 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.394644    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.394799 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.394678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.394799 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.394694    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.406511 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.406484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:12.495218 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495196    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495359 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495227    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495359 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495359 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495266    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495359 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495359 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e5cd76b-5232-479b-8568-ce9eaa22d341-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495581 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vkk2\" (UniqueName: \"kubernetes.io/projected/3e5cd76b-5232-479b-8568-ce9eaa22d341-kube-api-access-8vkk2\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495581 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495465    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495581 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495778 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495845 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495821    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495901 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.495901 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.495882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.496196 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.496179    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e5cd76b-5232-479b-8568-ce9eaa22d341-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.497723 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.497705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.497880 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.497864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.504303 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.504228    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vkk2\" (UniqueName: \"kubernetes.io/projected/3e5cd76b-5232-479b-8568-ce9eaa22d341-kube-api-access-8vkk2\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.504303 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.504291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e5cd76b-5232-479b-8568-ce9eaa22d341-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9b5v6\" (UID: \"3e5cd76b-5232-479b-8568-ce9eaa22d341\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.506894 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.506871    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:12.620594 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.620566    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:12.755281 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.755257    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"]
Jul 10 14:40:12.757194 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:40:12.757156    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5cd76b_5232_479b_8568_ce9eaa22d341.slice/crio-618b53d9ef3a235e8f623f99924492b2af34a4c1b783a957c5049419495e2a18 WatchSource:0}: Error finding container 618b53d9ef3a235e8f623f99924492b2af34a4c1b783a957c5049419495e2a18: Status 404 returned error can't find the container with id 618b53d9ef3a235e8f623f99924492b2af34a4c1b783a957c5049419495e2a18
Jul 10 14:40:12.937932 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:12.937903    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6" event={"ID":"3e5cd76b-5232-479b-8568-ce9eaa22d341","Type":"ContainerStarted","Data":"618b53d9ef3a235e8f623f99924492b2af34a4c1b783a957c5049419495e2a18"}
Jul 10 14:40:15.700722 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:15.700683    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:16.065387 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:16.065349    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:40:16.065466 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:16.065436    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:40:16.065509 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:16.065465    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:40:16.972501 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:16.972468    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6" event={"ID":"3e5cd76b-5232-479b-8568-ce9eaa22d341","Type":"ContainerStarted","Data":"9e21b436b06d4c626dff188326bb51fa928694a31705d6e9088b03d0ab140938"}
Jul 10 14:40:16.994952 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:16.994898    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6" podStartSLOduration=1.6890854910000002 podStartE2EDuration="4.994884014s" totalImagesPullingTime="3.305798523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:40:16.993145506 +0000 UTC m=+528.946035584" watchObservedRunningTime="2026-07-10 14:40:16.994884014 +0000 UTC m=+528.947774090"
Jul 10 14:40:17.621569 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:17.621533    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:17.626620 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:17.626593    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:17.978219 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:17.978136    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:17.979199 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:17.979183    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:40:18.627266 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:18.627230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:18.728161 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:18.728090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:25.970387 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:25.970348    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:25.970777 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:25.970552    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dccc"]
Jul 10 14:40:25.974071 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:25.974055    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:25.976808 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:25.976771    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 14:40:25.982544 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:25.982520    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dccc"]
Jul 10 14:40:26.066372 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.066329    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dccc"]
Jul 10 14:40:26.089517 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.089486    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:26.110335 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.110303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjvh\" (UniqueName: \"kubernetes.io/projected/2f526dad-9f2b-4454-9501-6a90ab2514f2-kube-api-access-xrjvh\") pod \"limitador-limitador-64c94fd64f-5dccc\" (UID: \"2f526dad-9f2b-4454-9501-6a90ab2514f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:26.110472 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.110344    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f526dad-9f2b-4454-9501-6a90ab2514f2-config-file\") pod \"limitador-limitador-64c94fd64f-5dccc\" (UID: \"2f526dad-9f2b-4454-9501-6a90ab2514f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:26.146917 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.146887    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:26.211223 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.211194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjvh\" (UniqueName: \"kubernetes.io/projected/2f526dad-9f2b-4454-9501-6a90ab2514f2-kube-api-access-xrjvh\") pod \"limitador-limitador-64c94fd64f-5dccc\" (UID: \"2f526dad-9f2b-4454-9501-6a90ab2514f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:26.211223 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.211252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f526dad-9f2b-4454-9501-6a90ab2514f2-config-file\") pod \"limitador-limitador-64c94fd64f-5dccc\" (UID: \"2f526dad-9f2b-4454-9501-6a90ab2514f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:26.211923 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.211903    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f526dad-9f2b-4454-9501-6a90ab2514f2-config-file\") pod \"limitador-limitador-64c94fd64f-5dccc\" (UID: \"2f526dad-9f2b-4454-9501-6a90ab2514f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:26.220203 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.220142    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjvh\" (UniqueName: \"kubernetes.io/projected/2f526dad-9f2b-4454-9501-6a90ab2514f2-kube-api-access-xrjvh\") pod \"limitador-limitador-64c94fd64f-5dccc\" (UID: \"2f526dad-9f2b-4454-9501-6a90ab2514f2\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:26.286235 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.286152    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:26.369701 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.369671    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:40:26.374033 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.374005    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"
Jul 10 14:40:26.382981 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.382920    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:40:26.398063 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.398030    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:40:26.429533 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.429513    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dccc"]
Jul 10 14:40:26.431795 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:40:26.431743    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f526dad_9f2b_4454_9501_6a90ab2514f2.slice/crio-6c0390ee48afa28137f7d9fc3861b425b5b4164a781c694c91f2fe62f8365702 WatchSource:0}: Error finding container 6c0390ee48afa28137f7d9fc3861b425b5b4164a781c694c91f2fe62f8365702: Status 404 returned error can't find the container with id 6c0390ee48afa28137f7d9fc3861b425b5b4164a781c694c91f2fe62f8365702
Jul 10 14:40:26.514090 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.514058    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl4m4\" (UniqueName: \"kubernetes.io/projected/5185b3d3-31cf-44cc-99db-cc59fd6618d7-kube-api-access-nl4m4\") pod \"limitador-limitador-54d6d988d5-nb8kq\" (UID: \"5185b3d3-31cf-44cc-99db-cc59fd6618d7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"
Jul 10 14:40:26.514220 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.514114    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5185b3d3-31cf-44cc-99db-cc59fd6618d7-config-file\") pod \"limitador-limitador-54d6d988d5-nb8kq\" (UID: \"5185b3d3-31cf-44cc-99db-cc59fd6618d7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"
Jul 10 14:40:26.615440 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.615407    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl4m4\" (UniqueName: \"kubernetes.io/projected/5185b3d3-31cf-44cc-99db-cc59fd6618d7-kube-api-access-nl4m4\") pod \"limitador-limitador-54d6d988d5-nb8kq\" (UID: \"5185b3d3-31cf-44cc-99db-cc59fd6618d7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"
Jul 10 14:40:26.615603 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.615473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5185b3d3-31cf-44cc-99db-cc59fd6618d7-config-file\") pod \"limitador-limitador-54d6d988d5-nb8kq\" (UID: \"5185b3d3-31cf-44cc-99db-cc59fd6618d7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"
Jul 10 14:40:26.616147 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.616128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5185b3d3-31cf-44cc-99db-cc59fd6618d7-config-file\") pod \"limitador-limitador-54d6d988d5-nb8kq\" (UID: \"5185b3d3-31cf-44cc-99db-cc59fd6618d7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"
Jul 10 14:40:26.623997 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.623970    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl4m4\" (UniqueName: \"kubernetes.io/projected/5185b3d3-31cf-44cc-99db-cc59fd6618d7-kube-api-access-nl4m4\") pod \"limitador-limitador-54d6d988d5-nb8kq\" (UID: \"5185b3d3-31cf-44cc-99db-cc59fd6618d7\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"
Jul 10 14:40:26.689502 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.689473    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"
Jul 10 14:40:26.803320 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.803288    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:26.825641 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.825614    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:40:26.827048 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:40:26.827014    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5185b3d3_31cf_44cc_99db_cc59fd6618d7.slice/crio-0fd3a9c2a7c4c66179b014f050879c7feebea12c9993ce01d5bd536a251a7234 WatchSource:0}: Error finding container 0fd3a9c2a7c4c66179b014f050879c7feebea12c9993ce01d5bd536a251a7234: Status 404 returned error can't find the container with id 0fd3a9c2a7c4c66179b014f050879c7feebea12c9993ce01d5bd536a251a7234
Jul 10 14:40:26.880279 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.880215    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-86zvc"]
Jul 10 14:40:26.883383 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.883360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:26.884821 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.884803    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-86zvc"
Jul 10 14:40:26.887646 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.887625    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zmhrc\""
Jul 10 14:40:26.889735 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:26.889717    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-86zvc"]
Jul 10 14:40:27.018253 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:27.018211    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqr4d\" (UniqueName: \"kubernetes.io/projected/e3108895-5522-4c2c-98ac-40e07e869d0d-kube-api-access-nqr4d\") pod \"authorino-75d556bd77-86zvc\" (UID: \"e3108895-5522-4c2c-98ac-40e07e869d0d\") " pod="kuadrant-system/authorino-75d556bd77-86zvc"
Jul 10 14:40:27.026057 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:27.026012    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq" event={"ID":"5185b3d3-31cf-44cc-99db-cc59fd6618d7","Type":"ContainerStarted","Data":"0fd3a9c2a7c4c66179b014f050879c7feebea12c9993ce01d5bd536a251a7234"}
Jul 10 14:40:27.027160 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:27.027140    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc" event={"ID":"2f526dad-9f2b-4454-9501-6a90ab2514f2","Type":"ContainerStarted","Data":"6c0390ee48afa28137f7d9fc3861b425b5b4164a781c694c91f2fe62f8365702"}
Jul 10 14:40:27.118967 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:27.118935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqr4d\" (UniqueName: \"kubernetes.io/projected/e3108895-5522-4c2c-98ac-40e07e869d0d-kube-api-access-nqr4d\") pod \"authorino-75d556bd77-86zvc\" (UID: \"e3108895-5522-4c2c-98ac-40e07e869d0d\") " pod="kuadrant-system/authorino-75d556bd77-86zvc"
Jul 10 14:40:27.127319 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:27.127297    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqr4d\" (UniqueName: \"kubernetes.io/projected/e3108895-5522-4c2c-98ac-40e07e869d0d-kube-api-access-nqr4d\") pod \"authorino-75d556bd77-86zvc\" (UID: \"e3108895-5522-4c2c-98ac-40e07e869d0d\") " pod="kuadrant-system/authorino-75d556bd77-86zvc"
Jul 10 14:40:27.203180 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:27.203109    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-86zvc"
Jul 10 14:40:27.384874 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:27.384846    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-86zvc"]
Jul 10 14:40:27.387822 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:40:27.387719    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3108895_5522_4c2c_98ac_40e07e869d0d.slice/crio-eeb5cff65d19cdbe7ab08d974a48883162fb213ec2221500d10e471b535a0e39 WatchSource:0}: Error finding container eeb5cff65d19cdbe7ab08d974a48883162fb213ec2221500d10e471b535a0e39: Status 404 returned error can't find the container with id eeb5cff65d19cdbe7ab08d974a48883162fb213ec2221500d10e471b535a0e39
Jul 10 14:40:28.039268 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:28.039231    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-86zvc" event={"ID":"e3108895-5522-4c2c-98ac-40e07e869d0d","Type":"ContainerStarted","Data":"eeb5cff65d19cdbe7ab08d974a48883162fb213ec2221500d10e471b535a0e39"}
Jul 10 14:40:32.064683 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:32.064640    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc" event={"ID":"2f526dad-9f2b-4454-9501-6a90ab2514f2","Type":"ContainerStarted","Data":"e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9"}
Jul 10 14:40:32.065137 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:32.064747    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:32.066185 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:32.066163    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq" event={"ID":"5185b3d3-31cf-44cc-99db-cc59fd6618d7","Type":"ContainerStarted","Data":"88367e41f7113e12551a595648990ed8919910965168b402f03def5f5ec8b4e9"}
Jul 10 14:40:32.066295 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:32.066210    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"
Jul 10 14:40:32.067669 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:32.067649    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-86zvc" event={"ID":"e3108895-5522-4c2c-98ac-40e07e869d0d","Type":"ContainerStarted","Data":"58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a"}
Jul 10 14:40:32.080720 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:32.080670    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc" podStartSLOduration=2.021675037 podStartE2EDuration="7.080654289s" totalImagesPullingTime="5.058979252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:40:32.080192433 +0000 UTC m=+544.033082510" watchObservedRunningTime="2026-07-10 14:40:32.080654289 +0000 UTC m=+544.033544371"
Jul 10 14:40:32.096306 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:32.096261    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq" podStartSLOduration=1.396533501 podStartE2EDuration="6.096248593s" totalImagesPullingTime="4.699715092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:40:32.095893071 +0000 UTC m=+544.048783148" watchObservedRunningTime="2026-07-10 14:40:32.096248593 +0000 UTC m=+544.049138669"
Jul 10 14:40:32.110477 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:32.110435    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-86zvc" podStartSLOduration=2.005174111 podStartE2EDuration="6.110422187s" totalImagesPullingTime="4.105248076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:40:32.108875518 +0000 UTC m=+544.061765620" watchObservedRunningTime="2026-07-10 14:40:32.110422187 +0000 UTC m=+544.063312263"
Jul 10 14:40:43.073906 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.073877    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:43.074297 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.073942    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"
Jul 10 14:40:43.139012 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.138977    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dccc"]
Jul 10 14:40:43.139274 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.139250    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc" podUID="2f526dad-9f2b-4454-9501-6a90ab2514f2" containerName="limitador" containerID="cri-o://e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9" gracePeriod=30
Jul 10 14:40:43.678905 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.678882    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:43.765079 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.764994    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f526dad-9f2b-4454-9501-6a90ab2514f2-config-file\") pod \"2f526dad-9f2b-4454-9501-6a90ab2514f2\" (UID: \"2f526dad-9f2b-4454-9501-6a90ab2514f2\") "
Jul 10 14:40:43.765079 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.765036    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrjvh\" (UniqueName: \"kubernetes.io/projected/2f526dad-9f2b-4454-9501-6a90ab2514f2-kube-api-access-xrjvh\") pod \"2f526dad-9f2b-4454-9501-6a90ab2514f2\" (UID: \"2f526dad-9f2b-4454-9501-6a90ab2514f2\") "
Jul 10 14:40:43.765341 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.765319    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f526dad-9f2b-4454-9501-6a90ab2514f2-config-file" (OuterVolumeSpecName: "config-file") pod "2f526dad-9f2b-4454-9501-6a90ab2514f2" (UID: "2f526dad-9f2b-4454-9501-6a90ab2514f2"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:40:43.767172 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.767144    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f526dad-9f2b-4454-9501-6a90ab2514f2-kube-api-access-xrjvh" (OuterVolumeSpecName: "kube-api-access-xrjvh") pod "2f526dad-9f2b-4454-9501-6a90ab2514f2" (UID: "2f526dad-9f2b-4454-9501-6a90ab2514f2"). InnerVolumeSpecName "kube-api-access-xrjvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:40:43.866230 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.866201    2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2f526dad-9f2b-4454-9501-6a90ab2514f2-config-file\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:40:43.866230 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:43.866226    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrjvh\" (UniqueName: \"kubernetes.io/projected/2f526dad-9f2b-4454-9501-6a90ab2514f2-kube-api-access-xrjvh\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:40:44.129522 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.129493    2564 generic.go:356] "Generic (PLEG): container finished" podID="2f526dad-9f2b-4454-9501-6a90ab2514f2" containerID="e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9" exitCode=0
Jul 10 14:40:44.129931 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.129535    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc"
Jul 10 14:40:44.129931 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.129576    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc" event={"ID":"2f526dad-9f2b-4454-9501-6a90ab2514f2","Type":"ContainerDied","Data":"e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9"}
Jul 10 14:40:44.129931 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.129623    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5dccc" event={"ID":"2f526dad-9f2b-4454-9501-6a90ab2514f2","Type":"ContainerDied","Data":"6c0390ee48afa28137f7d9fc3861b425b5b4164a781c694c91f2fe62f8365702"}
Jul 10 14:40:44.129931 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.129646    2564 scope.go:117] "RemoveContainer" containerID="e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9"
Jul 10 14:40:44.138827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.138812    2564 scope.go:117] "RemoveContainer" containerID="e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9"
Jul 10 14:40:44.139108 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:40:44.139087    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9\": container with ID starting with e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9 not found: ID does not exist" containerID="e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9"
Jul 10 14:40:44.139159 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.139122    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9"} err="failed to get container status \"e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9\": rpc error: code = NotFound desc = could not find container \"e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9\": container with ID starting with e0aaf4212f0df85fc70ca031e4d47d7a678a4c9a82980f6f53642e430df644a9 not found: ID does not exist"
Jul 10 14:40:44.151349 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.151324    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dccc"]
Jul 10 14:40:44.160414 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.160389    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5dccc"]
Jul 10 14:40:44.532321 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.532240    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:44.564111 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.564078    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f526dad-9f2b-4454-9501-6a90ab2514f2" path="/var/lib/kubelet/pods/2f526dad-9f2b-4454-9501-6a90ab2514f2/volumes"
Jul 10 14:40:44.630225 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:44.630199    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:45.102161 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:45.102128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:45.750069 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:45.750037    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:45.850431 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:45.850404    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:57.068369 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.068325    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:57.302680 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.302643    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrpcp"]
Jul 10 14:40:57.303042 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.303028    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f526dad-9f2b-4454-9501-6a90ab2514f2" containerName="limitador"
Jul 10 14:40:57.303094 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.303044    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f526dad-9f2b-4454-9501-6a90ab2514f2" containerName="limitador"
Jul 10 14:40:57.303133 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.303109    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f526dad-9f2b-4454-9501-6a90ab2514f2" containerName="limitador"
Jul 10 14:40:57.306172 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.306156    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mrpcp"
Jul 10 14:40:57.311943 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.311916    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrpcp"]
Jul 10 14:40:57.478851 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.478816    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlfn4\" (UniqueName: \"kubernetes.io/projected/0709f707-e75d-4797-a6a1-fe22f803c7d4-kube-api-access-qlfn4\") pod \"authorino-5d4b67c446-mrpcp\" (UID: \"0709f707-e75d-4797-a6a1-fe22f803c7d4\") " pod="kuadrant-system/authorino-5d4b67c446-mrpcp"
Jul 10 14:40:57.560699 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.560665    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrpcp"]
Jul 10 14:40:57.560960 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:40:57.560938    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qlfn4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-mrpcp" podUID="0709f707-e75d-4797-a6a1-fe22f803c7d4"
Jul 10 14:40:57.579712 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.579678    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlfn4\" (UniqueName: \"kubernetes.io/projected/0709f707-e75d-4797-a6a1-fe22f803c7d4-kube-api-access-qlfn4\") pod \"authorino-5d4b67c446-mrpcp\" (UID: \"0709f707-e75d-4797-a6a1-fe22f803c7d4\") " pod="kuadrant-system/authorino-5d4b67c446-mrpcp"
Jul 10 14:40:57.586560 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.586532    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c4bc8b66-9jnkb"]
Jul 10 14:40:57.590225 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.590205    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4bc8b66-9jnkb"
Jul 10 14:40:57.591373 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.591349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlfn4\" (UniqueName: \"kubernetes.io/projected/0709f707-e75d-4797-a6a1-fe22f803c7d4-kube-api-access-qlfn4\") pod \"authorino-5d4b67c446-mrpcp\" (UID: \"0709f707-e75d-4797-a6a1-fe22f803c7d4\") " pod="kuadrant-system/authorino-5d4b67c446-mrpcp"
Jul 10 14:40:57.598214 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.598188    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c4bc8b66-9jnkb"]
Jul 10 14:40:57.628342 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.628309    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:40:57.724421 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.724381    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c4bc8b66-9jnkb"]
Jul 10 14:40:57.724677 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:40:57.724656    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xbbln], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5c4bc8b66-9jnkb" podUID="9bc0d78f-722f-4720-90c9-477fc2fa576e"
Jul 10 14:40:57.782202 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.782119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbbln\" (UniqueName: \"kubernetes.io/projected/9bc0d78f-722f-4720-90c9-477fc2fa576e-kube-api-access-xbbln\") pod \"authorino-5c4bc8b66-9jnkb\" (UID: \"9bc0d78f-722f-4720-90c9-477fc2fa576e\") " pod="kuadrant-system/authorino-5c4bc8b66-9jnkb"
Jul 10 14:40:57.882790 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.882733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbbln\" (UniqueName: \"kubernetes.io/projected/9bc0d78f-722f-4720-90c9-477fc2fa576e-kube-api-access-xbbln\") pod \"authorino-5c4bc8b66-9jnkb\" (UID: \"9bc0d78f-722f-4720-90c9-477fc2fa576e\") " pod="kuadrant-system/authorino-5c4bc8b66-9jnkb"
Jul 10 14:40:57.892007 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:57.891975    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbbln\" (UniqueName: \"kubernetes.io/projected/9bc0d78f-722f-4720-90c9-477fc2fa576e-kube-api-access-xbbln\") pod \"authorino-5c4bc8b66-9jnkb\" (UID: \"9bc0d78f-722f-4720-90c9-477fc2fa576e\") " pod="kuadrant-system/authorino-5c4bc8b66-9jnkb"
Jul 10 14:40:58.205543 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:58.205507    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4bc8b66-9jnkb"
Jul 10 14:40:58.205543 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:58.205512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mrpcp"
Jul 10 14:40:58.212948 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:58.212926    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4bc8b66-9jnkb"
Jul 10 14:40:58.215691 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:58.215674    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mrpcp"
Jul 10 14:40:58.388282 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:58.388241    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbbln\" (UniqueName: \"kubernetes.io/projected/9bc0d78f-722f-4720-90c9-477fc2fa576e-kube-api-access-xbbln\") pod \"9bc0d78f-722f-4720-90c9-477fc2fa576e\" (UID: \"9bc0d78f-722f-4720-90c9-477fc2fa576e\") "
Jul 10 14:40:58.388475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:58.388315    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlfn4\" (UniqueName: \"kubernetes.io/projected/0709f707-e75d-4797-a6a1-fe22f803c7d4-kube-api-access-qlfn4\") pod \"0709f707-e75d-4797-a6a1-fe22f803c7d4\" (UID: \"0709f707-e75d-4797-a6a1-fe22f803c7d4\") "
Jul 10 14:40:58.391052 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:58.391023    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0709f707-e75d-4797-a6a1-fe22f803c7d4-kube-api-access-qlfn4" (OuterVolumeSpecName: "kube-api-access-qlfn4") pod "0709f707-e75d-4797-a6a1-fe22f803c7d4" (UID: "0709f707-e75d-4797-a6a1-fe22f803c7d4"). InnerVolumeSpecName "kube-api-access-qlfn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:40:58.391168 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:58.391062    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bc0d78f-722f-4720-90c9-477fc2fa576e-kube-api-access-xbbln" (OuterVolumeSpecName: "kube-api-access-xbbln") pod "9bc0d78f-722f-4720-90c9-477fc2fa576e" (UID: "9bc0d78f-722f-4720-90c9-477fc2fa576e"). InnerVolumeSpecName "kube-api-access-xbbln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:40:58.489573 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:58.489492    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlfn4\" (UniqueName: \"kubernetes.io/projected/0709f707-e75d-4797-a6a1-fe22f803c7d4-kube-api-access-qlfn4\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:40:58.489573 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:58.489523    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbbln\" (UniqueName: \"kubernetes.io/projected/9bc0d78f-722f-4720-90c9-477fc2fa576e-kube-api-access-xbbln\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:40:59.210177 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:59.210149    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4bc8b66-9jnkb"
Jul 10 14:40:59.210556 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:59.210148    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mrpcp"
Jul 10 14:40:59.243607 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:59.243571    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c4bc8b66-9jnkb"]
Jul 10 14:40:59.246677 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:59.246651    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c4bc8b66-9jnkb"]
Jul 10 14:40:59.271303 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:59.271268    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrpcp"]
Jul 10 14:40:59.273204 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:59.273182    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mrpcp"]
Jul 10 14:40:59.785829 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:59.785796    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-86zvc"]
Jul 10 14:40:59.786002 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:40:59.785956    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-86zvc" podUID="e3108895-5522-4c2c-98ac-40e07e869d0d" containerName="authorino" containerID="cri-o://58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a" gracePeriod=30
Jul 10 14:41:00.039012 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.038961    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-86zvc"
Jul 10 14:41:00.100659 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.100633    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqr4d\" (UniqueName: \"kubernetes.io/projected/e3108895-5522-4c2c-98ac-40e07e869d0d-kube-api-access-nqr4d\") pod \"e3108895-5522-4c2c-98ac-40e07e869d0d\" (UID: \"e3108895-5522-4c2c-98ac-40e07e869d0d\") "
Jul 10 14:41:00.102926 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.102887    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3108895-5522-4c2c-98ac-40e07e869d0d-kube-api-access-nqr4d" (OuterVolumeSpecName: "kube-api-access-nqr4d") pod "e3108895-5522-4c2c-98ac-40e07e869d0d" (UID: "e3108895-5522-4c2c-98ac-40e07e869d0d"). InnerVolumeSpecName "kube-api-access-nqr4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:41:00.201179 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.201144    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqr4d\" (UniqueName: \"kubernetes.io/projected/e3108895-5522-4c2c-98ac-40e07e869d0d-kube-api-access-nqr4d\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:41:00.217066 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.217024    2564 generic.go:356] "Generic (PLEG): container finished" podID="e3108895-5522-4c2c-98ac-40e07e869d0d" containerID="58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a" exitCode=0
Jul 10 14:41:00.217066 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.217065    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-86zvc"
Jul 10 14:41:00.217495 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.217092    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-86zvc" event={"ID":"e3108895-5522-4c2c-98ac-40e07e869d0d","Type":"ContainerDied","Data":"58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a"}
Jul 10 14:41:00.217495 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.217133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-86zvc" event={"ID":"e3108895-5522-4c2c-98ac-40e07e869d0d","Type":"ContainerDied","Data":"eeb5cff65d19cdbe7ab08d974a48883162fb213ec2221500d10e471b535a0e39"}
Jul 10 14:41:00.217495 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.217158    2564 scope.go:117] "RemoveContainer" containerID="58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a"
Jul 10 14:41:00.226372 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.226359    2564 scope.go:117] "RemoveContainer" containerID="58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a"
Jul 10 14:41:00.226656 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:41:00.226636    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a\": container with ID starting with 58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a not found: ID does not exist" containerID="58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a"
Jul 10 14:41:00.226724 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.226664    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a"} err="failed to get container status \"58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a\": rpc error: code = NotFound desc = could not find container \"58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a\": container with ID starting with 58e7c0b4a32aefa20390cd649dd3498335001e2e58676048bb1e222cb7a4ed8a not found: ID does not exist"
Jul 10 14:41:00.242379 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.242306    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-86zvc"]
Jul 10 14:41:00.244892 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.244871    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-86zvc"]
Jul 10 14:41:00.566268 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.566237    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0709f707-e75d-4797-a6a1-fe22f803c7d4" path="/var/lib/kubelet/pods/0709f707-e75d-4797-a6a1-fe22f803c7d4/volumes"
Jul 10 14:41:00.566531 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.566514    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bc0d78f-722f-4720-90c9-477fc2fa576e" path="/var/lib/kubelet/pods/9bc0d78f-722f-4720-90c9-477fc2fa576e/volumes"
Jul 10 14:41:00.566782 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:00.566746    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3108895-5522-4c2c-98ac-40e07e869d0d" path="/var/lib/kubelet/pods/e3108895-5522-4c2c-98ac-40e07e869d0d/volumes"
Jul 10 14:41:04.538984 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.538955    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-db579b5df-j4mpc"]
Jul 10 14:41:04.539346 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.539279    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3108895-5522-4c2c-98ac-40e07e869d0d" containerName="authorino"
Jul 10 14:41:04.539346 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.539290    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3108895-5522-4c2c-98ac-40e07e869d0d" containerName="authorino"
Jul 10 14:41:04.539425 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.539361    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3108895-5522-4c2c-98ac-40e07e869d0d" containerName="authorino"
Jul 10 14:41:04.561456 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.561422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:04.628631 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.628600    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-db579b5df-j4mpc"]
Jul 10 14:41:04.628792 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.628701    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:04.631420 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.631400    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 14:41:04.631601 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.631430    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 14:41:04.632616 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.632585    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z28dn\""
Jul 10 14:41:04.638903 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.638883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fddc79c-b428-4920-8648-93cb012582e7-webhook-cert\") pod \"maas-controller-db579b5df-j4mpc\" (UID: \"4fddc79c-b428-4920-8648-93cb012582e7\") " pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:04.639054 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.639035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6p24\" (UniqueName: \"kubernetes.io/projected/4fddc79c-b428-4920-8648-93cb012582e7-kube-api-access-d6p24\") pod \"maas-controller-db579b5df-j4mpc\" (UID: \"4fddc79c-b428-4920-8648-93cb012582e7\") " pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:04.737303 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.737275    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cdcdc785b-z6dlg"]
Jul 10 14:41:04.740280 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.740263    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6p24\" (UniqueName: \"kubernetes.io/projected/4fddc79c-b428-4920-8648-93cb012582e7-kube-api-access-d6p24\") pod \"maas-controller-db579b5df-j4mpc\" (UID: \"4fddc79c-b428-4920-8648-93cb012582e7\") " pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:04.740358 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.740298    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fddc79c-b428-4920-8648-93cb012582e7-webhook-cert\") pod \"maas-controller-db579b5df-j4mpc\" (UID: \"4fddc79c-b428-4920-8648-93cb012582e7\") " pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:04.742707 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.742668    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fddc79c-b428-4920-8648-93cb012582e7-webhook-cert\") pod \"maas-controller-db579b5df-j4mpc\" (UID: \"4fddc79c-b428-4920-8648-93cb012582e7\") " pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:04.751407 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.751385    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6p24\" (UniqueName: \"kubernetes.io/projected/4fddc79c-b428-4920-8648-93cb012582e7-kube-api-access-d6p24\") pod \"maas-controller-db579b5df-j4mpc\" (UID: \"4fddc79c-b428-4920-8648-93cb012582e7\") " pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:04.758593 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.758574    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdcdc785b-z6dlg"]
Jul 10 14:41:04.758678 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.758654    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:41:04.841603 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.841540    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn9g6\" (UniqueName: \"kubernetes.io/projected/7cb017de-dd82-4514-82ea-b1c26fa77311-kube-api-access-cn9g6\") pod \"maas-controller-7cdcdc785b-z6dlg\" (UID: \"7cb017de-dd82-4514-82ea-b1c26fa77311\") " pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:41:04.841603 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.841592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cb017de-dd82-4514-82ea-b1c26fa77311-webhook-cert\") pod \"maas-controller-7cdcdc785b-z6dlg\" (UID: \"7cb017de-dd82-4514-82ea-b1c26fa77311\") " pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:41:04.939805 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.939743    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:04.942725 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.942700    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn9g6\" (UniqueName: \"kubernetes.io/projected/7cb017de-dd82-4514-82ea-b1c26fa77311-kube-api-access-cn9g6\") pod \"maas-controller-7cdcdc785b-z6dlg\" (UID: \"7cb017de-dd82-4514-82ea-b1c26fa77311\") " pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:41:04.942848 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.942787    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cb017de-dd82-4514-82ea-b1c26fa77311-webhook-cert\") pod \"maas-controller-7cdcdc785b-z6dlg\" (UID: \"7cb017de-dd82-4514-82ea-b1c26fa77311\") " pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:41:04.945266 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.945241    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cb017de-dd82-4514-82ea-b1c26fa77311-webhook-cert\") pod \"maas-controller-7cdcdc785b-z6dlg\" (UID: \"7cb017de-dd82-4514-82ea-b1c26fa77311\") " pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:41:04.951273 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:04.951251    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn9g6\" (UniqueName: \"kubernetes.io/projected/7cb017de-dd82-4514-82ea-b1c26fa77311-kube-api-access-cn9g6\") pod \"maas-controller-7cdcdc785b-z6dlg\" (UID: \"7cb017de-dd82-4514-82ea-b1c26fa77311\") " pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:41:05.069129 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:05.069102    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:41:05.107318 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:05.107292    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-db579b5df-j4mpc"]
Jul 10 14:41:05.109237 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:41:05.109213    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fddc79c_b428_4920_8648_93cb012582e7.slice/crio-57abcdf16dc7dc1701c5f29b0a8439c33cb54a67f9a2d6d193348e5288724898 WatchSource:0}: Error finding container 57abcdf16dc7dc1701c5f29b0a8439c33cb54a67f9a2d6d193348e5288724898: Status 404 returned error can't find the container with id 57abcdf16dc7dc1701c5f29b0a8439c33cb54a67f9a2d6d193348e5288724898
Jul 10 14:41:05.231215 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:05.231191    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdcdc785b-z6dlg"]
Jul 10 14:41:05.232518 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:41:05.232498    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb017de_dd82_4514_82ea_b1c26fa77311.slice/crio-22bf536861aafee2f10fafa7b6aa545dd05a7c7dcdf6666256621c62f2a3098b WatchSource:0}: Error finding container 22bf536861aafee2f10fafa7b6aa545dd05a7c7dcdf6666256621c62f2a3098b: Status 404 returned error can't find the container with id 22bf536861aafee2f10fafa7b6aa545dd05a7c7dcdf6666256621c62f2a3098b
Jul 10 14:41:05.246618 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:05.246587    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-db579b5df-j4mpc" event={"ID":"4fddc79c-b428-4920-8648-93cb012582e7","Type":"ContainerStarted","Data":"57abcdf16dc7dc1701c5f29b0a8439c33cb54a67f9a2d6d193348e5288724898"}
Jul 10 14:41:05.247802 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:05.247781    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg" event={"ID":"7cb017de-dd82-4514-82ea-b1c26fa77311","Type":"ContainerStarted","Data":"22bf536861aafee2f10fafa7b6aa545dd05a7c7dcdf6666256621c62f2a3098b"}
Jul 10 14:41:05.867954 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:05.867904    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:07.455135 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:07.455011    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:07.550173 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:07.550145    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:08.266906 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:08.266865    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-db579b5df-j4mpc" event={"ID":"4fddc79c-b428-4920-8648-93cb012582e7","Type":"ContainerStarted","Data":"d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683"}
Jul 10 14:41:08.267105 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:08.266933    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:08.268697 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:08.268672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg" event={"ID":"7cb017de-dd82-4514-82ea-b1c26fa77311","Type":"ContainerStarted","Data":"6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac"}
Jul 10 14:41:08.268861 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:08.268778    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:41:08.285016 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:08.284972    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-db579b5df-j4mpc" podStartSLOduration=2.197208958 podStartE2EDuration="4.284957499s" totalImagesPullingTime="2.087748541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:41:08.28444716 +0000 UTC m=+580.237337266" watchObservedRunningTime="2026-07-10 14:41:08.284957499 +0000 UTC m=+580.237847575"
Jul 10 14:41:08.302803 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:08.302763    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg" podStartSLOduration=2.327552513 podStartE2EDuration="4.302732165s" totalImagesPullingTime="1.975179652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:41:08.300827757 +0000 UTC m=+580.253717853" watchObservedRunningTime="2026-07-10 14:41:08.302732165 +0000 UTC m=+580.255622241"
Jul 10 14:41:19.279023 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.278994    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:19.279509 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.279253    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:41:19.346010 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.345976    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-db579b5df-j4mpc"]
Jul 10 14:41:19.346290 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.346260    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-db579b5df-j4mpc" podUID="4fddc79c-b428-4920-8648-93cb012582e7" containerName="manager" containerID="cri-o://d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683" gracePeriod=30
Jul 10 14:41:19.597390 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.597361    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:19.672077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.672048    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6p24\" (UniqueName: \"kubernetes.io/projected/4fddc79c-b428-4920-8648-93cb012582e7-kube-api-access-d6p24\") pod \"4fddc79c-b428-4920-8648-93cb012582e7\" (UID: \"4fddc79c-b428-4920-8648-93cb012582e7\") "
Jul 10 14:41:19.672255 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.672097    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fddc79c-b428-4920-8648-93cb012582e7-webhook-cert\") pod \"4fddc79c-b428-4920-8648-93cb012582e7\" (UID: \"4fddc79c-b428-4920-8648-93cb012582e7\") "
Jul 10 14:41:19.674473 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.674439    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fddc79c-b428-4920-8648-93cb012582e7-kube-api-access-d6p24" (OuterVolumeSpecName: "kube-api-access-d6p24") pod "4fddc79c-b428-4920-8648-93cb012582e7" (UID: "4fddc79c-b428-4920-8648-93cb012582e7"). InnerVolumeSpecName "kube-api-access-d6p24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:41:19.674578 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.674443    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fddc79c-b428-4920-8648-93cb012582e7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4fddc79c-b428-4920-8648-93cb012582e7" (UID: "4fddc79c-b428-4920-8648-93cb012582e7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:41:19.773339 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.773310    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6p24\" (UniqueName: \"kubernetes.io/projected/4fddc79c-b428-4920-8648-93cb012582e7-kube-api-access-d6p24\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:41:19.773339 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:19.773334    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4fddc79c-b428-4920-8648-93cb012582e7-webhook-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:41:20.334656 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:20.334619    2564 generic.go:356] "Generic (PLEG): container finished" podID="4fddc79c-b428-4920-8648-93cb012582e7" containerID="d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683" exitCode=0
Jul 10 14:41:20.334656 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:20.334654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-db579b5df-j4mpc" event={"ID":"4fddc79c-b428-4920-8648-93cb012582e7","Type":"ContainerDied","Data":"d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683"}
Jul 10 14:41:20.335225 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:20.334662    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-db579b5df-j4mpc"
Jul 10 14:41:20.335225 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:20.334695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-db579b5df-j4mpc" event={"ID":"4fddc79c-b428-4920-8648-93cb012582e7","Type":"ContainerDied","Data":"57abcdf16dc7dc1701c5f29b0a8439c33cb54a67f9a2d6d193348e5288724898"}
Jul 10 14:41:20.335225 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:20.334716    2564 scope.go:117] "RemoveContainer" containerID="d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683"
Jul 10 14:41:20.344160 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:20.344143    2564 scope.go:117] "RemoveContainer" containerID="d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683"
Jul 10 14:41:20.344422 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:41:20.344405    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683\": container with ID starting with d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683 not found: ID does not exist" containerID="d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683"
Jul 10 14:41:20.344462 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:20.344432    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683"} err="failed to get container status \"d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683\": rpc error: code = NotFound desc = could not find container \"d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683\": container with ID starting with d59a67dfad05138efb1b574be4081765e88c3a6f260f7315b35e9e2813327683 not found: ID does not exist"
Jul 10 14:41:20.359784 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:20.359283    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-db579b5df-j4mpc"]
Jul 10 14:41:20.365107 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:20.365085    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-db579b5df-j4mpc"]
Jul 10 14:41:20.564386 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:20.564351    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fddc79c-b428-4920-8648-93cb012582e7" path="/var/lib/kubelet/pods/4fddc79c-b428-4920-8648-93cb012582e7/volumes"
Jul 10 14:41:28.441716 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:28.441686    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:41:28.442170 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:28.441809    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:41:42.492585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:42.492550    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:42.937333 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:42.937290    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:43.001806 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.001770    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"]
Jul 10 14:41:43.002151 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.002137    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fddc79c-b428-4920-8648-93cb012582e7" containerName="manager"
Jul 10 14:41:43.002151 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.002152    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fddc79c-b428-4920-8648-93cb012582e7" containerName="manager"
Jul 10 14:41:43.002282 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.002226    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fddc79c-b428-4920-8648-93cb012582e7" containerName="manager"
Jul 10 14:41:43.008346 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.008323    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.015273 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.015258    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 14:41:43.015347 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.015316    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 14:41:43.015408 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.015384    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kswzm\""
Jul 10 14:41:43.015466 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.015374    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 14:41:43.026549 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.026520    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"]
Jul 10 14:41:43.134521 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.134478    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:43.176169 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.176136    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvss7\" (UniqueName: \"kubernetes.io/projected/f06c9d41-e061-42e2-8f06-9a3d749f4176-kube-api-access-qvss7\") pod \"maas-api-6c4df6cbf-fzkts\" (UID: \"f06c9d41-e061-42e2-8f06-9a3d749f4176\") " pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.176325 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.176194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f06c9d41-e061-42e2-8f06-9a3d749f4176-openshift-service-ca\") pod \"maas-api-6c4df6cbf-fzkts\" (UID: \"f06c9d41-e061-42e2-8f06-9a3d749f4176\") " pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.176386 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.176330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f06c9d41-e061-42e2-8f06-9a3d749f4176-maas-api-tls\") pod \"maas-api-6c4df6cbf-fzkts\" (UID: \"f06c9d41-e061-42e2-8f06-9a3d749f4176\") " pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.277386 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.277306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f06c9d41-e061-42e2-8f06-9a3d749f4176-openshift-service-ca\") pod \"maas-api-6c4df6cbf-fzkts\" (UID: \"f06c9d41-e061-42e2-8f06-9a3d749f4176\") " pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.277386 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.277355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f06c9d41-e061-42e2-8f06-9a3d749f4176-maas-api-tls\") pod \"maas-api-6c4df6cbf-fzkts\" (UID: \"f06c9d41-e061-42e2-8f06-9a3d749f4176\") " pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.277563 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.277397    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvss7\" (UniqueName: \"kubernetes.io/projected/f06c9d41-e061-42e2-8f06-9a3d749f4176-kube-api-access-qvss7\") pod \"maas-api-6c4df6cbf-fzkts\" (UID: \"f06c9d41-e061-42e2-8f06-9a3d749f4176\") " pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.278004 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.277978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f06c9d41-e061-42e2-8f06-9a3d749f4176-openshift-service-ca\") pod \"maas-api-6c4df6cbf-fzkts\" (UID: \"f06c9d41-e061-42e2-8f06-9a3d749f4176\") " pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.279956 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.279936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f06c9d41-e061-42e2-8f06-9a3d749f4176-maas-api-tls\") pod \"maas-api-6c4df6cbf-fzkts\" (UID: \"f06c9d41-e061-42e2-8f06-9a3d749f4176\") " pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.286700 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.286669    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvss7\" (UniqueName: \"kubernetes.io/projected/f06c9d41-e061-42e2-8f06-9a3d749f4176-kube-api-access-qvss7\") pod \"maas-api-6c4df6cbf-fzkts\" (UID: \"f06c9d41-e061-42e2-8f06-9a3d749f4176\") " pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.319353 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.319333    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:43.378581 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.378172    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:43.471942 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.471872    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"]
Jul 10 14:41:43.474267 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:41:43.474241    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06c9d41_e061_42e2_8f06_9a3d749f4176.slice/crio-a4f680d777617d42b756d5e8e640e2079d9b10b12657a611e76779e5c02065b3 WatchSource:0}: Error finding container a4f680d777617d42b756d5e8e640e2079d9b10b12657a611e76779e5c02065b3: Status 404 returned error can't find the container with id a4f680d777617d42b756d5e8e640e2079d9b10b12657a611e76779e5c02065b3
Jul 10 14:41:43.475553 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.475537    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 14:41:43.521486 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.521461    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:43.526012 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.525969    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2nhzm"]
Jul 10 14:41:43.532099 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.532051    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-2nhzm"
Jul 10 14:41:43.534986 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.534967    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 10 14:41:43.535069 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.535012    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-d5tr9\""
Jul 10 14:41:43.541954 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.541933    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2nhzm"]
Jul 10 14:41:43.624368 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.624339    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:41:43.680912 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.680878    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9kzd\" (UniqueName: \"kubernetes.io/projected/7e9f548c-3396-4138-837d-6e9bb50158a6-kube-api-access-h9kzd\") pod \"payload-processing-58f86c7798-2nhzm\" (UID: \"7e9f548c-3396-4138-837d-6e9bb50158a6\") " pod="openshift-ingress/payload-processing-58f86c7798-2nhzm"
Jul 10 14:41:43.681062 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.680926    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e9f548c-3396-4138-837d-6e9bb50158a6-plugins-config-volume\") pod \"payload-processing-58f86c7798-2nhzm\" (UID: \"7e9f548c-3396-4138-837d-6e9bb50158a6\") " pod="openshift-ingress/payload-processing-58f86c7798-2nhzm"
Jul 10 14:41:43.782388 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.782300    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9kzd\" (UniqueName: \"kubernetes.io/projected/7e9f548c-3396-4138-837d-6e9bb50158a6-kube-api-access-h9kzd\") pod \"payload-processing-58f86c7798-2nhzm\" (UID: \"7e9f548c-3396-4138-837d-6e9bb50158a6\") " pod="openshift-ingress/payload-processing-58f86c7798-2nhzm"
Jul 10 14:41:43.782388 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.782366    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e9f548c-3396-4138-837d-6e9bb50158a6-plugins-config-volume\") pod \"payload-processing-58f86c7798-2nhzm\" (UID: \"7e9f548c-3396-4138-837d-6e9bb50158a6\") " pod="openshift-ingress/payload-processing-58f86c7798-2nhzm"
Jul 10 14:41:43.783170 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.783146    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e9f548c-3396-4138-837d-6e9bb50158a6-plugins-config-volume\") pod \"payload-processing-58f86c7798-2nhzm\" (UID: \"7e9f548c-3396-4138-837d-6e9bb50158a6\") " pod="openshift-ingress/payload-processing-58f86c7798-2nhzm"
Jul 10 14:41:43.798436 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.798411    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9kzd\" (UniqueName: \"kubernetes.io/projected/7e9f548c-3396-4138-837d-6e9bb50158a6-kube-api-access-h9kzd\") pod \"payload-processing-58f86c7798-2nhzm\" (UID: \"7e9f548c-3396-4138-837d-6e9bb50158a6\") " pod="openshift-ingress/payload-processing-58f86c7798-2nhzm"
Jul 10 14:41:43.844700 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.844672    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-2nhzm"
Jul 10 14:41:43.984305 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:43.984281    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2nhzm"]
Jul 10 14:41:43.986268 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:41:43.986243    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e9f548c_3396_4138_837d_6e9bb50158a6.slice/crio-4fc15223d788f063b0b6fb04e9324f27c9f33d615b0e70aa38e4f1c4b77e5ff1 WatchSource:0}: Error finding container 4fc15223d788f063b0b6fb04e9324f27c9f33d615b0e70aa38e4f1c4b77e5ff1: Status 404 returned error can't find the container with id 4fc15223d788f063b0b6fb04e9324f27c9f33d615b0e70aa38e4f1c4b77e5ff1
Jul 10 14:41:44.462777 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:44.462714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-2nhzm" event={"ID":"7e9f548c-3396-4138-837d-6e9bb50158a6","Type":"ContainerStarted","Data":"4fc15223d788f063b0b6fb04e9324f27c9f33d615b0e70aa38e4f1c4b77e5ff1"}
Jul 10 14:41:44.464605 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:44.464543    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts" event={"ID":"f06c9d41-e061-42e2-8f06-9a3d749f4176","Type":"ContainerStarted","Data":"a4f680d777617d42b756d5e8e640e2079d9b10b12657a611e76779e5c02065b3"}
Jul 10 14:41:46.478241 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:46.478204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-2nhzm" event={"ID":"7e9f548c-3396-4138-837d-6e9bb50158a6","Type":"ContainerStarted","Data":"75bd2d4fc52901403567bd84b0b5afa177c32bd2552a4d221d1168081b08a8ec"}
Jul 10 14:41:46.478717 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:46.478367    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-2nhzm"
Jul 10 14:41:46.479744 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:46.479718    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts" event={"ID":"f06c9d41-e061-42e2-8f06-9a3d749f4176","Type":"ContainerStarted","Data":"9aef01c01f67f997721215ae69f219d1b5f6853bfa3cab03f3eab1ee7fdcca5a"}
Jul 10 14:41:46.479895 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:46.479851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:46.495772 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:46.495694    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-2nhzm" podStartSLOduration=1.664243045 podStartE2EDuration="3.495680734s" totalImagesPullingTime="1.831437689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:41:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:41:46.494129322 +0000 UTC m=+618.447019400" watchObservedRunningTime="2026-07-10 14:41:46.495680734 +0000 UTC m=+618.448570811"
Jul 10 14:41:46.513870 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:46.513822    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts" podStartSLOduration=2.171691974 podStartE2EDuration="4.513809228s" totalImagesPullingTime="2.342117254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:41:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:41:46.511688234 +0000 UTC m=+618.464578312" watchObservedRunningTime="2026-07-10 14:41:46.513809228 +0000 UTC m=+618.466699304"
Jul 10 14:41:51.509654 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:51.509620    2564 generic.go:356] "Generic (PLEG): container finished" podID="3e5cd76b-5232-479b-8568-ce9eaa22d341" containerID="9e21b436b06d4c626dff188326bb51fa928694a31705d6e9088b03d0ab140938" exitCode=0
Jul 10 14:41:51.510082 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:51.509694    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6" event={"ID":"3e5cd76b-5232-479b-8568-ce9eaa22d341","Type":"ContainerDied","Data":"9e21b436b06d4c626dff188326bb51fa928694a31705d6e9088b03d0ab140938"}
Jul 10 14:41:51.510183 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:51.510163    2564 scope.go:117] "RemoveContainer" containerID="9e21b436b06d4c626dff188326bb51fa928694a31705d6e9088b03d0ab140938"
Jul 10 14:41:51.511108 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:51.511083    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:41:51.511172 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:51.511143    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:41:51.511209 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:51.511173    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:41:52.493863 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:52.493829    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6c4df6cbf-fzkts"
Jul 10 14:41:52.524337 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:52.524297    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6" event={"ID":"3e5cd76b-5232-479b-8568-ce9eaa22d341","Type":"ContainerStarted","Data":"26b3edc2882119a92b4ffd37d15bdd26fee39e6d26fbc123885aefcd8f806428"}
Jul 10 14:41:52.620924 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:52.620891    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:41:52.621165 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:52.621144    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9b5v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 10 14:41:52.621222 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:52.621205    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6" podUID="3e5cd76b-5232-479b-8568-ce9eaa22d341" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 10 14:41:53.561959 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:53.561921    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:53.621392 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:53.621357    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9b5v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 10 14:41:53.621554 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:53.621428    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6" podUID="3e5cd76b-5232-479b-8568-ce9eaa22d341" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 10 14:41:53.656328 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:53.656291    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:41:54.621565 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:54.621537    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9b5v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 10 14:41:54.621971 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:54.621594    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6" podUID="3e5cd76b-5232-479b-8568-ce9eaa22d341" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 10 14:41:55.621093 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:55.621053    2564 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9b5v6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 10 14:41:55.621271 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:55.621117    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6" podUID="3e5cd76b-5232-479b-8568-ce9eaa22d341" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 10 14:41:56.680484 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:56.680453    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:41:56.680889 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:56.680792    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:41:56.681456 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:56.681438    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9b5v6"
Jul 10 14:41:57.487397 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:41:57.487369    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-2nhzm"
Jul 10 14:42:08.785983 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.785952    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"]
Jul 10 14:42:08.789925 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.789902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:08.793014 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.792711    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 14:42:08.794712 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.794175    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 14:42:08.794712 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.794202    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 10 14:42:08.794712 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.794486    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2dj76\""
Jul 10 14:42:08.799801 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.799777    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"]
Jul 10 14:42:08.815140 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.815091    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:42:08.907547 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.907510    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:08.907547 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.907553    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:08.907780 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.907584    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:08.907780 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.907632    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwtvv\" (UniqueName: \"kubernetes.io/projected/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-kube-api-access-pwtvv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:08.907780 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.907652    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:08.907780 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:08.907672    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.008455 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.008409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.008645 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.008466    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.008645 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.008496    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwtvv\" (UniqueName: \"kubernetes.io/projected/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-kube-api-access-pwtvv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.008645 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.008515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.008645 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.008536    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.008645 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.008618    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.009031 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.009004    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.009098 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.009041    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.009160 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.009087    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.011024 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.011000    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.011305 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.011289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.017240 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.017202    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwtvv\" (UniqueName: \"kubernetes.io/projected/a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15-kube-api-access-pwtvv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj\" (UID: \"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.104247 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.104174    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:09.241185 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.241140    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"]
Jul 10 14:42:09.242578 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:42:09.242550    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ad0d22_33b3_4eb8_8d4d_59c2eebf9e15.slice/crio-32d8ccf68ca028ce362c3516ed659582d4bbaf3a9201254118ef5ca320d254e9 WatchSource:0}: Error finding container 32d8ccf68ca028ce362c3516ed659582d4bbaf3a9201254118ef5ca320d254e9: Status 404 returned error can't find the container with id 32d8ccf68ca028ce362c3516ed659582d4bbaf3a9201254118ef5ca320d254e9
Jul 10 14:42:09.293985 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.293955    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:42:09.625202 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:09.625159    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj" event={"ID":"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15","Type":"ContainerStarted","Data":"32d8ccf68ca028ce362c3516ed659582d4bbaf3a9201254118ef5ca320d254e9"}
Jul 10 14:42:10.631745 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:10.631705    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj" event={"ID":"a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15","Type":"ContainerStarted","Data":"1ebdfce05c1b1e2fd1a21f42619ad804257761676197cac5e46f5984fa162b22"}
Jul 10 14:42:10.650926 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:10.650881    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj" podStartSLOduration=1.424254759 podStartE2EDuration="2.650864177s" totalImagesPullingTime="1.226609418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:42:10.649116434 +0000 UTC m=+642.602006511" watchObservedRunningTime="2026-07-10 14:42:10.650864177 +0000 UTC m=+642.603754253"
Jul 10 14:42:10.911218 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:10.911186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:42:19.104287 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:19.104242    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:19.104743 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:19.104318    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:19.116834 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:19.116812    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:19.691139 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:19.691112    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj"
Jul 10 14:42:25.321967 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:25.321935    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:42:27.519637 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:27.519601    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:42:28.299713 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:28.299676    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:42:35.881846 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:35.881813    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:42:36.703547 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:36.703500    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:42:37.134490 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:37.134458    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:42:52.331975 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:52.331929    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:42:53.989440 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:42:53.989400    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:43:01.622737 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:43:01.622705    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:43:03.594055 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:43:03.594016    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:43:07.609543 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:43:07.609510    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:43:07.710571 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:43:07.710536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:43:11.242281 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:43:11.242244    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:43:13.697946 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:43:13.697915    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:44:31.334247 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.334201    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86cc75879-4rfjk"]
Jul 10 14:44:31.337648 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.337626    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86cc75879-4rfjk"
Jul 10 14:44:31.341676 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.341651    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zmhrc\""
Jul 10 14:44:31.341822 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.341653    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 10 14:44:31.345558 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.345539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86cc75879-4rfjk"]
Jul 10 14:44:31.425466 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.425439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlttt\" (UniqueName: \"kubernetes.io/projected/76c7b395-1671-42ae-823f-d986a8c1406e-kube-api-access-vlttt\") pod \"authorino-86cc75879-4rfjk\" (UID: \"76c7b395-1671-42ae-823f-d986a8c1406e\") " pod="kuadrant-system/authorino-86cc75879-4rfjk"
Jul 10 14:44:31.425614 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.425491    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76c7b395-1671-42ae-823f-d986a8c1406e-tls-cert\") pod \"authorino-86cc75879-4rfjk\" (UID: \"76c7b395-1671-42ae-823f-d986a8c1406e\") " pod="kuadrant-system/authorino-86cc75879-4rfjk"
Jul 10 14:44:31.525963 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.525935    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlttt\" (UniqueName: \"kubernetes.io/projected/76c7b395-1671-42ae-823f-d986a8c1406e-kube-api-access-vlttt\") pod \"authorino-86cc75879-4rfjk\" (UID: \"76c7b395-1671-42ae-823f-d986a8c1406e\") " pod="kuadrant-system/authorino-86cc75879-4rfjk"
Jul 10 14:44:31.526157 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.526012    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76c7b395-1671-42ae-823f-d986a8c1406e-tls-cert\") pod \"authorino-86cc75879-4rfjk\" (UID: \"76c7b395-1671-42ae-823f-d986a8c1406e\") " pod="kuadrant-system/authorino-86cc75879-4rfjk"
Jul 10 14:44:31.528933 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.528907    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/76c7b395-1671-42ae-823f-d986a8c1406e-tls-cert\") pod \"authorino-86cc75879-4rfjk\" (UID: \"76c7b395-1671-42ae-823f-d986a8c1406e\") " pod="kuadrant-system/authorino-86cc75879-4rfjk"
Jul 10 14:44:31.536523 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.536499    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlttt\" (UniqueName: \"kubernetes.io/projected/76c7b395-1671-42ae-823f-d986a8c1406e-kube-api-access-vlttt\") pod \"authorino-86cc75879-4rfjk\" (UID: \"76c7b395-1671-42ae-823f-d986a8c1406e\") " pod="kuadrant-system/authorino-86cc75879-4rfjk"
Jul 10 14:44:31.648385 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.648350    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86cc75879-4rfjk"
Jul 10 14:44:31.802453 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:31.802285    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86cc75879-4rfjk"]
Jul 10 14:44:31.805150 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:44:31.805122    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76c7b395_1671_42ae_823f_d986a8c1406e.slice/crio-2fad29ac24e9e3d0f7ea051ae850a66a977a895f9e9782ad53ee1d1adf359c60 WatchSource:0}: Error finding container 2fad29ac24e9e3d0f7ea051ae850a66a977a895f9e9782ad53ee1d1adf359c60: Status 404 returned error can't find the container with id 2fad29ac24e9e3d0f7ea051ae850a66a977a895f9e9782ad53ee1d1adf359c60
Jul 10 14:44:32.167054 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:32.167008    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:44:32.266933 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:32.266900    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:44:32.388246 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:32.388202    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86cc75879-4rfjk" event={"ID":"76c7b395-1671-42ae-823f-d986a8c1406e","Type":"ContainerStarted","Data":"2fad29ac24e9e3d0f7ea051ae850a66a977a895f9e9782ad53ee1d1adf359c60"}
Jul 10 14:44:33.395164 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:33.395121    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86cc75879-4rfjk" event={"ID":"76c7b395-1671-42ae-823f-d986a8c1406e","Type":"ContainerStarted","Data":"d458cc532bf9623560706625720909891812e79839d6b34b08acbd7a069ab5bf"}
Jul 10 14:44:33.415802 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:33.415718    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86cc75879-4rfjk" podStartSLOduration=1.791295036 podStartE2EDuration="2.415696548s" totalImagesPullingTime="624.401512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:44:33.41169207 +0000 UTC m=+785.364582149" watchObservedRunningTime="2026-07-10 14:44:33.415696548 +0000 UTC m=+785.368586623"
Jul 10 14:44:34.116430 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:34.116399    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:44:34.217227 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:34.217191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:44:44.854270 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:44:44.854228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:45:00.143343 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:00.143258    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq"]
Jul 10 14:45:00.146927 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:00.146907    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq"
Jul 10 14:45:00.149362 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:00.149343    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s85l5\""
Jul 10 14:45:00.153788 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:00.153767    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq"]
Jul 10 14:45:00.158572 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:00.158554    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq"
Jul 10 14:45:00.290306 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:00.290276    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq"]
Jul 10 14:45:00.293532 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:45:00.293500    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d7fd2f_8b9b_4f07_abdb_f0fff766706b.slice/crio-a4329786cc9d5e68d014901aba9bf6de5305d87072985c6599cd3f20c120c80e WatchSource:0}: Error finding container a4329786cc9d5e68d014901aba9bf6de5305d87072985c6599cd3f20c120c80e: Status 404 returned error can't find the container with id a4329786cc9d5e68d014901aba9bf6de5305d87072985c6599cd3f20c120c80e
Jul 10 14:45:00.541860 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:00.541778    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq" event={"ID":"94d7fd2f-8b9b-4f07-abdb-f0fff766706b","Type":"ContainerStarted","Data":"a4329786cc9d5e68d014901aba9bf6de5305d87072985c6599cd3f20c120c80e"}
Jul 10 14:45:03.445853 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:03.445801    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:45:03.560237 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:03.560203    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq" event={"ID":"94d7fd2f-8b9b-4f07-abdb-f0fff766706b","Type":"ContainerStarted","Data":"97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae"}
Jul 10 14:45:03.576155 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:03.576098    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq" podStartSLOduration=1.301634896 podStartE2EDuration="3.576082789s" totalImagesPullingTime="2.274447893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:45:03.57557891 +0000 UTC m=+815.528468986" watchObservedRunningTime="2026-07-10 14:45:03.576082789 +0000 UTC m=+815.528972886"
Jul 10 14:45:17.698093 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:17.698049    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:45:28.591208 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:28.591173    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:45:39.491517 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:39.491483    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:45:48.594253 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:48.594222    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:45:59.692830 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:45:59.692797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:46:00.011123 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:00.011041    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq"]
Jul 10 14:46:00.011275 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:00.011255    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq" podUID="94d7fd2f-8b9b-4f07-abdb-f0fff766706b" containerName="cleanup" containerID="cri-o://97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae" gracePeriod=30
Jul 10 14:46:01.861733 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:01.861690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:46:01.969888 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:01.969855    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdcdc785b-z6dlg"]
Jul 10 14:46:01.970101 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:01.970078    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg" podUID="7cb017de-dd82-4514-82ea-b1c26fa77311" containerName="manager" containerID="cri-o://6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac" gracePeriod=30
Jul 10 14:46:02.220169 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.220142    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:46:02.319966 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.319933    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cb017de-dd82-4514-82ea-b1c26fa77311-webhook-cert\") pod \"7cb017de-dd82-4514-82ea-b1c26fa77311\" (UID: \"7cb017de-dd82-4514-82ea-b1c26fa77311\") "
Jul 10 14:46:02.319966 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.319970    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn9g6\" (UniqueName: \"kubernetes.io/projected/7cb017de-dd82-4514-82ea-b1c26fa77311-kube-api-access-cn9g6\") pod \"7cb017de-dd82-4514-82ea-b1c26fa77311\" (UID: \"7cb017de-dd82-4514-82ea-b1c26fa77311\") "
Jul 10 14:46:02.322138 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.322113    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cb017de-dd82-4514-82ea-b1c26fa77311-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7cb017de-dd82-4514-82ea-b1c26fa77311" (UID: "7cb017de-dd82-4514-82ea-b1c26fa77311"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:46:02.322255 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.322227    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cb017de-dd82-4514-82ea-b1c26fa77311-kube-api-access-cn9g6" (OuterVolumeSpecName: "kube-api-access-cn9g6") pod "7cb017de-dd82-4514-82ea-b1c26fa77311" (UID: "7cb017de-dd82-4514-82ea-b1c26fa77311"). InnerVolumeSpecName "kube-api-access-cn9g6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:46:02.420740 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.420669    2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cb017de-dd82-4514-82ea-b1c26fa77311-webhook-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:46:02.420740 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.420698    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn9g6\" (UniqueName: \"kubernetes.io/projected/7cb017de-dd82-4514-82ea-b1c26fa77311-kube-api-access-cn9g6\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:46:02.882293 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.882259    2564 generic.go:356] "Generic (PLEG): container finished" podID="7cb017de-dd82-4514-82ea-b1c26fa77311" containerID="6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac" exitCode=0
Jul 10 14:46:02.882689 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.882302    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg"
Jul 10 14:46:02.882689 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.882336    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg" event={"ID":"7cb017de-dd82-4514-82ea-b1c26fa77311","Type":"ContainerDied","Data":"6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac"}
Jul 10 14:46:02.882689 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.882385    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdcdc785b-z6dlg" event={"ID":"7cb017de-dd82-4514-82ea-b1c26fa77311","Type":"ContainerDied","Data":"22bf536861aafee2f10fafa7b6aa545dd05a7c7dcdf6666256621c62f2a3098b"}
Jul 10 14:46:02.882689 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.882408    2564 scope.go:117] "RemoveContainer" containerID="6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac"
Jul 10 14:46:02.891836 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.891817    2564 scope.go:117] "RemoveContainer" containerID="6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac"
Jul 10 14:46:02.892066 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:46:02.892052    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac\": container with ID starting with 6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac not found: ID does not exist" containerID="6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac"
Jul 10 14:46:02.892114 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.892074    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac"} err="failed to get container status \"6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac\": rpc error: code = NotFound desc = could not find container \"6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac\": container with ID starting with 6dea27f8bb2ebfd5ef00b1dcdfdcd4e6dbe0dea11f0cbc4bf840970e7c5e89ac not found: ID does not exist"
Jul 10 14:46:02.900953 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.900922    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cdcdc785b-z6dlg"]
Jul 10 14:46:02.904769 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:02.904738    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cdcdc785b-z6dlg"]
Jul 10 14:46:03.639570 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.639529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:46:03.789077 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.789048    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cdcdc785b-x546f"]
Jul 10 14:46:03.789438 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.789426    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cb017de-dd82-4514-82ea-b1c26fa77311" containerName="manager"
Jul 10 14:46:03.789479 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.789440    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cb017de-dd82-4514-82ea-b1c26fa77311" containerName="manager"
Jul 10 14:46:03.789514 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.789507    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cb017de-dd82-4514-82ea-b1c26fa77311" containerName="manager"
Jul 10 14:46:03.793842 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.793821    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdcdc785b-x546f"
Jul 10 14:46:03.798165 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.798144    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-z28dn\""
Jul 10 14:46:03.798290 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.798177    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 14:46:03.798290 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.798183    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 14:46:03.803562 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.803542    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdcdc785b-x546f"]
Jul 10 14:46:03.934251 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.934169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlswp\" (UniqueName: \"kubernetes.io/projected/bf4f7402-132b-40ea-b5e4-2aab58b4394f-kube-api-access-rlswp\") pod \"maas-controller-7cdcdc785b-x546f\" (UID: \"bf4f7402-132b-40ea-b5e4-2aab58b4394f\") " pod="opendatahub/maas-controller-7cdcdc785b-x546f"
Jul 10 14:46:03.934251 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:03.934231    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf4f7402-132b-40ea-b5e4-2aab58b4394f-webhook-cert\") pod \"maas-controller-7cdcdc785b-x546f\" (UID: \"bf4f7402-132b-40ea-b5e4-2aab58b4394f\") " pod="opendatahub/maas-controller-7cdcdc785b-x546f"
Jul 10 14:46:04.035476 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.035436    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf4f7402-132b-40ea-b5e4-2aab58b4394f-webhook-cert\") pod \"maas-controller-7cdcdc785b-x546f\" (UID: \"bf4f7402-132b-40ea-b5e4-2aab58b4394f\") " pod="opendatahub/maas-controller-7cdcdc785b-x546f"
Jul 10 14:46:04.035611 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.035570    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlswp\" (UniqueName: \"kubernetes.io/projected/bf4f7402-132b-40ea-b5e4-2aab58b4394f-kube-api-access-rlswp\") pod \"maas-controller-7cdcdc785b-x546f\" (UID: \"bf4f7402-132b-40ea-b5e4-2aab58b4394f\") " pod="opendatahub/maas-controller-7cdcdc785b-x546f"
Jul 10 14:46:04.037929 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.037910    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf4f7402-132b-40ea-b5e4-2aab58b4394f-webhook-cert\") pod \"maas-controller-7cdcdc785b-x546f\" (UID: \"bf4f7402-132b-40ea-b5e4-2aab58b4394f\") " pod="opendatahub/maas-controller-7cdcdc785b-x546f"
Jul 10 14:46:04.044720 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.044697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlswp\" (UniqueName: \"kubernetes.io/projected/bf4f7402-132b-40ea-b5e4-2aab58b4394f-kube-api-access-rlswp\") pod \"maas-controller-7cdcdc785b-x546f\" (UID: \"bf4f7402-132b-40ea-b5e4-2aab58b4394f\") " pod="opendatahub/maas-controller-7cdcdc785b-x546f"
Jul 10 14:46:04.104585 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.104561    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cdcdc785b-x546f"
Jul 10 14:46:04.242782 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.242731    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cdcdc785b-x546f"]
Jul 10 14:46:04.243320 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:46:04.243288    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf4f7402_132b_40ea_b5e4_2aab58b4394f.slice/crio-08942673cddf824a061525035c8fb537390fd8eab0b67920a377d907afe549d9 WatchSource:0}: Error finding container 08942673cddf824a061525035c8fb537390fd8eab0b67920a377d907afe549d9: Status 404 returned error can't find the container with id 08942673cddf824a061525035c8fb537390fd8eab0b67920a377d907afe549d9
Jul 10 14:46:04.566045 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.565955    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cb017de-dd82-4514-82ea-b1c26fa77311" path="/var/lib/kubelet/pods/7cb017de-dd82-4514-82ea-b1c26fa77311/volumes"
Jul 10 14:46:04.898458 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.898434    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdcdc785b-x546f" event={"ID":"bf4f7402-132b-40ea-b5e4-2aab58b4394f","Type":"ContainerStarted","Data":"cb9d3bd1bd367c41946639b123e27478500a57b45c11c032a5ef702098403ba4"}
Jul 10 14:46:04.898549 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.898484    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cdcdc785b-x546f" event={"ID":"bf4f7402-132b-40ea-b5e4-2aab58b4394f","Type":"ContainerStarted","Data":"08942673cddf824a061525035c8fb537390fd8eab0b67920a377d907afe549d9"}
Jul 10 14:46:04.898618 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.898603    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cdcdc785b-x546f"
Jul 10 14:46:04.917878 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:04.917828    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cdcdc785b-x546f" podStartSLOduration=1.327440977 podStartE2EDuration="1.917812753s" totalImagesPullingTime="590.371776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:46:04.916839796 +0000 UTC m=+876.869729874" watchObservedRunningTime="2026-07-10 14:46:04.917812753 +0000 UTC m=+876.870702856"
Jul 10 14:46:05.252954 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:05.252919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:46:15.909881 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:15.909851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cdcdc785b-x546f"
Jul 10 14:46:28.483737 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:28.483671    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:46:28.484899 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:28.484874    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:46:29.795644 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:29.795611    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:46:30.226657 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:30.226626    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq"
Jul 10 14:46:31.044246 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:31.044204    2564 generic.go:356] "Generic (PLEG): container finished" podID="94d7fd2f-8b9b-4f07-abdb-f0fff766706b" containerID="97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae" exitCode=137
Jul 10 14:46:31.044246 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:31.044248    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq"
Jul 10 14:46:31.044851 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:31.044280    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq" event={"ID":"94d7fd2f-8b9b-4f07-abdb-f0fff766706b","Type":"ContainerDied","Data":"97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae"}
Jul 10 14:46:31.044851 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:31.044342    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq" event={"ID":"94d7fd2f-8b9b-4f07-abdb-f0fff766706b","Type":"ContainerDied","Data":"a4329786cc9d5e68d014901aba9bf6de5305d87072985c6599cd3f20c120c80e"}
Jul 10 14:46:31.044851 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:31.044373    2564 scope.go:117] "RemoveContainer" containerID="97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae"
Jul 10 14:46:31.057023 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:31.057002    2564 scope.go:117] "RemoveContainer" containerID="97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae"
Jul 10 14:46:31.057355 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:46:31.057330    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae\": container with ID starting with 97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae not found: ID does not exist" containerID="97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae"
Jul 10 14:46:31.057424 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:31.057369    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae"} err="failed to get container status \"97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae\": rpc error: code = NotFound desc = could not find container \"97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae\": container with ID starting with 97cce681c98cac3965436dd54f88bcfa94ca68e51b941744e6c77ea146207dae not found: ID does not exist"
Jul 10 14:46:31.070836 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:31.070809    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq"]
Jul 10 14:46:31.074292 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:31.074269    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728245-wh7rq"]
Jul 10 14:46:32.565862 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:32.565829    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94d7fd2f-8b9b-4f07-abdb-f0fff766706b" path="/var/lib/kubelet/pods/94d7fd2f-8b9b-4f07-abdb-f0fff766706b/volumes"
Jul 10 14:46:42.299393 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:42.299351    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:46:46.904640 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:46.904588    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:46:48.251260 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:48.251226    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:46:52.908649 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:52.908617    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:46:53.017708 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:53.017670    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:46:53.109892 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:53.109853    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:46:53.304352 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:53.304267    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:46:58.964600 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:58.964569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:46:59.026393 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:46:59.026359    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:47:15.094104 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:47:15.094065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:47:22.888889 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:47:22.888854    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:47:33.491659 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:47:33.491622    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:47:41.800094 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:47:41.800062    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:47:48.446107 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:47:48.446072    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:47:48.545708 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:47:48.545674    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:47:53.388374 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:47:53.388331    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:48:03.197574 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:48:03.197534    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:48:13.683470 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:48:13.683431    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:48:23.685405 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:48:23.685369    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:48:46.202856 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:48:46.202824    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:48:55.897430 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:48:55.897397    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:49:18.893847 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:49:18.893744    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:49:29.596007 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:49:29.595972    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:49:36.698661 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:49:36.698614    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:49:48.090305 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:49:48.090262    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:50:05.193081 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:05.193042    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:50:18.891297 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:18.891262    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:50:28.598332 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:28.598301    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:50:53.373697 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:53.373606    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"]
Jul 10 14:50:53.374307 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:53.373919    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw" podUID="40c302c8-5f10-4e62-b02d-d66954a68979" containerName="manager" containerID="cri-o://1061604a1bc458bc1c16785b9c8781061445625d260ada4b9336724bca564d8b" gracePeriod=10
Jul 10 14:50:57.497700 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:57.497668    2564 generic.go:356] "Generic (PLEG): container finished" podID="40c302c8-5f10-4e62-b02d-d66954a68979" containerID="1061604a1bc458bc1c16785b9c8781061445625d260ada4b9336724bca564d8b" exitCode=0
Jul 10 14:50:57.498102 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:57.497736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw" event={"ID":"40c302c8-5f10-4e62-b02d-d66954a68979","Type":"ContainerDied","Data":"1061604a1bc458bc1c16785b9c8781061445625d260ada4b9336724bca564d8b"}
Jul 10 14:50:57.727588 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:57.727562    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:50:57.845144 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:57.845065    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40c302c8-5f10-4e62-b02d-d66954a68979-extensions-socket-volume\") pod \"40c302c8-5f10-4e62-b02d-d66954a68979\" (UID: \"40c302c8-5f10-4e62-b02d-d66954a68979\") "
Jul 10 14:50:57.845289 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:57.845160    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gtst\" (UniqueName: \"kubernetes.io/projected/40c302c8-5f10-4e62-b02d-d66954a68979-kube-api-access-7gtst\") pod \"40c302c8-5f10-4e62-b02d-d66954a68979\" (UID: \"40c302c8-5f10-4e62-b02d-d66954a68979\") "
Jul 10 14:50:57.845430 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:57.845409    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40c302c8-5f10-4e62-b02d-d66954a68979-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "40c302c8-5f10-4e62-b02d-d66954a68979" (UID: "40c302c8-5f10-4e62-b02d-d66954a68979"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:50:57.847311 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:57.847283    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40c302c8-5f10-4e62-b02d-d66954a68979-kube-api-access-7gtst" (OuterVolumeSpecName: "kube-api-access-7gtst") pod "40c302c8-5f10-4e62-b02d-d66954a68979" (UID: "40c302c8-5f10-4e62-b02d-d66954a68979"). InnerVolumeSpecName "kube-api-access-7gtst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:50:57.946509 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:57.946478    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gtst\" (UniqueName: \"kubernetes.io/projected/40c302c8-5f10-4e62-b02d-d66954a68979-kube-api-access-7gtst\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:50:57.946509 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:57.946505    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/40c302c8-5f10-4e62-b02d-d66954a68979-extensions-socket-volume\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:50:58.504794 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:58.504741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw" event={"ID":"40c302c8-5f10-4e62-b02d-d66954a68979","Type":"ContainerDied","Data":"34cfc9b136bde0a359979405bfaa005c0c1d088b7aa4bdf5f24d2a11acc790d4"}
Jul 10 14:50:58.504794 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:58.504785    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"
Jul 10 14:50:58.505281 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:58.504823    2564 scope.go:117] "RemoveContainer" containerID="1061604a1bc458bc1c16785b9c8781061445625d260ada4b9336724bca564d8b"
Jul 10 14:50:58.527355 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:58.527321    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"]
Jul 10 14:50:58.532863 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:58.532839    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-f7zzw"]
Jul 10 14:50:58.565850 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:58.565819    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40c302c8-5f10-4e62-b02d-d66954a68979" path="/var/lib/kubelet/pods/40c302c8-5f10-4e62-b02d-d66954a68979/volumes"
Jul 10 14:50:59.132839 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:50:59.132810    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:51:28.516451 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:28.516418    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:51:28.518917 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:28.518893    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:51:54.603458 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.603422    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"]
Jul 10 14:51:54.605831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.603795    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d7fd2f-8b9b-4f07-abdb-f0fff766706b" containerName="cleanup"
Jul 10 14:51:54.605831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.603809    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d7fd2f-8b9b-4f07-abdb-f0fff766706b" containerName="cleanup"
Jul 10 14:51:54.605831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.603821    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40c302c8-5f10-4e62-b02d-d66954a68979" containerName="manager"
Jul 10 14:51:54.605831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.603826    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c302c8-5f10-4e62-b02d-d66954a68979" containerName="manager"
Jul 10 14:51:54.605831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.603891    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d7fd2f-8b9b-4f07-abdb-f0fff766706b" containerName="cleanup"
Jul 10 14:51:54.605831 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.603918    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="40c302c8-5f10-4e62-b02d-d66954a68979" containerName="manager"
Jul 10 14:51:54.606888 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.606872    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"
Jul 10 14:51:54.609430 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.609408    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-68hvr\""
Jul 10 14:51:54.619352 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.619328    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"]
Jul 10 14:51:54.655223 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.655194    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2p74\" (UniqueName: \"kubernetes.io/projected/2ef64430-eeb7-4279-8d68-fc339a84e8d7-kube-api-access-l2p74\") pod \"kuadrant-operator-controller-manager-86878c769f-twbrm\" (UID: \"2ef64430-eeb7-4279-8d68-fc339a84e8d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"
Jul 10 14:51:54.655223 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.655226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ef64430-eeb7-4279-8d68-fc339a84e8d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-twbrm\" (UID: \"2ef64430-eeb7-4279-8d68-fc339a84e8d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"
Jul 10 14:51:54.756142 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.756092    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2p74\" (UniqueName: \"kubernetes.io/projected/2ef64430-eeb7-4279-8d68-fc339a84e8d7-kube-api-access-l2p74\") pod \"kuadrant-operator-controller-manager-86878c769f-twbrm\" (UID: \"2ef64430-eeb7-4279-8d68-fc339a84e8d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"
Jul 10 14:51:54.756142 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.756146    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ef64430-eeb7-4279-8d68-fc339a84e8d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-twbrm\" (UID: \"2ef64430-eeb7-4279-8d68-fc339a84e8d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"
Jul 10 14:51:54.756549 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.756526    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ef64430-eeb7-4279-8d68-fc339a84e8d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-twbrm\" (UID: \"2ef64430-eeb7-4279-8d68-fc339a84e8d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"
Jul 10 14:51:54.766221 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.766193    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2p74\" (UniqueName: \"kubernetes.io/projected/2ef64430-eeb7-4279-8d68-fc339a84e8d7-kube-api-access-l2p74\") pod \"kuadrant-operator-controller-manager-86878c769f-twbrm\" (UID: \"2ef64430-eeb7-4279-8d68-fc339a84e8d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"
Jul 10 14:51:54.917150 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:54.917116    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"
Jul 10 14:51:55.069493 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:55.069466    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"]
Jul 10 14:51:55.071473 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:51:55.071449    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef64430_eeb7_4279_8d68_fc339a84e8d7.slice/crio-bc007f5cde6ef68cd16acb27c2323dea80fccf82b338eedfebdc4edb6209099c WatchSource:0}: Error finding container bc007f5cde6ef68cd16acb27c2323dea80fccf82b338eedfebdc4edb6209099c: Status 404 returned error can't find the container with id bc007f5cde6ef68cd16acb27c2323dea80fccf82b338eedfebdc4edb6209099c
Jul 10 14:51:55.802786 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:55.802734    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm" event={"ID":"2ef64430-eeb7-4279-8d68-fc339a84e8d7","Type":"ContainerStarted","Data":"74265dc40873101ee495f8908fbaf302fb226dbdf5eab298a87c4b012f0319c8"}
Jul 10 14:51:55.803167 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:55.802807    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm" event={"ID":"2ef64430-eeb7-4279-8d68-fc339a84e8d7","Type":"ContainerStarted","Data":"bc007f5cde6ef68cd16acb27c2323dea80fccf82b338eedfebdc4edb6209099c"}
Jul 10 14:51:55.803167 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:55.802833    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"
Jul 10 14:51:55.824811 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:51:55.824745    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm" podStartSLOduration=1.8247309 podStartE2EDuration="1.8247309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:51:55.821948311 +0000 UTC m=+1227.774838385" watchObservedRunningTime="2026-07-10 14:51:55.8247309 +0000 UTC m=+1227.777620976"
Jul 10 14:52:06.811059 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:52:06.811028    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twbrm"
Jul 10 14:52:14.494450 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:52:14.494418    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:52:25.997515 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:52:25.997438    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:52:35.492763 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:52:35.492726    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:52:44.692992 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:52:44.692952    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:52:53.991009 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:52:53.990975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:53:03.183284 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:53:03.183253    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:53:14.190682 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:53:14.190652    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:53:23.588227 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:53:23.588193    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:53:34.297229 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:53:34.297192    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:53:38.004153 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:53:38.004119    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:53:44.689731 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:53:44.689693    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:53:55.682151 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:53:55.682075    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:54:00.328603 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:54:00.328563    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:54:00.380816 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:54:00.380785    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:54:02.993276 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:54:02.993246    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:54:24.494089 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:54:24.494046    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:54:33.897400 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:54:33.897359    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:54:43.888699 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:54:43.888668    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:54:44.825714 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:54:44.825677    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:54:44.875363 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:54:44.875328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:54:53.789400 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:54:53.789365    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:55:01.584097 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:55:01.584058    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:55:17.894657 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:55:17.894613    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:55:27.491389 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:55:27.491310    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:55:37.288479 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:55:37.288444    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:55:47.788210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:55:47.788171    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:55:56.793988 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:55:56.793935    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:56:06.487228 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:56:06.487189    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:56:19.884368 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:56:19.884332    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:56:28.553309 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:56:28.553276    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:56:28.557663 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:56:28.557638    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 14:56:29.582047 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:56:29.582012    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:56:39.200111 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:56:39.200071    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:56:49.190108 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:56:49.190027    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:57:01.692658 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:57:01.692621    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:57:09.390280 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:57:09.390242    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:57:21.790812 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:57:21.790776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:57:31.189574 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:57:31.189537    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:57:40.983809 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:57:40.983776    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:57:50.194017 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:57:50.193979    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:57:57.303146 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:57:57.303110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:57:57.390868 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:57:57.390803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:02.862516 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:02.862480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:02.967256 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:02.967227    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:03.047037 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:03.047003    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:04.205240 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.205200    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:04.269930 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.269900    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"]
Jul 10 14:58:04.273481 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.273461    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:04.276285 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.276263    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-eec6a163-serving-cert\""
Jul 10 14:58:04.283995 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.283965    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"]
Jul 10 14:58:04.291826 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.287535    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:04.360588 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.360536    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:04.374713 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.374685    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90610454-ce09-4126-ba74-a21f0694ec44-openshift-service-ca\") pod \"maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:04.374877 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.374770    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90610454-ce09-4126-ba74-a21f0694ec44-maas-api-tls\") pod \"maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:04.374877 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.374822    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxzxn\" (UniqueName: \"kubernetes.io/projected/90610454-ce09-4126-ba74-a21f0694ec44-kube-api-access-zxzxn\") pod \"maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:04.476278 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.476202    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90610454-ce09-4126-ba74-a21f0694ec44-openshift-service-ca\") pod \"maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:04.476278 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.476247    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90610454-ce09-4126-ba74-a21f0694ec44-maas-api-tls\") pod \"maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:04.476493 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.476281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxzxn\" (UniqueName: \"kubernetes.io/projected/90610454-ce09-4126-ba74-a21f0694ec44-kube-api-access-zxzxn\") pod \"maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:04.476493 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:58:04.476411    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-serving-cert: secret "maas-api-e2e-ait-eec6a163-serving-cert" not found
Jul 10 14:58:04.476493 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:58:04.476491    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90610454-ce09-4126-ba74-a21f0694ec44-maas-api-tls podName:90610454-ce09-4126-ba74-a21f0694ec44 nodeName:}" failed. No retries permitted until 2026-07-10 14:58:04.976472993 +0000 UTC m=+1596.929363048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/90610454-ce09-4126-ba74-a21f0694ec44-maas-api-tls") pod "maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv" (UID: "90610454-ce09-4126-ba74-a21f0694ec44") : secret "maas-api-e2e-ait-eec6a163-serving-cert" not found
Jul 10 14:58:04.476952 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.476928    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90610454-ce09-4126-ba74-a21f0694ec44-openshift-service-ca\") pod \"maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:04.486649 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.486625    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxzxn\" (UniqueName: \"kubernetes.io/projected/90610454-ce09-4126-ba74-a21f0694ec44-kube-api-access-zxzxn\") pod \"maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:04.615423 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.615393    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:04.737842 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.737726    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:04.838290 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.838254    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:04.981626 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.981591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90610454-ce09-4126-ba74-a21f0694ec44-maas-api-tls\") pod \"maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:04.984147 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:04.984123    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90610454-ce09-4126-ba74-a21f0694ec44-maas-api-tls\") pod \"maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:05.185157 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:05.185121    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:05.331732 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:05.331710    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"]
Jul 10 14:58:05.334172 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:58:05.334147    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90610454_ce09_4126_ba74_a21f0694ec44.slice/crio-b74ec7bf9f7100823fa15f1ee84336dd4942c700ad8449387aae2b22012b2697 WatchSource:0}: Error finding container b74ec7bf9f7100823fa15f1ee84336dd4942c700ad8449387aae2b22012b2697: Status 404 returned error can't find the container with id b74ec7bf9f7100823fa15f1ee84336dd4942c700ad8449387aae2b22012b2697
Jul 10 14:58:05.335674 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:05.335653    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 14:58:05.846823 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:05.846789    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv" event={"ID":"90610454-ce09-4126-ba74-a21f0694ec44","Type":"ContainerStarted","Data":"b74ec7bf9f7100823fa15f1ee84336dd4942c700ad8449387aae2b22012b2697"}
Jul 10 14:58:06.665044 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:06.665013    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:06.853909 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:06.853874    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv" event={"ID":"90610454-ce09-4126-ba74-a21f0694ec44","Type":"ContainerStarted","Data":"4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a"}
Jul 10 14:58:06.854076 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:06.854007    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:06.876824 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:06.876773    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv" podStartSLOduration=2.325087087 podStartE2EDuration="2.876747622s" totalImagesPullingTime="551.660535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:58:06.874172539 +0000 UTC m=+1598.827062615" watchObservedRunningTime="2026-07-10 14:58:06.876747622 +0000 UTC m=+1598.829637722"
Jul 10 14:58:09.307917 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:09.307890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:09.537790 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:09.537734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:09.685376 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:09.685334    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:09.840962 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:09.840926    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"]
Jul 10 14:58:09.841196 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:09.841170    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv" podUID="90610454-ce09-4126-ba74-a21f0694ec44" containerName="maas-api" containerID="cri-o://4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a" gracePeriod=30
Jul 10 14:58:09.866249 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:09.866228    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:10.096277 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.096251    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:10.122940 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.122915    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxzxn\" (UniqueName: \"kubernetes.io/projected/90610454-ce09-4126-ba74-a21f0694ec44-kube-api-access-zxzxn\") pod \"90610454-ce09-4126-ba74-a21f0694ec44\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") "
Jul 10 14:58:10.123106 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.122963    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90610454-ce09-4126-ba74-a21f0694ec44-openshift-service-ca\") pod \"90610454-ce09-4126-ba74-a21f0694ec44\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") "
Jul 10 14:58:10.123106 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.122988    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90610454-ce09-4126-ba74-a21f0694ec44-maas-api-tls\") pod \"90610454-ce09-4126-ba74-a21f0694ec44\" (UID: \"90610454-ce09-4126-ba74-a21f0694ec44\") "
Jul 10 14:58:10.123333 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.123310    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90610454-ce09-4126-ba74-a21f0694ec44-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "90610454-ce09-4126-ba74-a21f0694ec44" (UID: "90610454-ce09-4126-ba74-a21f0694ec44"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:58:10.125219 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.125199    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90610454-ce09-4126-ba74-a21f0694ec44-kube-api-access-zxzxn" (OuterVolumeSpecName: "kube-api-access-zxzxn") pod "90610454-ce09-4126-ba74-a21f0694ec44" (UID: "90610454-ce09-4126-ba74-a21f0694ec44"). InnerVolumeSpecName "kube-api-access-zxzxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:58:10.125323 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.125305    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90610454-ce09-4126-ba74-a21f0694ec44-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "90610454-ce09-4126-ba74-a21f0694ec44" (UID: "90610454-ce09-4126-ba74-a21f0694ec44"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:58:10.224569 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.224486    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxzxn\" (UniqueName: \"kubernetes.io/projected/90610454-ce09-4126-ba74-a21f0694ec44-kube-api-access-zxzxn\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:10.224569 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.224517    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/90610454-ce09-4126-ba74-a21f0694ec44-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:10.224569 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.224530    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/90610454-ce09-4126-ba74-a21f0694ec44-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:10.876583 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.876546    2564 generic.go:356] "Generic (PLEG): container finished" podID="90610454-ce09-4126-ba74-a21f0694ec44" containerID="4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a" exitCode=0
Jul 10 14:58:10.876981 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.876592    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"
Jul 10 14:58:10.876981 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.876634    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv" event={"ID":"90610454-ce09-4126-ba74-a21f0694ec44","Type":"ContainerDied","Data":"4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a"}
Jul 10 14:58:10.876981 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.876712    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv" event={"ID":"90610454-ce09-4126-ba74-a21f0694ec44","Type":"ContainerDied","Data":"b74ec7bf9f7100823fa15f1ee84336dd4942c700ad8449387aae2b22012b2697"}
Jul 10 14:58:10.876981 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.876738    2564 scope.go:117] "RemoveContainer" containerID="4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a"
Jul 10 14:58:10.885688 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.885668    2564 scope.go:117] "RemoveContainer" containerID="4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a"
Jul 10 14:58:10.885973 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:58:10.885944    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a\": container with ID starting with 4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a not found: ID does not exist" containerID="4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a"
Jul 10 14:58:10.886054 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.885984    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a"} err="failed to get container status \"4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a\": rpc error: code = NotFound desc = could not find container \"4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a\": container with ID starting with 4b7d65ddfcef035ba8bf4c1141a49ed622e4651c107bdde9fa8c7ff6db69a42a not found: ID does not exist"
Jul 10 14:58:10.894182 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.894160    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"]
Jul 10 14:58:10.900085 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:10.900066    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eec6a163-586fc56c78-gxxcv"]
Jul 10 14:58:11.120953 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:11.120920    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:12.564423 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:12.564390    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90610454-ce09-4126-ba74-a21f0694ec44" path="/var/lib/kubelet/pods/90610454-ce09-4126-ba74-a21f0694ec44/volumes"
Jul 10 14:58:15.379167 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.379138    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:15.440836 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.440804    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:15.558765 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.558717    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"]
Jul 10 14:58:15.559137 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.559123    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90610454-ce09-4126-ba74-a21f0694ec44" containerName="maas-api"
Jul 10 14:58:15.559137 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.559138    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="90610454-ce09-4126-ba74-a21f0694ec44" containerName="maas-api"
Jul 10 14:58:15.559272 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.559202    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="90610454-ce09-4126-ba74-a21f0694ec44" containerName="maas-api"
Jul 10 14:58:15.563678 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.563655    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.566474 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.566454    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-95416e73-openshift-default-dockercfg-q562b\""
Jul 10 14:58:15.580341 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.580315    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"]
Jul 10 14:58:15.602693 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.602665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:15.669649 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.669573    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istiod-ca-cert\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.669649 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.669613    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-token\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.669891 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.669844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-podinfo\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.669965 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.669891    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-data\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.669965 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.669942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-credential-socket\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.670066 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.669970    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-certs\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.670103 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.670076    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-envoy\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.670103 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.670097    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-socket\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.670179 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.670142    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smb46\" (UniqueName: \"kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-kube-api-access-smb46\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.705032 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.705001    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:15.771382 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-podinfo\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771510 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771391    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-data\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771510 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771413    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-credential-socket\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771510 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-certs\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771510 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771457    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-envoy\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771510 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-socket\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771802 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771540    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smb46\" (UniqueName: \"kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-kube-api-access-smb46\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771802 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771579    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istiod-ca-cert\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771802 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-token\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771962 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771851    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-credential-socket\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771962 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771881    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-data\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.771962 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771912    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-certs\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.772057 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.771995    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-socket\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.772302 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.772284    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istiod-ca-cert\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.774023 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.774001    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-envoy\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.774132 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.774117    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-podinfo\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.779608 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.779584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-token\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.779687 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.779636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smb46\" (UniqueName: \"kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-kube-api-access-smb46\") pod \"e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") " pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.877988 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.877960    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:15.976126 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:15.976097    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:16.023324 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.023294    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"]
Jul 10 14:58:16.024746 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:58:16.024719    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81ef1dd_d99f_4b3d_b7f5_75a29c1eec32.slice/crio-816a40c97482793207d7f529e11cb6c12441e0acb558a5edc5a798f432ed4037 WatchSource:0}: Error finding container 816a40c97482793207d7f529e11cb6c12441e0acb558a5edc5a798f432ed4037: Status 404 returned error can't find the container with id 816a40c97482793207d7f529e11cb6c12441e0acb558a5edc5a798f432ed4037
Jul 10 14:58:16.026821 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.026790    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:58:16.026916 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.026852    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:58:16.026916 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.026879    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:58:16.814794 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.814735    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:16.897380 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.897343    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"]
Jul 10 14:58:16.898117 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.898090    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:16.901672 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.901652    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:16.904595 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.904575    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-95416e73-serving-cert\""
Jul 10 14:58:16.911829 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.911787    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"]
Jul 10 14:58:16.913854 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.913804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z" event={"ID":"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32","Type":"ContainerStarted","Data":"45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22"}
Jul 10 14:58:16.914003 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.913862    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z" event={"ID":"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32","Type":"ContainerStarted","Data":"816a40c97482793207d7f529e11cb6c12441e0acb558a5edc5a798f432ed4037"}
Jul 10 14:58:16.947888 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.947835    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z" podStartSLOduration=1.947819989 podStartE2EDuration="1.947819989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:58:16.944977417 +0000 UTC m=+1608.897867498" watchObservedRunningTime="2026-07-10 14:58:16.947819989 +0000 UTC m=+1608.900710065"
Jul 10 14:58:16.969556 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.969529    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:16.984668 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.984639    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e01e85-556d-42cf-8e88-61669511b759-openshift-service-ca\") pod \"maas-api-e2e-ait-95416e73-5b97c5d694-f48nm\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:16.984835 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.984689    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e01e85-556d-42cf-8e88-61669511b759-maas-api-tls\") pod \"maas-api-e2e-ait-95416e73-5b97c5d694-f48nm\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:16.984835 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:16.984821    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9xvd\" (UniqueName: \"kubernetes.io/projected/f4e01e85-556d-42cf-8e88-61669511b759-kube-api-access-m9xvd\") pod \"maas-api-e2e-ait-95416e73-5b97c5d694-f48nm\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:17.086054 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.085970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e01e85-556d-42cf-8e88-61669511b759-openshift-service-ca\") pod \"maas-api-e2e-ait-95416e73-5b97c5d694-f48nm\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:17.086054 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.086008    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e01e85-556d-42cf-8e88-61669511b759-maas-api-tls\") pod \"maas-api-e2e-ait-95416e73-5b97c5d694-f48nm\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:17.086232 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.086060    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9xvd\" (UniqueName: \"kubernetes.io/projected/f4e01e85-556d-42cf-8e88-61669511b759-kube-api-access-m9xvd\") pod \"maas-api-e2e-ait-95416e73-5b97c5d694-f48nm\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:17.086232 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:58:17.086187    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-serving-cert: secret "maas-api-e2e-ait-95416e73-serving-cert" not found
Jul 10 14:58:17.086321 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:58:17.086262    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4e01e85-556d-42cf-8e88-61669511b759-maas-api-tls podName:f4e01e85-556d-42cf-8e88-61669511b759 nodeName:}" failed. No retries permitted until 2026-07-10 14:58:17.586244767 +0000 UTC m=+1609.539134822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f4e01e85-556d-42cf-8e88-61669511b759-maas-api-tls") pod "maas-api-e2e-ait-95416e73-5b97c5d694-f48nm" (UID: "f4e01e85-556d-42cf-8e88-61669511b759") : secret "maas-api-e2e-ait-95416e73-serving-cert" not found
Jul 10 14:58:17.086611 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.086593    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e01e85-556d-42cf-8e88-61669511b759-openshift-service-ca\") pod \"maas-api-e2e-ait-95416e73-5b97c5d694-f48nm\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:17.095654 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.095626    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9xvd\" (UniqueName: \"kubernetes.io/projected/f4e01e85-556d-42cf-8e88-61669511b759-kube-api-access-m9xvd\") pod \"maas-api-e2e-ait-95416e73-5b97c5d694-f48nm\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:17.183129 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.183095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:17.368545 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.368469    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:17.469736 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.469699    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:17.589553 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.589520    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e01e85-556d-42cf-8e88-61669511b759-maas-api-tls\") pod \"maas-api-e2e-ait-95416e73-5b97c5d694-f48nm\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:17.592101 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.592070    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e01e85-556d-42cf-8e88-61669511b759-maas-api-tls\") pod \"maas-api-e2e-ait-95416e73-5b97c5d694-f48nm\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:17.816501 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.816412    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:17.879136 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.878932    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:17.883713 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.883685    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:17.919614 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.919574    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:17.920901 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.920867    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:17.962435 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:17.962395    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"]
Jul 10 14:58:17.965817 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:58:17.965789    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e01e85_556d_42cf_8e88_61669511b759.slice/crio-4e348c9c72b1b2629a1bd67274c2c1fb61dda6c41a02f2a132f90ac7f3d0ed77 WatchSource:0}: Error finding container 4e348c9c72b1b2629a1bd67274c2c1fb61dda6c41a02f2a132f90ac7f3d0ed77: Status 404 returned error can't find the container with id 4e348c9c72b1b2629a1bd67274c2c1fb61dda6c41a02f2a132f90ac7f3d0ed77
Jul 10 14:58:18.925643 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:18.925613    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm" event={"ID":"f4e01e85-556d-42cf-8e88-61669511b759","Type":"ContainerStarted","Data":"e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702"}
Jul 10 14:58:18.926106 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:18.925664    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm" event={"ID":"f4e01e85-556d-42cf-8e88-61669511b759","Type":"ContainerStarted","Data":"4e348c9c72b1b2629a1bd67274c2c1fb61dda6c41a02f2a132f90ac7f3d0ed77"}
Jul 10 14:58:18.926106 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:18.925694    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:18.942533 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:18.942482    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm" podStartSLOduration=2.496346615 podStartE2EDuration="2.942465425s" totalImagesPullingTime="446.11881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:58:18.94153392 +0000 UTC m=+1610.894423998" watchObservedRunningTime="2026-07-10 14:58:18.942465425 +0000 UTC m=+1610.895355900"
Jul 10 14:58:19.314541 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:19.314501    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:19.490092 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:19.490059    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:58:21.964679 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:21.964647    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:22.316916 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.316835    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"]
Jul 10 14:58:22.317115 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.317085    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm" podUID="f4e01e85-556d-42cf-8e88-61669511b759" containerName="maas-api" containerID="cri-o://e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702" gracePeriod=30
Jul 10 14:58:22.358799 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.357665    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:22.605824 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.605800    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:22.740779 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.734804    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9xvd\" (UniqueName: \"kubernetes.io/projected/f4e01e85-556d-42cf-8e88-61669511b759-kube-api-access-m9xvd\") pod \"f4e01e85-556d-42cf-8e88-61669511b759\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") "
Jul 10 14:58:22.740779 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.734874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e01e85-556d-42cf-8e88-61669511b759-maas-api-tls\") pod \"f4e01e85-556d-42cf-8e88-61669511b759\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") "
Jul 10 14:58:22.740779 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.734998    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e01e85-556d-42cf-8e88-61669511b759-openshift-service-ca\") pod \"f4e01e85-556d-42cf-8e88-61669511b759\" (UID: \"f4e01e85-556d-42cf-8e88-61669511b759\") "
Jul 10 14:58:22.740779 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.735552    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4e01e85-556d-42cf-8e88-61669511b759-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4e01e85-556d-42cf-8e88-61669511b759" (UID: "f4e01e85-556d-42cf-8e88-61669511b759"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:58:22.754981 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.752238    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4e01e85-556d-42cf-8e88-61669511b759-kube-api-access-m9xvd" (OuterVolumeSpecName: "kube-api-access-m9xvd") pod "f4e01e85-556d-42cf-8e88-61669511b759" (UID: "f4e01e85-556d-42cf-8e88-61669511b759"). InnerVolumeSpecName "kube-api-access-m9xvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:58:22.763774 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.756157    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4e01e85-556d-42cf-8e88-61669511b759-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4e01e85-556d-42cf-8e88-61669511b759" (UID: "f4e01e85-556d-42cf-8e88-61669511b759"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:58:22.836026 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.835905    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4e01e85-556d-42cf-8e88-61669511b759-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:22.836026 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.835938    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e01e85-556d-42cf-8e88-61669511b759-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:22.836026 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.835954    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9xvd\" (UniqueName: \"kubernetes.io/projected/f4e01e85-556d-42cf-8e88-61669511b759-kube-api-access-m9xvd\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:22.960398 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.960355    2564 generic.go:356] "Generic (PLEG): container finished" podID="f4e01e85-556d-42cf-8e88-61669511b759" containerID="e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702" exitCode=0
Jul 10 14:58:22.960609 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.960490    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm" event={"ID":"f4e01e85-556d-42cf-8e88-61669511b759","Type":"ContainerDied","Data":"e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702"}
Jul 10 14:58:22.960609 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.960545    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm" event={"ID":"f4e01e85-556d-42cf-8e88-61669511b759","Type":"ContainerDied","Data":"4e348c9c72b1b2629a1bd67274c2c1fb61dda6c41a02f2a132f90ac7f3d0ed77"}
Jul 10 14:58:22.960609 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.960579    2564 scope.go:117] "RemoveContainer" containerID="e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702"
Jul 10 14:58:22.960800 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.960782    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"
Jul 10 14:58:22.973285 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.973267    2564 scope.go:117] "RemoveContainer" containerID="e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702"
Jul 10 14:58:22.973578 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:58:22.973531    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702\": container with ID starting with e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702 not found: ID does not exist" containerID="e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702"
Jul 10 14:58:22.973578 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.973554    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702"} err="failed to get container status \"e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702\": rpc error: code = NotFound desc = could not find container \"e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702\": container with ID starting with e0fcafbf6aaad63cd66618cf85163037ca747e6c43ecb3d784f9b12f54bf2702 not found: ID does not exist"
Jul 10 14:58:22.985406 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.985383    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"]
Jul 10 14:58:22.991562 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:22.991543    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-95416e73-5b97c5d694-f48nm"]
Jul 10 14:58:24.565772 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:24.565725    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4e01e85-556d-42cf-8e88-61669511b759" path="/var/lib/kubelet/pods/f4e01e85-556d-42cf-8e88-61669511b759/volumes"
Jul 10 14:58:27.995827 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:27.995796    2564 generic.go:356] "Generic (PLEG): container finished" podID="e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" containerID="45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22" exitCode=0
Jul 10 14:58:27.996243 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:27.995855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z" event={"ID":"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32","Type":"ContainerDied","Data":"45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22"}
Jul 10 14:58:27.996243 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:27.996236    2564 scope.go:117] "RemoveContainer" containerID="45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22"
Jul 10 14:58:27.997273 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:27.997245    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:58:27.997349 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:27.997333    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:58:27.997400 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:27.997384    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 14:58:28.140185 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:28.140143    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"]
Jul 10 14:58:28.159863 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:28.159827    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:28.278863 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:28.278784    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:29.003156 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:29.003122    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z" event={"ID":"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32","Type":"ContainerStarted","Data":"53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06"}
Jul 10 14:58:29.003156 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:29.003146    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z" podUID="e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" containerName="istio-proxy" containerID="cri-o://53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06" gracePeriod=30
Jul 10 14:58:31.297151 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:31.297115    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:58:31.453602 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:31.453558    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:32.919885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:32.919850    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:34.003258 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.003222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:34.071173 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.071143    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:34.226085 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.226054    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:34.267104 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.267045    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:34.297826 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.296049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:34.340099 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340072    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-token\") pod \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") "
Jul 10 14:58:34.340273 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340122    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istiod-ca-cert\") pod \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") "
Jul 10 14:58:34.340273 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340191    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smb46\" (UniqueName: \"kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-kube-api-access-smb46\") pod \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") "
Jul 10 14:58:34.340273 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340217    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-data\") pod \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") "
Jul 10 14:58:34.340273 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340239    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-envoy\") pod \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") "
Jul 10 14:58:34.340273 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340261    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-socket\") pod \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") "
Jul 10 14:58:34.340549 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340301    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-podinfo\") pod \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") "
Jul 10 14:58:34.340549 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340354    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-credential-socket\") pod \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") "
Jul 10 14:58:34.340549 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340424    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-certs\") pod \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\" (UID: \"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32\") "
Jul 10 14:58:34.340713 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340662    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" (UID: "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:58:34.340878 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.340856    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" (UID: "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:58:34.341276 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.341186    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" (UID: "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:58:34.341276 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.341235    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" (UID: "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:58:34.341517 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.341481    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-data" (OuterVolumeSpecName: "istio-data") pod "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" (UID: "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:58:34.343059 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.343034    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-token" (OuterVolumeSpecName: "istio-token") pod "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" (UID: "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:58:34.343340 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.343321    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" (UID: "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 14:58:34.343475 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.343454    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-kube-api-access-smb46" (OuterVolumeSpecName: "kube-api-access-smb46") pod "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" (UID: "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32"). InnerVolumeSpecName "kube-api-access-smb46". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:58:34.343686 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.343673    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" (UID: "e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 14:58:34.442090 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.442059    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:34.442210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.442093    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smb46\" (UniqueName: \"kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-kube-api-access-smb46\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:34.442210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.442109    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:34.442210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.442124    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:34.442210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.442137    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:34.442210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.442150    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:34.442210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.442182    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:34.442210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.442196    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:34.442210 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:34.442209    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:35.036657 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.036618    2564 generic.go:356] "Generic (PLEG): container finished" podID="e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" containerID="53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06" exitCode=0
Jul 10 14:58:35.037104 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.036700    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"
Jul 10 14:58:35.037104 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.036714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z" event={"ID":"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32","Type":"ContainerDied","Data":"53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06"}
Jul 10 14:58:35.037104 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.036788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z" event={"ID":"e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32","Type":"ContainerDied","Data":"816a40c97482793207d7f529e11cb6c12441e0acb558a5edc5a798f432ed4037"}
Jul 10 14:58:35.037104 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.036815    2564 scope.go:117] "RemoveContainer" containerID="53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06"
Jul 10 14:58:35.047367 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.047347    2564 scope.go:117] "RemoveContainer" containerID="45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22"
Jul 10 14:58:35.056302 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.056284    2564 scope.go:117] "RemoveContainer" containerID="53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06"
Jul 10 14:58:35.056586 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:58:35.056566    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06\": container with ID starting with 53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06 not found: ID does not exist" containerID="53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06"
Jul 10 14:58:35.056662 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.056598    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06"} err="failed to get container status \"53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06\": rpc error: code = NotFound desc = could not find container \"53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06\": container with ID starting with 53d510e60482288cea4e454bf90229b3713e9c3414581351689e9b829bbead06 not found: ID does not exist"
Jul 10 14:58:35.056662 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.056622    2564 scope.go:117] "RemoveContainer" containerID="45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22"
Jul 10 14:58:35.056907 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:58:35.056886    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22\": container with ID starting with 45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22 not found: ID does not exist" containerID="45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22"
Jul 10 14:58:35.057011 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.056909    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22"} err="failed to get container status \"45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22\": rpc error: code = NotFound desc = could not find container \"45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22\": container with ID starting with 45576df275a1eceb587f854f6893bba33cb7e4412194bcfe1b29359935ec0e22 not found: ID does not exist"
Jul 10 14:58:35.057143 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.057126    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"]
Jul 10 14:58:35.060885 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.060867    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-95416e73-openshift-default-7cbd84795f-9cf9z"]
Jul 10 14:58:35.328321 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.328210    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:35.405807 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.405699    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"]
Jul 10 14:58:35.406378 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.406348    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" containerName="istio-proxy"
Jul 10 14:58:35.406378 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.406377    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" containerName="istio-proxy"
Jul 10 14:58:35.406586 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.406397    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4e01e85-556d-42cf-8e88-61669511b759" containerName="maas-api"
Jul 10 14:58:35.406586 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.406409    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4e01e85-556d-42cf-8e88-61669511b759" containerName="maas-api"
Jul 10 14:58:35.406586 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.406549    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4e01e85-556d-42cf-8e88-61669511b759" containerName="maas-api"
Jul 10 14:58:35.406586 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.406568    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" containerName="istio-proxy"
Jul 10 14:58:35.407048 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.407016    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:35.411656 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.411636    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.414396 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.414379    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5d3267f0-serving-cert\""
Jul 10 14:58:35.418738 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.418718    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"]
Jul 10 14:58:35.478428 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.478392    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:35.551532 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.551496    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a47acf-ead8-4bae-810e-9109126b42bb-openshift-service-ca\") pod \"maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.551532 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.551529    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcgv9\" (UniqueName: \"kubernetes.io/projected/64a47acf-ead8-4bae-810e-9109126b42bb-kube-api-access-xcgv9\") pod \"maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.551717 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.551549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a47acf-ead8-4bae-810e-9109126b42bb-maas-api-tls\") pod \"maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.576645 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.576616    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:35.653024 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.652987    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a47acf-ead8-4bae-810e-9109126b42bb-openshift-service-ca\") pod \"maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.653224 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.653151    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcgv9\" (UniqueName: \"kubernetes.io/projected/64a47acf-ead8-4bae-810e-9109126b42bb-kube-api-access-xcgv9\") pod \"maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.653224 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.653207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a47acf-ead8-4bae-810e-9109126b42bb-maas-api-tls\") pod \"maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.653656 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.653632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a47acf-ead8-4bae-810e-9109126b42bb-openshift-service-ca\") pod \"maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.655714 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.655697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a47acf-ead8-4bae-810e-9109126b42bb-maas-api-tls\") pod \"maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.661365 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.661344    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcgv9\" (UniqueName: \"kubernetes.io/projected/64a47acf-ead8-4bae-810e-9109126b42bb-kube-api-access-xcgv9\") pod \"maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.723396 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.723373    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:35.883617 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.883590    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"]
Jul 10 14:58:35.884705 ip-10-0-141-223 kubenswrapper[2564]: W0710 14:58:35.884672    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a47acf_ead8_4bae_810e_9109126b42bb.slice/crio-e779368a2135414398727cdefe5cae3fe973d64510b9e1b93b3bdd1a524e4408 WatchSource:0}: Error finding container e779368a2135414398727cdefe5cae3fe973d64510b9e1b93b3bdd1a524e4408: Status 404 returned error can't find the container with id e779368a2135414398727cdefe5cae3fe973d64510b9e1b93b3bdd1a524e4408
Jul 10 14:58:35.998289 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:35.998184    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:36.044423 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:36.044387    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq" event={"ID":"64a47acf-ead8-4bae-810e-9109126b42bb","Type":"ContainerStarted","Data":"e779368a2135414398727cdefe5cae3fe973d64510b9e1b93b3bdd1a524e4408"}
Jul 10 14:58:36.100337 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:36.100300    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:36.564894 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:36.564814    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" path="/var/lib/kubelet/pods/e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32/volumes"
Jul 10 14:58:37.052192 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:37.052149    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq" event={"ID":"64a47acf-ead8-4bae-810e-9109126b42bb","Type":"ContainerStarted","Data":"fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a"}
Jul 10 14:58:37.052641 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:37.052304    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:37.071007 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:37.070961    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq" podStartSLOduration=1.7233339239999999 podStartE2EDuration="2.070944568s" totalImagesPullingTime="347.610644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:58:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:58:37.068415797 +0000 UTC m=+1629.021305893" watchObservedRunningTime="2026-07-10 14:58:37.070944568 +0000 UTC m=+1629.023834644"
Jul 10 14:58:37.627608 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:37.627575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:39.192557 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:39.192526    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:58:39.789190 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:39.789154    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:40.275208 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.275172    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"]
Jul 10 14:58:40.275600 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.275519    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq" podUID="64a47acf-ead8-4bae-810e-9109126b42bb" containerName="maas-api" containerID="cri-o://fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a" gracePeriod=30
Jul 10 14:58:40.530568 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.530502    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:40.699211 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.699177    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a47acf-ead8-4bae-810e-9109126b42bb-openshift-service-ca\") pod \"64a47acf-ead8-4bae-810e-9109126b42bb\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") "
Jul 10 14:58:40.699211 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.699209    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcgv9\" (UniqueName: \"kubernetes.io/projected/64a47acf-ead8-4bae-810e-9109126b42bb-kube-api-access-xcgv9\") pod \"64a47acf-ead8-4bae-810e-9109126b42bb\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") "
Jul 10 14:58:40.699472 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.699236    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a47acf-ead8-4bae-810e-9109126b42bb-maas-api-tls\") pod \"64a47acf-ead8-4bae-810e-9109126b42bb\" (UID: \"64a47acf-ead8-4bae-810e-9109126b42bb\") "
Jul 10 14:58:40.699539 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.699507    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64a47acf-ead8-4bae-810e-9109126b42bb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64a47acf-ead8-4bae-810e-9109126b42bb" (UID: "64a47acf-ead8-4bae-810e-9109126b42bb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 14:58:40.701393 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.701355    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64a47acf-ead8-4bae-810e-9109126b42bb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64a47acf-ead8-4bae-810e-9109126b42bb" (UID: "64a47acf-ead8-4bae-810e-9109126b42bb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 14:58:40.701499 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.701401    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64a47acf-ead8-4bae-810e-9109126b42bb-kube-api-access-xcgv9" (OuterVolumeSpecName: "kube-api-access-xcgv9") pod "64a47acf-ead8-4bae-810e-9109126b42bb" (UID: "64a47acf-ead8-4bae-810e-9109126b42bb"). InnerVolumeSpecName "kube-api-access-xcgv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 14:58:40.800416 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.800350    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64a47acf-ead8-4bae-810e-9109126b42bb-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:40.800416 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.800375    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64a47acf-ead8-4bae-810e-9109126b42bb-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:40.800416 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:40.800387    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcgv9\" (UniqueName: \"kubernetes.io/projected/64a47acf-ead8-4bae-810e-9109126b42bb-kube-api-access-xcgv9\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 14:58:41.080999 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.080923    2564 generic.go:356] "Generic (PLEG): container finished" podID="64a47acf-ead8-4bae-810e-9109126b42bb" containerID="fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a" exitCode=0
Jul 10 14:58:41.080999 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.080981    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"
Jul 10 14:58:41.081183 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.081012    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq" event={"ID":"64a47acf-ead8-4bae-810e-9109126b42bb","Type":"ContainerDied","Data":"fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a"}
Jul 10 14:58:41.081183 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.081067    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq" event={"ID":"64a47acf-ead8-4bae-810e-9109126b42bb","Type":"ContainerDied","Data":"e779368a2135414398727cdefe5cae3fe973d64510b9e1b93b3bdd1a524e4408"}
Jul 10 14:58:41.081183 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.081091    2564 scope.go:117] "RemoveContainer" containerID="fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a"
Jul 10 14:58:41.090665 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.090649    2564 scope.go:117] "RemoveContainer" containerID="fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a"
Jul 10 14:58:41.090954 ip-10-0-141-223 kubenswrapper[2564]: E0710 14:58:41.090930    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a\": container with ID starting with fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a not found: ID does not exist" containerID="fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a"
Jul 10 14:58:41.091053 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.090966    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a"} err="failed to get container status \"fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a\": rpc error: code = NotFound desc = could not find container \"fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a\": container with ID starting with fc5e3ae7ce1e9c70f89948f995a82d491eadb3706695f5ba2c48bdbe12a3243a not found: ID does not exist"
Jul 10 14:58:41.103939 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.103920    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"]
Jul 10 14:58:41.107142 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.107121    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:41.108309 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.108290    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5d3267f0-7468d8c856-d2wqq"]
Jul 10 14:58:41.307543 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:41.307512    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:42.565080 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:42.565037    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64a47acf-ead8-4bae-810e-9109126b42bb" path="/var/lib/kubelet/pods/64a47acf-ead8-4bae-810e-9109126b42bb/volumes"
Jul 10 14:58:45.915785 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:45.915716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:46.019564 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:46.019534    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:46.440170 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:46.440128    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:46.539370 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:46.539337    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:46.638789 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:46.638737    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:48.139986 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:48.139958    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:50.591416 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:50.591376    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 14:58:53.796057 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:53.796012    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:53.854592 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:53.854567    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:53.943003 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:53.942969    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:54.042658 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:54.042618    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:54.143833 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:54.143803    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:58:54.547497 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:58:54.547402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:59:20.777023 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:59:20.776987    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:59:26.963483 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:59:26.963443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:59:27.030522 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:59:27.030487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:59:27.122668 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:59:27.122634    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:59:27.215722 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:59:27.215637    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:59:43.236943 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:59:43.236906    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:59:48.799031 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:59:48.798952    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:59:48.909511 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:59:48.909466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:59:49.001305 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:59:49.001269    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 14:59:59.621022 ip-10-0-141-223 kubenswrapper[2564]: I0710 14:59:59.620992    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:00.140796 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.140764    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc"]
Jul 10 15:00:00.141144 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.141132    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" containerName="istio-proxy"
Jul 10 15:00:00.141186 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.141145    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" containerName="istio-proxy"
Jul 10 15:00:00.141186 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.141155    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64a47acf-ead8-4bae-810e-9109126b42bb" containerName="maas-api"
Jul 10 15:00:00.141186 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.141162    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="64a47acf-ead8-4bae-810e-9109126b42bb" containerName="maas-api"
Jul 10 15:00:00.141282 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.141217    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="64a47acf-ead8-4bae-810e-9109126b42bb" containerName="maas-api"
Jul 10 15:00:00.141282 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.141228    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e81ef1dd-d99f-4b3d-b7f5-75a29c1eec32" containerName="istio-proxy"
Jul 10 15:00:00.144263 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.144240    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc"
Jul 10 15:00:00.146890 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.146869    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s85l5\""
Jul 10 15:00:00.151056 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.151036    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc"]
Jul 10 15:00:00.156434 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.156416    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc"
Jul 10 15:00:00.290431 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.290408    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc"]
Jul 10 15:00:00.292618 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:00:00.292582    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44dfe676_69ed_48e2_b6b6_f2f0b5df1206.slice/crio-51a72f9a0c3ddee63cf44d3d566bc0960d11d2555d28b6286ff79df921ef302d WatchSource:0}: Error finding container 51a72f9a0c3ddee63cf44d3d566bc0960d11d2555d28b6286ff79df921ef302d: Status 404 returned error can't find the container with id 51a72f9a0c3ddee63cf44d3d566bc0960d11d2555d28b6286ff79df921ef302d
Jul 10 15:00:00.499406 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.499374    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc" event={"ID":"44dfe676-69ed-48e2-b6b6-f2f0b5df1206","Type":"ContainerStarted","Data":"51a72f9a0c3ddee63cf44d3d566bc0960d11d2555d28b6286ff79df921ef302d"}
Jul 10 15:00:00.515654 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:00.515618    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:01.506498 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:01.506461    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc" event={"ID":"44dfe676-69ed-48e2-b6b6-f2f0b5df1206","Type":"ContainerStarted","Data":"7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5"}
Jul 10 15:00:01.525288 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:01.525238    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc" podStartSLOduration=1.5252253329999998 podStartE2EDuration="1.525225333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:00:01.523024249 +0000 UTC m=+1713.475914325" watchObservedRunningTime="2026-07-10 15:00:01.525225333 +0000 UTC m=+1713.478115409"
Jul 10 15:00:06.453709 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:06.453671    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:06.556355 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:06.556322    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:06.654765 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:06.654696    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:06.754465 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:06.754386    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:07.557066 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:07.557027    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:07.749102 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:07.749063    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:07.849142 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:07.849049    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:08.595488 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:08.595453    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:00:09.583473 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:09.583441    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:15.445168 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:15.445126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:15.547436 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:15.547402    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:15.893823 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:15.893791    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:00:16.170460 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:16.170381    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:21.915467 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:21.915426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:22.061114 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.061074    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:22.223835 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.223702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:22.517585 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.517490    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"]
Jul 10 15:00:22.521324 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.521304    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.524135 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.524117    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9ac4a2ac-openshift-default-dockercfg-kt29d\""
Jul 10 15:00:22.532637 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.532614    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"]
Jul 10 15:00:22.547047 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.547015    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:22.678866 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.678820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istiod-ca-cert\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.678866 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.678867    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgtjg\" (UniqueName: \"kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-kube-api-access-wgtjg\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.679082 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.678899    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-token\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.679082 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.678927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-envoy\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.679082 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.678962    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-certs\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.679082 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.678989    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-podinfo\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.679082 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.679026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-socket\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.679082 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.679040    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-credential-socket\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.679269 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.679086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-data\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.745257 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.745227    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:22.779583 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.779516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-podinfo\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.779583 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.779557    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-socket\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.779583 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.779578    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-credential-socket\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.779865 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.779608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-data\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.779865 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.779664    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istiod-ca-cert\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.779865 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.779694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgtjg\" (UniqueName: \"kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-kube-api-access-wgtjg\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.779865 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.779724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-token\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.779865 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.779784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-envoy\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.779865 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.779829    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-certs\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.780203 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.780026    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-socket\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.780203 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.780077    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-credential-socket\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.780203 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.780131    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-data\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.780362 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.780213    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-certs\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.780521 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.780501    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istiod-ca-cert\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.782248 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.782220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-envoy\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.782652 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.782632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-podinfo\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.790552 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.790523    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-token\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.790675 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.790619    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgtjg\" (UniqueName: \"kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-kube-api-access-wgtjg\") pod \"e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") " pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.833900 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.833877    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:22.977139 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.977105    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"]
Jul 10 15:00:22.977949 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:00:22.977923    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112e1f74_b808_411f_a98f_1ebf0c6a2d19.slice/crio-02a173936992a931977f647eb472b655120332f4fd6f36329c855438718d1dcc WatchSource:0}: Error finding container 02a173936992a931977f647eb472b655120332f4fd6f36329c855438718d1dcc: Status 404 returned error can't find the container with id 02a173936992a931977f647eb472b655120332f4fd6f36329c855438718d1dcc
Jul 10 15:00:22.980285 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.980250    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:00:22.980375 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.980341    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:00:22.980425 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:22.980390    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:00:23.631356 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:23.631325    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" event={"ID":"112e1f74-b808-411f-a98f-1ebf0c6a2d19","Type":"ContainerStarted","Data":"accebc9e7e5402f80b53671a44e49fec898d6e91b6f393825947c09d3d37ca8b"}
Jul 10 15:00:23.631543 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:23.631376    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" event={"ID":"112e1f74-b808-411f-a98f-1ebf0c6a2d19","Type":"ContainerStarted","Data":"02a173936992a931977f647eb472b655120332f4fd6f36329c855438718d1dcc"}
Jul 10 15:00:23.653992 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:23.653928    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" podStartSLOduration=1.65391078 podStartE2EDuration="1.65391078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:00:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:00:23.650849335 +0000 UTC m=+1735.603739412" watchObservedRunningTime="2026-07-10 15:00:23.65391078 +0000 UTC m=+1735.606800857"
Jul 10 15:00:23.833992 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:23.833951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:24.841031 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:24.840997    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:25.192866 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.192831    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:00:25.643910 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.643877    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:25.645370 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.645343    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:25.665869 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.665837    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:25.744937 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.744902    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"]
Jul 10 15:00:25.748654 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.748637    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:25.751576 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.751549    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9ac4a2ac-serving-cert\""
Jul 10 15:00:25.759391 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.759363    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"]
Jul 10 15:00:25.768103 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.768077    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:25.856450 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.856409    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:25.910104 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.910013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbm2w\" (UniqueName: \"kubernetes.io/projected/e9b1f578-94e1-46e9-b950-2e8838e0225e-kube-api-access-qbm2w\") pod \"maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:25.910104 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.910077    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b1f578-94e1-46e9-b950-2e8838e0225e-openshift-service-ca\") pod \"maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:25.910307 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:25.910134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9b1f578-94e1-46e9-b950-2e8838e0225e-maas-api-tls\") pod \"maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:26.011648 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.011591    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbm2w\" (UniqueName: \"kubernetes.io/projected/e9b1f578-94e1-46e9-b950-2e8838e0225e-kube-api-access-qbm2w\") pod \"maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:26.011896 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.011693    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b1f578-94e1-46e9-b950-2e8838e0225e-openshift-service-ca\") pod \"maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:26.011896 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.011714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9b1f578-94e1-46e9-b950-2e8838e0225e-maas-api-tls\") pod \"maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:26.011896 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:00:26.011834    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-serving-cert: secret "maas-api-e2e-mt-9ac4a2ac-serving-cert" not found
Jul 10 15:00:26.011896 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:00:26.011897    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b1f578-94e1-46e9-b950-2e8838e0225e-maas-api-tls podName:e9b1f578-94e1-46e9-b950-2e8838e0225e nodeName:}" failed. No retries permitted until 2026-07-10 15:00:26.51187901 +0000 UTC m=+1738.464769065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e9b1f578-94e1-46e9-b950-2e8838e0225e-maas-api-tls") pod "maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv" (UID: "e9b1f578-94e1-46e9-b950-2e8838e0225e") : secret "maas-api-e2e-mt-9ac4a2ac-serving-cert" not found
Jul 10 15:00:26.012354 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.012330    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b1f578-94e1-46e9-b950-2e8838e0225e-openshift-service-ca\") pod \"maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:26.023575 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.023550    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbm2w\" (UniqueName: \"kubernetes.io/projected/e9b1f578-94e1-46e9-b950-2e8838e0225e-kube-api-access-qbm2w\") pod \"maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:26.204605 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.204516    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:26.348541 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.348508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:26.449793 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.449734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:26.517197 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.517110    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9b1f578-94e1-46e9-b950-2e8838e0225e-maas-api-tls\") pod \"maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:26.519620 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.519586    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9b1f578-94e1-46e9-b950-2e8838e0225e-maas-api-tls\") pod \"maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:26.662346 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.662314    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:26.805074 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:26.805031    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"]
Jul 10 15:00:26.805934 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:00:26.805904    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b1f578_94e1_46e9_b950_2e8838e0225e.slice/crio-7943c3f8f66eaac371f1371533efe9a92d80cb2bf0d4a0878bcb021f1c0074ed WatchSource:0}: Error finding container 7943c3f8f66eaac371f1371533efe9a92d80cb2bf0d4a0878bcb021f1c0074ed: Status 404 returned error can't find the container with id 7943c3f8f66eaac371f1371533efe9a92d80cb2bf0d4a0878bcb021f1c0074ed
Jul 10 15:00:27.655098 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:27.655062    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv" event={"ID":"e9b1f578-94e1-46e9-b950-2e8838e0225e","Type":"ContainerStarted","Data":"6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4"}
Jul 10 15:00:27.655526 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:27.655126    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv" event={"ID":"e9b1f578-94e1-46e9-b950-2e8838e0225e","Type":"ContainerStarted","Data":"7943c3f8f66eaac371f1371533efe9a92d80cb2bf0d4a0878bcb021f1c0074ed"}
Jul 10 15:00:27.655526 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:27.655233    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:27.693448 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:27.693395    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv" podStartSLOduration=2.2708854130000002 podStartE2EDuration="2.693379222s" totalImagesPullingTime="422.493809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:00:27.690738055 +0000 UTC m=+1739.643628134" watchObservedRunningTime="2026-07-10 15:00:27.693379222 +0000 UTC m=+1739.646269360"
Jul 10 15:00:30.237196 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:30.237162    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:30.991431 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:30.991397    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:31.126601 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:31.126566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:31.723123 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:31.723095    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:33.666470 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:33.666439    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:36.890784 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:36.890732    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:00:37.339777 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:37.339660    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:37.441579 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:37.441544    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:37.794792 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:37.794740    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:38.265936 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.265902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:38.370144 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.370108    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"]
Jul 10 15:00:38.370467 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.370435    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv" podUID="e9b1f578-94e1-46e9-b950-2e8838e0225e" containerName="maas-api" containerID="cri-o://6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4" gracePeriod=30
Jul 10 15:00:38.397977 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.397939    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:38.635288 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.635262    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:38.718150 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.718113    2564 generic.go:356] "Generic (PLEG): container finished" podID="e9b1f578-94e1-46e9-b950-2e8838e0225e" containerID="6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4" exitCode=0
Jul 10 15:00:38.718299 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.718160    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"
Jul 10 15:00:38.718299 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.718198    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv" event={"ID":"e9b1f578-94e1-46e9-b950-2e8838e0225e","Type":"ContainerDied","Data":"6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4"}
Jul 10 15:00:38.718299 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.718255    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv" event={"ID":"e9b1f578-94e1-46e9-b950-2e8838e0225e","Type":"ContainerDied","Data":"7943c3f8f66eaac371f1371533efe9a92d80cb2bf0d4a0878bcb021f1c0074ed"}
Jul 10 15:00:38.718299 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.718287    2564 scope.go:117] "RemoveContainer" containerID="6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4"
Jul 10 15:00:38.720554 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.720533    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9b1f578-94e1-46e9-b950-2e8838e0225e-maas-api-tls\") pod \"e9b1f578-94e1-46e9-b950-2e8838e0225e\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") "
Jul 10 15:00:38.720655 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.720629    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbm2w\" (UniqueName: \"kubernetes.io/projected/e9b1f578-94e1-46e9-b950-2e8838e0225e-kube-api-access-qbm2w\") pod \"e9b1f578-94e1-46e9-b950-2e8838e0225e\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") "
Jul 10 15:00:38.720743 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.720729    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b1f578-94e1-46e9-b950-2e8838e0225e-openshift-service-ca\") pod \"e9b1f578-94e1-46e9-b950-2e8838e0225e\" (UID: \"e9b1f578-94e1-46e9-b950-2e8838e0225e\") "
Jul 10 15:00:38.721135 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.721104    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9b1f578-94e1-46e9-b950-2e8838e0225e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9b1f578-94e1-46e9-b950-2e8838e0225e" (UID: "e9b1f578-94e1-46e9-b950-2e8838e0225e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:00:38.722962 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.722934    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9b1f578-94e1-46e9-b950-2e8838e0225e-kube-api-access-qbm2w" (OuterVolumeSpecName: "kube-api-access-qbm2w") pod "e9b1f578-94e1-46e9-b950-2e8838e0225e" (UID: "e9b1f578-94e1-46e9-b950-2e8838e0225e"). InnerVolumeSpecName "kube-api-access-qbm2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:00:38.723051 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.723007    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9b1f578-94e1-46e9-b950-2e8838e0225e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9b1f578-94e1-46e9-b950-2e8838e0225e" (UID: "e9b1f578-94e1-46e9-b950-2e8838e0225e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 15:00:38.741681 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.741653    2564 scope.go:117] "RemoveContainer" containerID="6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4"
Jul 10 15:00:38.742088 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:00:38.742066    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4\": container with ID starting with 6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4 not found: ID does not exist" containerID="6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4"
Jul 10 15:00:38.742163 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.742098    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4"} err="failed to get container status \"6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4\": rpc error: code = NotFound desc = could not find container \"6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4\": container with ID starting with 6a9a468c1ef8db85442f5210c937aab4cbd81b2eb0fbb9426345094a65f32bc4 not found: ID does not exist"
Jul 10 15:00:38.822091 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.822011    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9b1f578-94e1-46e9-b950-2e8838e0225e-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:38.822091 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.822039    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9b1f578-94e1-46e9-b950-2e8838e0225e-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:38.822091 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:38.822050    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbm2w\" (UniqueName: \"kubernetes.io/projected/e9b1f578-94e1-46e9-b950-2e8838e0225e-kube-api-access-qbm2w\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:39.043709 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:39.043675    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"]
Jul 10 15:00:39.046082 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:39.046057    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9ac4a2ac-7fd9cdc8f5-8tvqv"]
Jul 10 15:00:39.725542 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:39.725514    2564 generic.go:356] "Generic (PLEG): container finished" podID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerID="accebc9e7e5402f80b53671a44e49fec898d6e91b6f393825947c09d3d37ca8b" exitCode=0
Jul 10 15:00:39.726048 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:39.725585    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" event={"ID":"112e1f74-b808-411f-a98f-1ebf0c6a2d19","Type":"ContainerDied","Data":"accebc9e7e5402f80b53671a44e49fec898d6e91b6f393825947c09d3d37ca8b"}
Jul 10 15:00:39.726105 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:39.726046    2564 scope.go:117] "RemoveContainer" containerID="accebc9e7e5402f80b53671a44e49fec898d6e91b6f393825947c09d3d37ca8b"
Jul 10 15:00:39.727076 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:39.727053    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:00:39.727147 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:39.727114    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:00:39.727186 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:39.727146    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:00:40.567022 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:40.566987    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9b1f578-94e1-46e9-b950-2e8838e0225e" path="/var/lib/kubelet/pods/e9b1f578-94e1-46e9-b950-2e8838e0225e/volumes"
Jul 10 15:00:40.644402 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:40.644363    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:40.734076 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:40.734046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" event={"ID":"112e1f74-b808-411f-a98f-1ebf0c6a2d19","Type":"ContainerStarted","Data":"6027feb69e9e699d2f5a2f5accae8844dddc7eaa41e88ba3810f546355dbffab"}
Jul 10 15:00:40.834546 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:40.834452    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:40.835780 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:40.835704    2564 patch_prober.go:28] interesting pod/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 10 15:00:40.836033 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:40.835994    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 10 15:00:41.834367 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:41.834331    2564 patch_prober.go:28] interesting pod/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 10 15:00:41.834865 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:41.834384    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 10 15:00:42.834405 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:42.834373    2564 patch_prober.go:28] interesting pod/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 10 15:00:42.834796 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:42.834423    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 10 15:00:43.835178 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:43.835140    2564 patch_prober.go:28] interesting pod/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Jul 10 15:00:43.835648 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:43.835202    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Jul 10 15:00:44.110668 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:44.110641    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:44.212619 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:44.212581    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:44.382202 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:44.382118    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"]
Jul 10 15:00:44.382436 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:44.382406    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy" containerID="cri-o://6027feb69e9e699d2f5a2f5accae8844dddc7eaa41e88ba3810f546355dbffab" gracePeriod=30
Jul 10 15:00:44.405151 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:44.405116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:44.647210 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:44.647126    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:44.915054 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:44.914956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:45.014737 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:45.014702    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:45.114936 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:45.114878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:49.083170 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.083132    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:00:49.797236 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.797205    2564 generic.go:356] "Generic (PLEG): container finished" podID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerID="6027feb69e9e699d2f5a2f5accae8844dddc7eaa41e88ba3810f546355dbffab" exitCode=0
Jul 10 15:00:49.797383 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.797269    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" event={"ID":"112e1f74-b808-411f-a98f-1ebf0c6a2d19","Type":"ContainerDied","Data":"6027feb69e9e699d2f5a2f5accae8844dddc7eaa41e88ba3810f546355dbffab"}
Jul 10 15:00:49.797383 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.797356    2564 scope.go:117] "RemoveContainer" containerID="accebc9e7e5402f80b53671a44e49fec898d6e91b6f393825947c09d3d37ca8b"
Jul 10 15:00:49.846062 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.846041    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:49.927837 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.927770    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-token\") pod \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") "
Jul 10 15:00:49.927837 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.927817    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-podinfo\") pod \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") "
Jul 10 15:00:49.928016 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.927841    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-data\") pod \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") "
Jul 10 15:00:49.928016 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.927874    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-envoy\") pod \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") "
Jul 10 15:00:49.928016 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.927924    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istiod-ca-cert\") pod \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") "
Jul 10 15:00:49.928016 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.927947    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-socket\") pod \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") "
Jul 10 15:00:49.928016 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.928000    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-certs\") pod \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") "
Jul 10 15:00:49.928266 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.928025    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-credential-socket\") pod \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") "
Jul 10 15:00:49.928266 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.928075    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgtjg\" (UniqueName: \"kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-kube-api-access-wgtjg\") pod \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\" (UID: \"112e1f74-b808-411f-a98f-1ebf0c6a2d19\") "
Jul 10 15:00:49.928372 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.928301    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "112e1f74-b808-411f-a98f-1ebf0c6a2d19" (UID: "112e1f74-b808-411f-a98f-1ebf0c6a2d19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:00:49.928426 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.928395    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "112e1f74-b808-411f-a98f-1ebf0c6a2d19" (UID: "112e1f74-b808-411f-a98f-1ebf0c6a2d19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:00:49.928495 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.928469    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:49.928913 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.928883    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "112e1f74-b808-411f-a98f-1ebf0c6a2d19" (UID: "112e1f74-b808-411f-a98f-1ebf0c6a2d19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:00:49.929186 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.928963    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "112e1f74-b808-411f-a98f-1ebf0c6a2d19" (UID: "112e1f74-b808-411f-a98f-1ebf0c6a2d19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:00:49.929186 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.929019    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-data" (OuterVolumeSpecName: "istio-data") pod "112e1f74-b808-411f-a98f-1ebf0c6a2d19" (UID: "112e1f74-b808-411f-a98f-1ebf0c6a2d19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:00:49.930226 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.930198    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "112e1f74-b808-411f-a98f-1ebf0c6a2d19" (UID: "112e1f74-b808-411f-a98f-1ebf0c6a2d19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:00:49.930226 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.930204    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "112e1f74-b808-411f-a98f-1ebf0c6a2d19" (UID: "112e1f74-b808-411f-a98f-1ebf0c6a2d19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 15:00:49.930363 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.930238    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-token" (OuterVolumeSpecName: "istio-token") pod "112e1f74-b808-411f-a98f-1ebf0c6a2d19" (UID: "112e1f74-b808-411f-a98f-1ebf0c6a2d19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:00:49.930468 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:49.930450    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-kube-api-access-wgtjg" (OuterVolumeSpecName: "kube-api-access-wgtjg") pod "112e1f74-b808-411f-a98f-1ebf0c6a2d19" (UID: "112e1f74-b808-411f-a98f-1ebf0c6a2d19"). InnerVolumeSpecName "kube-api-access-wgtjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:00:50.029675 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.029645    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:50.029675 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.029670    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:50.029675 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.029680    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgtjg\" (UniqueName: \"kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-kube-api-access-wgtjg\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:50.029887 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.029688    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:50.029887 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.029697    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:50.029887 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.029704    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:50.029887 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.029713    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:50.029887 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.029720    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/112e1f74-b808-411f-a98f-1ebf0c6a2d19-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:00:50.803965 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.803935    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"
Jul 10 15:00:50.804407 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.803932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7" event={"ID":"112e1f74-b808-411f-a98f-1ebf0c6a2d19","Type":"ContainerDied","Data":"02a173936992a931977f647eb472b655120332f4fd6f36329c855438718d1dcc"}
Jul 10 15:00:50.804407 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.804073    2564 scope.go:117] "RemoveContainer" containerID="6027feb69e9e699d2f5a2f5accae8844dddc7eaa41e88ba3810f546355dbffab"
Jul 10 15:00:50.821994 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.821930    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"]
Jul 10 15:00:50.827418 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.827394    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9ac4a2ac-openshift-default-58d7b8fd9f-rhzv7"]
Jul 10 15:00:50.933911 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:50.933884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:51.039456 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:51.039424    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:51.157996 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:51.157962    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:51.418129 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:51.418048    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:52.565068 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:52.565038    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" path="/var/lib/kubelet/pods/112e1f74-b808-411f-a98f-1ebf0c6a2d19/volumes"
Jul 10 15:00:57.234113 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:57.234083    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:00:57.308398 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:00:57.308365    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:00.011343 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:00.011304    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc"]
Jul 10 15:01:00.011832 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:00.011506    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc" podUID="44dfe676-69ed-48e2-b6b6-f2f0b5df1206" containerName="cleanup" containerID="cri-o://7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5" gracePeriod=30
Jul 10 15:01:04.254967 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.254924    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:04.500674 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.500644    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"]
Jul 10 15:01:04.501095 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.501081    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy"
Jul 10 15:01:04.501145 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.501097    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy"
Jul 10 15:01:04.501145 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.501106    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy"
Jul 10 15:01:04.501145 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.501111    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy"
Jul 10 15:01:04.501145 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.501124    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b1f578-94e1-46e9-b950-2e8838e0225e" containerName="maas-api"
Jul 10 15:01:04.501145 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.501129    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b1f578-94e1-46e9-b950-2e8838e0225e" containerName="maas-api"
Jul 10 15:01:04.501298 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.501199    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b1f578-94e1-46e9-b950-2e8838e0225e" containerName="maas-api"
Jul 10 15:01:04.501298 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.501207    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy"
Jul 10 15:01:04.501298 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.501215    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="112e1f74-b808-411f-a98f-1ebf0c6a2d19" containerName="istio-proxy"
Jul 10 15:01:04.504375 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.504356    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.507115 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.507064    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f34a9b9d-openshift-default-dockercfg-stqf9\""
Jul 10 15:01:04.514535 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.514512    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"]
Jul 10 15:01:04.526583 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.526556    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:04.659481 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.659442    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-podinfo\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.659800 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.659776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rf95\" (UniqueName: \"kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-kube-api-access-8rf95\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.660000 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.659983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-credential-socket\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.660137 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.660123    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-data\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.660266 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.660253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-socket\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.660475 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.660457    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-envoy\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.660646 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.660629    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-token\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.660835 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.660813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6db2bb6-f647-4c78-a946-5638f513ee33-istiod-ca-cert\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.660976 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.660856    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-certs\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.761647 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.761563    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-envoy\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.761647 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.761601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-token\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.761647 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.761621    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6db2bb6-f647-4c78-a946-5638f513ee33-istiod-ca-cert\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.761647 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.761643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-certs\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.762014 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.761676    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-podinfo\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.762014 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.761705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rf95\" (UniqueName: \"kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-kube-api-access-8rf95\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.762014 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.761737    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-credential-socket\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.762014 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.761778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-data\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.762014 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.761803    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-socket\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.762427 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.762394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-certs\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.762565 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.762395    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-socket\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.762636 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.762581    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-credential-socket\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.762636 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.762589    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6db2bb6-f647-4c78-a946-5638f513ee33-istiod-ca-cert\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.762636 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.762605    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-data\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.764161 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.764137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-envoy\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.764286 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.764221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-podinfo\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.770436 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.770413    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-token\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.771007 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.770982    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rf95\" (UniqueName: \"kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-kube-api-access-8rf95\") pod \"e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") " pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.815637 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.815603    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:04.968481 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.968397    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"]
Jul 10 15:01:04.969283 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:01:04.969238    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6db2bb6_f647_4c78_a946_5638f513ee33.slice/crio-593d022e4bd4b03dfe6a277d5f2fe4e4ed329906147cb2b0abc1a17ea0efde70 WatchSource:0}: Error finding container 593d022e4bd4b03dfe6a277d5f2fe4e4ed329906147cb2b0abc1a17ea0efde70: Status 404 returned error can't find the container with id 593d022e4bd4b03dfe6a277d5f2fe4e4ed329906147cb2b0abc1a17ea0efde70
Jul 10 15:01:04.971552 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.971514    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:01:04.971655 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.971602    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:01:04.971724 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:04.971654    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:01:05.021557 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:05.021528    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:05.892344 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:05.892310    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" event={"ID":"d6db2bb6-f647-4c78-a946-5638f513ee33","Type":"ContainerStarted","Data":"2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8"}
Jul 10 15:01:05.892724 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:05.892365    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" event={"ID":"d6db2bb6-f647-4c78-a946-5638f513ee33","Type":"ContainerStarted","Data":"593d022e4bd4b03dfe6a277d5f2fe4e4ed329906147cb2b0abc1a17ea0efde70"}
Jul 10 15:01:05.916343 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:05.916298    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" podStartSLOduration=1.9162840270000001 podStartE2EDuration="1.916284027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:01:05.912637329 +0000 UTC m=+1777.865527429" watchObservedRunningTime="2026-07-10 15:01:05.916284027 +0000 UTC m=+1777.869174149"
Jul 10 15:01:06.815805 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:06.815774    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:06.820430 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:06.820405    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:06.898910 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:06.898877    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:06.899872 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:06.899855    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:07.901343 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:07.901304    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:07.972874 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:07.972844    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"]
Jul 10 15:01:07.976696 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:07.976671    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:07.979308 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:07.979289    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-f34a9b9d-serving-cert\""
Jul 10 15:01:07.988726 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:07.988700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"]
Jul 10 15:01:08.035181 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.035151    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:08.093320 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.093284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21150fe-fbac-4e3b-9122-2191f93c4c55-maas-api-tls\") pod \"maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:08.093500 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.093335    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb9wv\" (UniqueName: \"kubernetes.io/projected/d21150fe-fbac-4e3b-9122-2191f93c4c55-kube-api-access-pb9wv\") pod \"maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:08.093500 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.093370    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21150fe-fbac-4e3b-9122-2191f93c4c55-openshift-service-ca\") pod \"maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:08.135342 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.135307    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:08.194431 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.194357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21150fe-fbac-4e3b-9122-2191f93c4c55-maas-api-tls\") pod \"maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:08.194431 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.194415    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb9wv\" (UniqueName: \"kubernetes.io/projected/d21150fe-fbac-4e3b-9122-2191f93c4c55-kube-api-access-pb9wv\") pod \"maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:08.194607 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.194580    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21150fe-fbac-4e3b-9122-2191f93c4c55-openshift-service-ca\") pod \"maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:08.195217 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.195188    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21150fe-fbac-4e3b-9122-2191f93c4c55-openshift-service-ca\") pod \"maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:08.197012 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.196992    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21150fe-fbac-4e3b-9122-2191f93c4c55-maas-api-tls\") pod \"maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:08.203660 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.203635    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb9wv\" (UniqueName: \"kubernetes.io/projected/d21150fe-fbac-4e3b-9122-2191f93c4c55-kube-api-access-pb9wv\") pod \"maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:08.289468 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.289439    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:08.435390 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.435357    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"]
Jul 10 15:01:08.438278 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:01:08.438244    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21150fe_fbac_4e3b_9122_2191f93c4c55.slice/crio-e61402a9ca75b7c71e7b71ce5f8fc529ea8a5e83c5258b1fb5d4497758b1a19d WatchSource:0}: Error finding container e61402a9ca75b7c71e7b71ce5f8fc529ea8a5e83c5258b1fb5d4497758b1a19d: Status 404 returned error can't find the container with id e61402a9ca75b7c71e7b71ce5f8fc529ea8a5e83c5258b1fb5d4497758b1a19d
Jul 10 15:01:08.483492 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.483432    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:08.584287 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.584248    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:08.913613 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:08.913578    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh" event={"ID":"d21150fe-fbac-4e3b-9122-2191f93c4c55","Type":"ContainerStarted","Data":"e61402a9ca75b7c71e7b71ce5f8fc529ea8a5e83c5258b1fb5d4497758b1a19d"}
Jul 10 15:01:09.920818 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:09.920788    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh" event={"ID":"d21150fe-fbac-4e3b-9122-2191f93c4c55","Type":"ContainerStarted","Data":"6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb"}
Jul 10 15:01:09.921237 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:09.920921    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:09.941440 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:09.941391    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh" podStartSLOduration=2.274043954 podStartE2EDuration="2.941376286s" totalImagesPullingTime="667.332332ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:01:09.938449397 +0000 UTC m=+1781.891339473" watchObservedRunningTime="2026-07-10 15:01:09.941376286 +0000 UTC m=+1781.894266365"
Jul 10 15:01:12.290685 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:12.290648    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:01:12.524345 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:12.524313    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:15.419101 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:15.419066    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:15.932660 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:15.932630    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:20.993910 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:20.993877    2564 generic.go:356] "Generic (PLEG): container finished" podID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerID="2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8" exitCode=0
Jul 10 15:01:20.994338 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:20.993933    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" event={"ID":"d6db2bb6-f647-4c78-a946-5638f513ee33","Type":"ContainerDied","Data":"2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8"}
Jul 10 15:01:20.994338 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:20.994297    2564 scope.go:117] "RemoveContainer" containerID="2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8"
Jul 10 15:01:20.995264 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:20.995235    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:01:20.995361 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:20.995300    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:01:20.995361 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:20.995330    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:01:21.899697 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:21.899661    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:22.001773 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:22.001727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" event={"ID":"d6db2bb6-f647-4c78-a946-5638f513ee33","Type":"ContainerStarted","Data":"346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c"}
Jul 10 15:01:22.816659 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:22.816624    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:22.817533 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:22.817510    2564 patch_prober.go:28] interesting pod/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 10 15:01:22.817587 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:22.817565    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 10 15:01:23.218608 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:23.218579    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:23.816684 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:23.816653    2564 patch_prober.go:28] interesting pod/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 10 15:01:23.816882 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:23.816701    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 10 15:01:24.816247 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:24.816210    2564 patch_prober.go:28] interesting pod/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 10 15:01:24.816615 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:24.816274    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 10 15:01:25.816888 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:25.816858    2564 patch_prober.go:28] interesting pod/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Jul 10 15:01:25.817264 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:25.816920    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Jul 10 15:01:26.820155 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:26.820121    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:26.820550 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:26.820392    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:26.821025 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:26.821003    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:01:27.091267 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:27.091190    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:01:27.384985 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:27.384946    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:27.485554 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:27.485515    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:28.597340 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:28.597314    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 15:01:28.597861 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:28.597839    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 15:01:29.223865 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:29.223822    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:29.324204 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:29.324165    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:30.209194 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:30.209173    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc"
Jul 10 15:01:31.055052 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:31.055021    2564 generic.go:356] "Generic (PLEG): container finished" podID="44dfe676-69ed-48e2-b6b6-f2f0b5df1206" containerID="7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5" exitCode=137
Jul 10 15:01:31.055227 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:31.055063    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc"
Jul 10 15:01:31.055227 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:31.055104    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc" event={"ID":"44dfe676-69ed-48e2-b6b6-f2f0b5df1206","Type":"ContainerDied","Data":"7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5"}
Jul 10 15:01:31.055227 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:31.055159    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc" event={"ID":"44dfe676-69ed-48e2-b6b6-f2f0b5df1206","Type":"ContainerDied","Data":"51a72f9a0c3ddee63cf44d3d566bc0960d11d2555d28b6286ff79df921ef302d"}
Jul 10 15:01:31.055227 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:31.055188    2564 scope.go:117] "RemoveContainer" containerID="7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5"
Jul 10 15:01:31.064132 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:31.064114    2564 scope.go:117] "RemoveContainer" containerID="7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5"
Jul 10 15:01:31.064377 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:01:31.064358    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5\": container with ID starting with 7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5 not found: ID does not exist" containerID="7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5"
Jul 10 15:01:31.064415 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:31.064388    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5"} err="failed to get container status \"7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5\": rpc error: code = NotFound desc = could not find container \"7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5\": container with ID starting with 7f71a67e9aa7a4018fa743aa3ca0fbed9220ccef94df5d338bbbf5d25d1c3fc5 not found: ID does not exist"
Jul 10 15:01:31.070635 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:31.070612    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc"]
Jul 10 15:01:31.074083 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:31.074063    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728260-d9fzc"]
Jul 10 15:01:32.564514 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:32.564483    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44dfe676-69ed-48e2-b6b6-f2f0b5df1206" path="/var/lib/kubelet/pods/44dfe676-69ed-48e2-b6b6-f2f0b5df1206/volumes"
Jul 10 15:01:38.589523 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:38.589491    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:01:41.207295 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.207251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:41.547789 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.547682    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"]
Jul 10 15:01:41.548013 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.547982    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh" podUID="d21150fe-fbac-4e3b-9122-2191f93c4c55" containerName="maas-api" containerID="cri-o://6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb" gracePeriod=30
Jul 10 15:01:41.576618 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.576591    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:41.805183 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.805118    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:41.912813 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.912781    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb9wv\" (UniqueName: \"kubernetes.io/projected/d21150fe-fbac-4e3b-9122-2191f93c4c55-kube-api-access-pb9wv\") pod \"d21150fe-fbac-4e3b-9122-2191f93c4c55\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") "
Jul 10 15:01:41.912986 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.912871    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21150fe-fbac-4e3b-9122-2191f93c4c55-openshift-service-ca\") pod \"d21150fe-fbac-4e3b-9122-2191f93c4c55\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") "
Jul 10 15:01:41.912986 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.912909    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21150fe-fbac-4e3b-9122-2191f93c4c55-maas-api-tls\") pod \"d21150fe-fbac-4e3b-9122-2191f93c4c55\" (UID: \"d21150fe-fbac-4e3b-9122-2191f93c4c55\") "
Jul 10 15:01:41.913212 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.913191    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21150fe-fbac-4e3b-9122-2191f93c4c55-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d21150fe-fbac-4e3b-9122-2191f93c4c55" (UID: "d21150fe-fbac-4e3b-9122-2191f93c4c55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:01:41.915128 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.915097    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d21150fe-fbac-4e3b-9122-2191f93c4c55-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d21150fe-fbac-4e3b-9122-2191f93c4c55" (UID: "d21150fe-fbac-4e3b-9122-2191f93c4c55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 15:01:41.915235 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:41.915114    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21150fe-fbac-4e3b-9122-2191f93c4c55-kube-api-access-pb9wv" (OuterVolumeSpecName: "kube-api-access-pb9wv") pod "d21150fe-fbac-4e3b-9122-2191f93c4c55" (UID: "d21150fe-fbac-4e3b-9122-2191f93c4c55"). InnerVolumeSpecName "kube-api-access-pb9wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:01:42.014476 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.014449    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb9wv\" (UniqueName: \"kubernetes.io/projected/d21150fe-fbac-4e3b-9122-2191f93c4c55-kube-api-access-pb9wv\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:01:42.014476 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.014474    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d21150fe-fbac-4e3b-9122-2191f93c4c55-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:01:42.014629 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.014484    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d21150fe-fbac-4e3b-9122-2191f93c4c55-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:01:42.114400 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.114373    2564 generic.go:356] "Generic (PLEG): container finished" podID="d21150fe-fbac-4e3b-9122-2191f93c4c55" containerID="6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb" exitCode=0
Jul 10 15:01:42.114529 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.114419    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"
Jul 10 15:01:42.114529 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.114420    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh" event={"ID":"d21150fe-fbac-4e3b-9122-2191f93c4c55","Type":"ContainerDied","Data":"6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb"}
Jul 10 15:01:42.114607 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.114549    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh" event={"ID":"d21150fe-fbac-4e3b-9122-2191f93c4c55","Type":"ContainerDied","Data":"e61402a9ca75b7c71e7b71ce5f8fc529ea8a5e83c5258b1fb5d4497758b1a19d"}
Jul 10 15:01:42.114607 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.114578    2564 scope.go:117] "RemoveContainer" containerID="6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb"
Jul 10 15:01:42.123657 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.123639    2564 scope.go:117] "RemoveContainer" containerID="6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb"
Jul 10 15:01:42.123927 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:01:42.123909    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb\": container with ID starting with 6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb not found: ID does not exist" containerID="6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb"
Jul 10 15:01:42.123976 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.123936    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb"} err="failed to get container status \"6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb\": rpc error: code = NotFound desc = could not find container \"6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb\": container with ID starting with 6abd34ede1eff58a5b63508d707bde25ccebda1d806af7ff66cfd31ce4aa57fb not found: ID does not exist"
Jul 10 15:01:42.138009 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.137985    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"]
Jul 10 15:01:42.141565 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.141540    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-f34a9b9d-7cd9cd5f75-j59wh"]
Jul 10 15:01:42.564593 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:42.564514    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d21150fe-fbac-4e3b-9122-2191f93c4c55" path="/var/lib/kubelet/pods/d21150fe-fbac-4e3b-9122-2191f93c4c55/volumes"
Jul 10 15:01:47.405377 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:47.405342    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:52.432765 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:52.432724    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:01:52.492013 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:01:52.491985    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:02:11.105948 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:11.105902    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:12.002650 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:12.002613    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:14.591920 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:14.591882    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:02:17.501114 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:17.501079    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:17.602667 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:17.602631    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:17.729260 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:17.729226    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"]
Jul 10 15:02:17.729514 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:17.729491    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy" containerID="cri-o://346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c" gracePeriod=30
Jul 10 15:02:17.756024 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:17.755956    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:17.997087 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:17.997047    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:19.126180 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:19.126139    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:19.224959 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:19.224919    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:19.324626 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:19.324594    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:20.116346 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:20.116311    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:20.209963 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:20.209922    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:20.314130 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:20.314099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:21.800222 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:21.800182    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:22.996745 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:22.996691    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:02:23.064779 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.064725    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-podinfo\") pod \"d6db2bb6-f647-4c78-a946-5638f513ee33\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") "
Jul 10 15:02:23.064959 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.064791    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-envoy\") pod \"d6db2bb6-f647-4c78-a946-5638f513ee33\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") "
Jul 10 15:02:23.064959 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.064846    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-data\") pod \"d6db2bb6-f647-4c78-a946-5638f513ee33\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") "
Jul 10 15:02:23.064959 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.064872    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rf95\" (UniqueName: \"kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-kube-api-access-8rf95\") pod \"d6db2bb6-f647-4c78-a946-5638f513ee33\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") "
Jul 10 15:02:23.064959 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.064912    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-socket\") pod \"d6db2bb6-f647-4c78-a946-5638f513ee33\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") "
Jul 10 15:02:23.065176 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.064960    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-credential-socket\") pod \"d6db2bb6-f647-4c78-a946-5638f513ee33\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") "
Jul 10 15:02:23.065176 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.065148    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6db2bb6-f647-4c78-a946-5638f513ee33" (UID: "d6db2bb6-f647-4c78-a946-5638f513ee33"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:02:23.065176 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.065167    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-certs\") pod \"d6db2bb6-f647-4c78-a946-5638f513ee33\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") "
Jul 10 15:02:23.065340 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.065179    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6db2bb6-f647-4c78-a946-5638f513ee33" (UID: "d6db2bb6-f647-4c78-a946-5638f513ee33"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:02:23.065340 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.065277    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6db2bb6-f647-4c78-a946-5638f513ee33-istiod-ca-cert\") pod \"d6db2bb6-f647-4c78-a946-5638f513ee33\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") "
Jul 10 15:02:23.065340 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.065301    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6db2bb6-f647-4c78-a946-5638f513ee33" (UID: "d6db2bb6-f647-4c78-a946-5638f513ee33"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:02:23.065617 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.065589    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6db2bb6-f647-4c78-a946-5638f513ee33-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6db2bb6-f647-4c78-a946-5638f513ee33" (UID: "d6db2bb6-f647-4c78-a946-5638f513ee33"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:02:23.065907 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.065859    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6db2bb6-f647-4c78-a946-5638f513ee33" (UID: "d6db2bb6-f647-4c78-a946-5638f513ee33"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:02:23.065907 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.065879    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-token\") pod \"d6db2bb6-f647-4c78-a946-5638f513ee33\" (UID: \"d6db2bb6-f647-4c78-a946-5638f513ee33\") "
Jul 10 15:02:23.066222 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.066197    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:02:23.066349 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.066227    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:02:23.066349 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.066242    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:02:23.066349 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.066256    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:02:23.066349 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.066283    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6db2bb6-f647-4c78-a946-5638f513ee33-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:02:23.068037 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.068009    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6db2bb6-f647-4c78-a946-5638f513ee33" (UID: "d6db2bb6-f647-4c78-a946-5638f513ee33"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:02:23.068354 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.068318    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-kube-api-access-8rf95" (OuterVolumeSpecName: "kube-api-access-8rf95") pod "d6db2bb6-f647-4c78-a946-5638f513ee33" (UID: "d6db2bb6-f647-4c78-a946-5638f513ee33"). InnerVolumeSpecName "kube-api-access-8rf95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:02:23.068452 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.068400    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6db2bb6-f647-4c78-a946-5638f513ee33" (UID: "d6db2bb6-f647-4c78-a946-5638f513ee33"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 15:02:23.068545 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.068522    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6db2bb6-f647-4c78-a946-5638f513ee33" (UID: "d6db2bb6-f647-4c78-a946-5638f513ee33"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:02:23.167486 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.167447    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:02:23.167672 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.167499    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:02:23.167672 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.167510    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6db2bb6-f647-4c78-a946-5638f513ee33-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:02:23.167672 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.167521    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rf95\" (UniqueName: \"kubernetes.io/projected/d6db2bb6-f647-4c78-a946-5638f513ee33-kube-api-access-8rf95\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:02:23.343456 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.343361    2564 generic.go:356] "Generic (PLEG): container finished" podID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerID="346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c" exitCode=0
Jul 10 15:02:23.343456 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.343418    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"
Jul 10 15:02:23.343456 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.343442    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" event={"ID":"d6db2bb6-f647-4c78-a946-5638f513ee33","Type":"ContainerDied","Data":"346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c"}
Jul 10 15:02:23.343726 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.343504    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w" event={"ID":"d6db2bb6-f647-4c78-a946-5638f513ee33","Type":"ContainerDied","Data":"593d022e4bd4b03dfe6a277d5f2fe4e4ed329906147cb2b0abc1a17ea0efde70"}
Jul 10 15:02:23.343726 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.343536    2564 scope.go:117] "RemoveContainer" containerID="346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c"
Jul 10 15:02:23.358184 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.358165    2564 scope.go:117] "RemoveContainer" containerID="2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8"
Jul 10 15:02:23.367850 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.367828    2564 scope.go:117] "RemoveContainer" containerID="346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c"
Jul 10 15:02:23.368137 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:02:23.368104    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c\": container with ID starting with 346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c not found: ID does not exist" containerID="346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c"
Jul 10 15:02:23.368253 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.368144    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c"} err="failed to get container status \"346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c\": rpc error: code = NotFound desc = could not find container \"346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c\": container with ID starting with 346997623cf98e4565fff7ae2bd5f7a23d0736a5deec46456d80e502b316c37c not found: ID does not exist"
Jul 10 15:02:23.368253 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.368168    2564 scope.go:117] "RemoveContainer" containerID="2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8"
Jul 10 15:02:23.368533 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:02:23.368498    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8\": container with ID starting with 2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8 not found: ID does not exist" containerID="2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8"
Jul 10 15:02:23.368627 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.368528    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8"} err="failed to get container status \"2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8\": rpc error: code = NotFound desc = could not find container \"2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8\": container with ID starting with 2a730df858f0c12d3a718d6f30c328212bdfaf6ebb2ca5ba405f9364089112a8 not found: ID does not exist"
Jul 10 15:02:23.370546 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.370524    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"]
Jul 10 15:02:23.373655 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:23.373634    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f34a9b9d-openshift-default-7fc9fd6cf9-qv94w"]
Jul 10 15:02:24.572494 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:24.572459    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" path="/var/lib/kubelet/pods/d6db2bb6-f647-4c78-a946-5638f513ee33/volumes"
Jul 10 15:02:27.614141 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:27.614110    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:27.682001 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:27.681973    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:28.337264 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:28.337229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:33.985797 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:33.985730    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:34.047704 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:34.047657    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:34.135988 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:34.135961    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:34.236913 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:34.236818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:44.752694 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:44.752653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:02:45.103335 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:02:45.103251    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:05.851633 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:05.851593    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:06.148537 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:06.148509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:11.972259 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:11.972214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:12.038769 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:12.038732    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:12.344462 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:12.344378    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:13.026626 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:13.026586    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:13.099024 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:13.098988    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:16.009477 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.009439    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:16.080172 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.080135    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:16.089167 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089138    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"]
Jul 10 15:03:16.089707 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089693    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44dfe676-69ed-48e2-b6b6-f2f0b5df1206" containerName="cleanup"
Jul 10 15:03:16.089776 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089712    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="44dfe676-69ed-48e2-b6b6-f2f0b5df1206" containerName="cleanup"
Jul 10 15:03:16.089776 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089725    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy"
Jul 10 15:03:16.089776 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089733    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy"
Jul 10 15:03:16.089776 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089746    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy"
Jul 10 15:03:16.089902 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089777    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy"
Jul 10 15:03:16.089902 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089800    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d21150fe-fbac-4e3b-9122-2191f93c4c55" containerName="maas-api"
Jul 10 15:03:16.089902 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089808    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d21150fe-fbac-4e3b-9122-2191f93c4c55" containerName="maas-api"
Jul 10 15:03:16.089902 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089890    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="44dfe676-69ed-48e2-b6b6-f2f0b5df1206" containerName="cleanup"
Jul 10 15:03:16.089902 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089899    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy"
Jul 10 15:03:16.090057 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.089910    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d21150fe-fbac-4e3b-9122-2191f93c4c55" containerName="maas-api"
Jul 10 15:03:16.093454 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.093434    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:16.096308 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.096280    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-72c145-serving-cert\""
Jul 10 15:03:16.100664 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.100639    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"]
Jul 10 15:03:16.112417 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.112386    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-openshift-service-ca\") pod \"maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:16.112550 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.112507    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7lcr\" (UniqueName: \"kubernetes.io/projected/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-kube-api-access-w7lcr\") pod \"maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:16.112627 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.112575    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-maas-api-tls\") pod \"maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:16.156329 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.156302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:16.213423 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.213394    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-openshift-service-ca\") pod \"maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:16.213583 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.213447    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7lcr\" (UniqueName: \"kubernetes.io/projected/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-kube-api-access-w7lcr\") pod \"maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:16.213583 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.213485    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-maas-api-tls\") pod \"maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:16.213675 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:03:16.213601    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-serving-cert: secret "maas-api-e2e-inf-a-72c145-serving-cert" not found
Jul 10 15:03:16.213675 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:03:16.213669    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-maas-api-tls podName:8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77 nodeName:}" failed. No retries permitted until 2026-07-10 15:03:16.713652102 +0000 UTC m=+1908.666542156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-maas-api-tls") pod "maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk" (UID: "8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77") : secret "maas-api-e2e-inf-a-72c145-serving-cert" not found
Jul 10 15:03:16.214087 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.214068    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-openshift-service-ca\") pod \"maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:16.224967 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.224942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7lcr\" (UniqueName: \"kubernetes.io/projected/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-kube-api-access-w7lcr\") pod \"maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:16.372893 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.372847    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:16.531899 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.531866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:16.638436 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.638349    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:16.718005 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.717975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-maas-api-tls\") pod \"maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:16.720519 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:16.720489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-maas-api-tls\") pod \"maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:17.004844 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:17.004744    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:17.147300 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:17.147263    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"]
Jul 10 15:03:17.148596 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:03:17.148566    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae22dfc_bfba_426d_aa0b_cdfd4ea55d77.slice/crio-fbc37683222cfca485a5d9f5071b3d1bfe011c00214561e9a0a526b1a1d88076 WatchSource:0}: Error finding container fbc37683222cfca485a5d9f5071b3d1bfe011c00214561e9a0a526b1a1d88076: Status 404 returned error can't find the container with id fbc37683222cfca485a5d9f5071b3d1bfe011c00214561e9a0a526b1a1d88076
Jul 10 15:03:17.150530 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:17.150510    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 15:03:17.633407 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:17.633364    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk" event={"ID":"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77","Type":"ContainerStarted","Data":"fbc37683222cfca485a5d9f5071b3d1bfe011c00214561e9a0a526b1a1d88076"}
Jul 10 15:03:18.641303 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:18.641265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk" event={"ID":"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77","Type":"ContainerStarted","Data":"a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594"}
Jul 10 15:03:18.641817 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:18.641349    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:18.659445 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:18.659403    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk" podStartSLOduration=2.138594188 podStartE2EDuration="2.659388377s" totalImagesPullingTime="520.794189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:03:18.658328282 +0000 UTC m=+1910.611218358" watchObservedRunningTime="2026-07-10 15:03:18.659388377 +0000 UTC m=+1910.612278453"
Jul 10 15:03:20.573126 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:20.573092    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:20.945925 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:20.945878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:21.249884 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.249785    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"]
Jul 10 15:03:21.250359 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.250340    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6db2bb6-f647-4c78-a946-5638f513ee33" containerName="istio-proxy"
Jul 10 15:03:21.253868 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.253843    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.256694 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.256672    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a68a9f-openshift-default-dockercfg-q5hqj\""
Jul 10 15:03:21.265518 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.265497    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"]
Jul 10 15:03:21.281021 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.280987    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:21.357194 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.357165    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-credential-socket\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.357444 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.357424    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-certs\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.357610 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.357582    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istiod-ca-cert\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.357764 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.357651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-socket\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.357764 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.357726    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-data\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.357889 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.357797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwqkp\" (UniqueName: \"kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-kube-api-access-zwqkp\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.357889 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.357825    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-token\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.357889 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.357859    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-podinfo\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.358056 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.357893    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-envoy\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.443709 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.443673    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:21.458744 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.458715    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwqkp\" (UniqueName: \"kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-kube-api-access-zwqkp\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.458894 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.458747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-token\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.458894 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.458797    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-podinfo\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.458894 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.458818    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-envoy\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.458894 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.458851    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-credential-socket\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.458894 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.458869    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-certs\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.458894 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.458895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istiod-ca-cert\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.459201 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.458932    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-socket\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.459201 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.458998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-data\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.459380 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.459347    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-credential-socket\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.459503 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.459444    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-certs\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.459577 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.459545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-data\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.459577 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.459548    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-socket\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.459796 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.459745    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istiod-ca-cert\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.461428 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.461401    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-envoy\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.461565 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.461544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-podinfo\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.466812 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.466788    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-token\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.467115 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.467093    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwqkp\" (UniqueName: \"kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-kube-api-access-zwqkp\") pod \"e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") " pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.564622 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.564543    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:21.711501 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.711467    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"]
Jul 10 15:03:21.714608 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:03:21.714576    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e76d305_2fde_4e44_8c23_ba8ff1835c15.slice/crio-0f4d9eca9592a2998815141a1203a93c35c55fe68bf31b624bf7433e0d14efa3 WatchSource:0}: Error finding container 0f4d9eca9592a2998815141a1203a93c35c55fe68bf31b624bf7433e0d14efa3: Status 404 returned error can't find the container with id 0f4d9eca9592a2998815141a1203a93c35c55fe68bf31b624bf7433e0d14efa3
Jul 10 15:03:21.716907 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.716877    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:03:21.716999 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.716937    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:03:21.716999 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:21.716966    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:03:22.666920 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:22.666879    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" event={"ID":"2e76d305-2fde-4e44-8c23-ba8ff1835c15","Type":"ContainerStarted","Data":"7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278"}
Jul 10 15:03:22.667122 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:22.666936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" event={"ID":"2e76d305-2fde-4e44-8c23-ba8ff1835c15","Type":"ContainerStarted","Data":"0f4d9eca9592a2998815141a1203a93c35c55fe68bf31b624bf7433e0d14efa3"}
Jul 10 15:03:22.687275 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:22.687227    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" podStartSLOduration=1.6872127209999999 podStartE2EDuration="1.687212721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:03:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:03:22.685809149 +0000 UTC m=+1914.638699226" watchObservedRunningTime="2026-07-10 15:03:22.687212721 +0000 UTC m=+1914.640102798"
Jul 10 15:03:23.485889 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:23.485858    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:03:23.564986 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:23.564951    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:23.569723 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:23.569699    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:23.672574 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:23.672550    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:23.673518 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:23.673500    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:24.622446 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.622408    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:24.656553 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.656525    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:03:24.686476 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.686443    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:24.795815 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.795787    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"]
Jul 10 15:03:24.799601 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.799579    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:24.802171 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.802151    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-a68a9f-serving-cert\""
Jul 10 15:03:24.808820 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.808797    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"]
Jul 10 15:03:24.832023 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.831997    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:24.887284 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.887215    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e950d7e-bf36-43a0-b768-0a1a7da8c767-maas-api-tls\") pod \"maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:24.887284 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.887245    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e950d7e-bf36-43a0-b768-0a1a7da8c767-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:24.887439 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.887341    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fddln\" (UniqueName: \"kubernetes.io/projected/8e950d7e-bf36-43a0-b768-0a1a7da8c767-kube-api-access-fddln\") pod \"maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:24.988663 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.988619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e950d7e-bf36-43a0-b768-0a1a7da8c767-maas-api-tls\") pod \"maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:24.988663 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.988662    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e950d7e-bf36-43a0-b768-0a1a7da8c767-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:24.988897 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.988719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fddln\" (UniqueName: \"kubernetes.io/projected/8e950d7e-bf36-43a0-b768-0a1a7da8c767-kube-api-access-fddln\") pod \"maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:24.988897 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:03:24.988804    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-serving-cert: secret "maas-api-e2e-inf-b-a68a9f-serving-cert" not found
Jul 10 15:03:24.988897 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:03:24.988883    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e950d7e-bf36-43a0-b768-0a1a7da8c767-maas-api-tls podName:8e950d7e-bf36-43a0-b768-0a1a7da8c767 nodeName:}" failed. No retries permitted until 2026-07-10 15:03:25.488864681 +0000 UTC m=+1917.441754736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8e950d7e-bf36-43a0-b768-0a1a7da8c767-maas-api-tls") pod "maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m" (UID: "8e950d7e-bf36-43a0-b768-0a1a7da8c767") : secret "maas-api-e2e-inf-b-a68a9f-serving-cert" not found
Jul 10 15:03:24.989300 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:24.989282    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e950d7e-bf36-43a0-b768-0a1a7da8c767-openshift-service-ca\") pod \"maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:25.005235 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:25.005206    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fddln\" (UniqueName: \"kubernetes.io/projected/8e950d7e-bf36-43a0-b768-0a1a7da8c767-kube-api-access-fddln\") pod \"maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:25.305197 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:25.305104    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:25.405126 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:25.405094    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:25.493796 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:25.493744    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e950d7e-bf36-43a0-b768-0a1a7da8c767-maas-api-tls\") pod \"maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:25.496189 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:25.496164    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e950d7e-bf36-43a0-b768-0a1a7da8c767-maas-api-tls\") pod \"maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:25.504762 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:25.504728    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:25.713369 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:25.713338    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:25.863289 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:25.863257    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"]
Jul 10 15:03:25.864682 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:03:25.864656    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e950d7e_bf36_43a0_b768_0a1a7da8c767.slice/crio-16b7c0b4a408e128b364dabba25b3805c24176ac3123ea13d06cd185b16f25a1 WatchSource:0}: Error finding container 16b7c0b4a408e128b364dabba25b3805c24176ac3123ea13d06cd185b16f25a1: Status 404 returned error can't find the container with id 16b7c0b4a408e128b364dabba25b3805c24176ac3123ea13d06cd185b16f25a1
Jul 10 15:03:26.697558 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:26.697518    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m" event={"ID":"8e950d7e-bf36-43a0-b768-0a1a7da8c767","Type":"ContainerStarted","Data":"0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba"}
Jul 10 15:03:26.697743 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:26.697691    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:26.697743 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:26.697733    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m" event={"ID":"8e950d7e-bf36-43a0-b768-0a1a7da8c767","Type":"ContainerStarted","Data":"16b7c0b4a408e128b364dabba25b3805c24176ac3123ea13d06cd185b16f25a1"}
Jul 10 15:03:26.716627 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:26.716570    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m" podStartSLOduration=2.248523657 podStartE2EDuration="2.716558s" totalImagesPullingTime="468.034343ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:03:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:03:26.714299788 +0000 UTC m=+1918.667189885" watchObservedRunningTime="2026-07-10 15:03:26.716558 +0000 UTC m=+1918.669448077"
Jul 10 15:03:29.169892 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:29.169859    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:32.708597 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:32.708569    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:03:34.495642 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:34.495609    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:03:38.166213 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:38.166173    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:38.271268 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:38.271229    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:38.674520 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:38.674484    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 10 15:03:38.674684 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:38.674534    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 10 15:03:38.783239 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:38.783209    2564 generic.go:356] "Generic (PLEG): container finished" podID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerID="7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278" exitCode=0
Jul 10 15:03:38.783389 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:38.783284    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" event={"ID":"2e76d305-2fde-4e44-8c23-ba8ff1835c15","Type":"ContainerDied","Data":"7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278"}
Jul 10 15:03:38.783675 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:38.783650    2564 scope.go:117] "RemoveContainer" containerID="7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278"
Jul 10 15:03:38.784655 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:38.784633    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:03:38.784705 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:38.784691    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:03:38.784745 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:38.784722    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:03:39.023450 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:39.023328    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:39.791163 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:39.791133    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" event={"ID":"2e76d305-2fde-4e44-8c23-ba8ff1835c15","Type":"ContainerStarted","Data":"f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951"}
Jul 10 15:03:40.268224 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:40.268186    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:40.365462 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:40.365426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:40.565292 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:40.565204    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 10 15:03:40.565292 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:40.565266    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 10 15:03:40.567793 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:40.567771    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:41.565129 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:41.565082    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 10 15:03:41.565616 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:41.565150    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 10 15:03:42.564975 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:42.564937    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 10 15:03:42.565144 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:42.565011    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 10 15:03:43.565023 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:43.564987    2564 patch_prober.go:28] interesting pod/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Jul 10 15:03:43.565416 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:43.565045    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Jul 10 15:03:44.569966 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:44.569928    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:44.570407 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:44.570375    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:44.570999 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:44.570976    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:03:45.192903 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:45.192872    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:03:46.893188 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:46.893153    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:48.347390 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:48.347360    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:03:56.493365 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:03:56.493326    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:04:02.882065 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:02.882034    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:04:16.997524 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:16.997490    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:04:17.595312 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:17.595271    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:04:18.499308 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:18.499281    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:04:18.688536 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:18.688459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:04:19.137714 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.137676    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:04:19.237611 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.237575    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:04:19.338067 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.338035    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:04:19.442456 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.442372    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"]
Jul 10 15:04:19.442972 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.442938    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk" podUID="8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77" containerName="maas-api" containerID="cri-o://a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594" gracePeriod=30
Jul 10 15:04:19.465335 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.465312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:04:19.696558 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.696498    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:04:19.783745 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.783716    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-openshift-service-ca\") pod \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") "
Jul 10 15:04:19.783745 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.783772    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7lcr\" (UniqueName: \"kubernetes.io/projected/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-kube-api-access-w7lcr\") pod \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") "
Jul 10 15:04:19.783998 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.783888    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-maas-api-tls\") pod \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\" (UID: \"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77\") "
Jul 10 15:04:19.784159 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.784125    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77" (UID: "8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:04:19.786018 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.785994    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-kube-api-access-w7lcr" (OuterVolumeSpecName: "kube-api-access-w7lcr") pod "8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77" (UID: "8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77"). InnerVolumeSpecName "kube-api-access-w7lcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:04:19.786018 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.786001    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77" (UID: "8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 15:04:19.885425 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.885400    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:04:19.885425 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.885424    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7lcr\" (UniqueName: \"kubernetes.io/projected/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-kube-api-access-w7lcr\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:04:19.885584 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:19.885434    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:04:20.015745 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:20.015671    2564 generic.go:356] "Generic (PLEG): container finished" podID="8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77" containerID="a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594" exitCode=0
Jul 10 15:04:20.015745 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:20.015709    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk" event={"ID":"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77","Type":"ContainerDied","Data":"a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594"}
Jul 10 15:04:20.015745 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:20.015716    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"
Jul 10 15:04:20.016002 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:20.015776    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk" event={"ID":"8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77","Type":"ContainerDied","Data":"fbc37683222cfca485a5d9f5071b3d1bfe011c00214561e9a0a526b1a1d88076"}
Jul 10 15:04:20.016002 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:20.015800    2564 scope.go:117] "RemoveContainer" containerID="a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594"
Jul 10 15:04:20.025309 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:20.025287    2564 scope.go:117] "RemoveContainer" containerID="a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594"
Jul 10 15:04:20.025566 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:04:20.025546    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594\": container with ID starting with a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594 not found: ID does not exist" containerID="a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594"
Jul 10 15:04:20.025634 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:20.025577    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594"} err="failed to get container status \"a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594\": rpc error: code = NotFound desc = could not find container \"a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594\": container with ID starting with a658e20559ec9665adba84e2540a97d3b41687e791634753ec7a2665f197f594 not found: ID does not exist"
Jul 10 15:04:20.037453 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:20.037419    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"]
Jul 10 15:04:20.040679 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:20.040656    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk"]
Jul 10 15:04:20.565128 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:20.565095    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77" path="/var/lib/kubelet/pods/8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77/volumes"
Jul 10 15:04:22.648604 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:22.648565    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-72c145-55b5ff9b97-6sdrk" podUID="8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.70:8443/health\": context deadline exceeded"
Jul 10 15:04:24.290138 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:24.290099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:04:29.989668 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:29.989622    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:04:34.845017 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:04:34.844978    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:00.936072 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:00.936033    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:01.213634 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:01.213539    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:01.610500 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:01.610463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:01.711006 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:01.710959    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:02.067316 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.067236    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:02.166703 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.166667    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:02.271766 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.271709    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"]
Jul 10 15:05:02.272000 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.271976    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m" podUID="8e950d7e-bf36-43a0-b768-0a1a7da8c767" containerName="maas-api" containerID="cri-o://0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba" gracePeriod=30
Jul 10 15:05:02.295531 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.295508    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:02.524383 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.524356    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:05:02.545348 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.545316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fddln\" (UniqueName: \"kubernetes.io/projected/8e950d7e-bf36-43a0-b768-0a1a7da8c767-kube-api-access-fddln\") pod \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") "
Jul 10 15:05:02.545534 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.545411    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e950d7e-bf36-43a0-b768-0a1a7da8c767-maas-api-tls\") pod \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") "
Jul 10 15:05:02.545534 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.545469    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e950d7e-bf36-43a0-b768-0a1a7da8c767-openshift-service-ca\") pod \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\" (UID: \"8e950d7e-bf36-43a0-b768-0a1a7da8c767\") "
Jul 10 15:05:02.546053 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.546015    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e950d7e-bf36-43a0-b768-0a1a7da8c767-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e950d7e-bf36-43a0-b768-0a1a7da8c767" (UID: "8e950d7e-bf36-43a0-b768-0a1a7da8c767"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:05:02.548047 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.548020    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e950d7e-bf36-43a0-b768-0a1a7da8c767-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e950d7e-bf36-43a0-b768-0a1a7da8c767" (UID: "8e950d7e-bf36-43a0-b768-0a1a7da8c767"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 15:05:02.548388 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.548358    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e950d7e-bf36-43a0-b768-0a1a7da8c767-kube-api-access-fddln" (OuterVolumeSpecName: "kube-api-access-fddln") pod "8e950d7e-bf36-43a0-b768-0a1a7da8c767" (UID: "8e950d7e-bf36-43a0-b768-0a1a7da8c767"). InnerVolumeSpecName "kube-api-access-fddln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:05:02.646458 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.646374    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fddln\" (UniqueName: \"kubernetes.io/projected/8e950d7e-bf36-43a0-b768-0a1a7da8c767-kube-api-access-fddln\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:02.646458 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.646409    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e950d7e-bf36-43a0-b768-0a1a7da8c767-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:02.646458 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:02.646420    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e950d7e-bf36-43a0-b768-0a1a7da8c767-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:03.248436 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:03.248407    2564 generic.go:356] "Generic (PLEG): container finished" podID="8e950d7e-bf36-43a0-b768-0a1a7da8c767" containerID="0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba" exitCode=0
Jul 10 15:05:03.248892 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:03.248452    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"
Jul 10 15:05:03.248892 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:03.248498    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m" event={"ID":"8e950d7e-bf36-43a0-b768-0a1a7da8c767","Type":"ContainerDied","Data":"0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba"}
Jul 10 15:05:03.248892 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:03.248549    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m" event={"ID":"8e950d7e-bf36-43a0-b768-0a1a7da8c767","Type":"ContainerDied","Data":"16b7c0b4a408e128b364dabba25b3805c24176ac3123ea13d06cd185b16f25a1"}
Jul 10 15:05:03.248892 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:03.248572    2564 scope.go:117] "RemoveContainer" containerID="0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba"
Jul 10 15:05:03.257928 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:03.257912    2564 scope.go:117] "RemoveContainer" containerID="0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba"
Jul 10 15:05:03.258224 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:05:03.258203    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba\": container with ID starting with 0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba not found: ID does not exist" containerID="0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba"
Jul 10 15:05:03.258274 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:03.258238    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba"} err="failed to get container status \"0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba\": rpc error: code = NotFound desc = could not find container \"0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba\": container with ID starting with 0537948a6a246e90b80089ee0f90dd9baa979119072c6fa7772a7d4f4db4d7ba not found: ID does not exist"
Jul 10 15:05:03.266003 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:03.265982    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"]
Jul 10 15:05:03.268335 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:03.268316    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-a68a9f-58b4bd9fc9-wx94m"]
Jul 10 15:05:04.564968 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:04.564937    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e950d7e-bf36-43a0-b768-0a1a7da8c767" path="/var/lib/kubelet/pods/8e950d7e-bf36-43a0-b768-0a1a7da8c767/volumes"
Jul 10 15:05:05.287470 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:05.287433    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:05:08.060269 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:08.060235    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:08.122217 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:08.122191    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:08.341615 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:08.341530    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"]
Jul 10 15:05:08.341837 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:08.341807    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy" containerID="cri-o://f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951" gracePeriod=30
Jul 10 15:05:08.359292 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:08.359252    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:08.605505 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:08.605475    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:08.962252 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:08.962158    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:09.300509 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:09.300432    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:09.465601 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:09.465569    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:12.608225 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.608187    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:12.692942 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.692908    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:12.697619 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.697589    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"]
Jul 10 15:05:12.698095 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.698076    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77" containerName="maas-api"
Jul 10 15:05:12.698095 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.698096    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77" containerName="maas-api"
Jul 10 15:05:12.698252 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.698119    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e950d7e-bf36-43a0-b768-0a1a7da8c767" containerName="maas-api"
Jul 10 15:05:12.698252 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.698127    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e950d7e-bf36-43a0-b768-0a1a7da8c767" containerName="maas-api"
Jul 10 15:05:12.698353 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.698258    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae22dfc-bfba-426d-aa0b-cdfd4ea55d77" containerName="maas-api"
Jul 10 15:05:12.698353 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.698270    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e950d7e-bf36-43a0-b768-0a1a7da8c767" containerName="maas-api"
Jul 10 15:05:12.702615 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.702596    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:12.705409 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.705395    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-6d41a0-serving-cert\""
Jul 10 15:05:12.714116 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.714094    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"]
Jul 10 15:05:12.734051 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.734005    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxmq\" (UniqueName: \"kubernetes.io/projected/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-kube-api-access-4zxmq\") pod \"maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:12.734164 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.734100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-maas-api-tls\") pod \"maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:12.734164 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.734134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-openshift-service-ca\") pod \"maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:12.801496 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.801463    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:12.834822 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.834789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-maas-api-tls\") pod \"maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:12.834972 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.834838    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-openshift-service-ca\") pod \"maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:12.834972 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:05:12.834933    2564 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-serving-cert: secret "maas-api-e2e-api-a-6d41a0-serving-cert" not found
Jul 10 15:05:12.835082 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:05:12.834986    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-maas-api-tls podName:ddb58d14-1a10-450e-b243-0cd7bf0ecd53 nodeName:}" failed. No retries permitted until 2026-07-10 15:05:13.334969892 +0000 UTC m=+2025.287859947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-maas-api-tls") pod "maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527" (UID: "ddb58d14-1a10-450e-b243-0cd7bf0ecd53") : secret "maas-api-e2e-api-a-6d41a0-serving-cert" not found
Jul 10 15:05:12.835082 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.835017    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxmq\" (UniqueName: \"kubernetes.io/projected/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-kube-api-access-4zxmq\") pod \"maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:12.835448 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.835429    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-openshift-service-ca\") pod \"maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:12.844051 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:12.844027    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxmq\" (UniqueName: \"kubernetes.io/projected/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-kube-api-access-4zxmq\") pod \"maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:13.243257 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.243176    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:13.340299 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.340271    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-maas-api-tls\") pod \"maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:13.343064 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.343036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-maas-api-tls\") pod \"maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:13.343225 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.343091    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:13.600522 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.600496    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:05:13.614180 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.614160    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:13.643149 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643116    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-certs\") pod \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") "
Jul 10 15:05:13.643283 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643215    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-data\") pod \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") "
Jul 10 15:05:13.643330 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643280    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-envoy\") pod \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") "
Jul 10 15:05:13.643382 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643333    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-socket\") pod \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") "
Jul 10 15:05:13.643382 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643366    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwqkp\" (UniqueName: \"kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-kube-api-access-zwqkp\") pod \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") "
Jul 10 15:05:13.643489 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643423    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e76d305-2fde-4e44-8c23-ba8ff1835c15" (UID: "2e76d305-2fde-4e44-8c23-ba8ff1835c15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:05:13.643489 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643467    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-credential-socket\") pod \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") "
Jul 10 15:05:13.643608 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643507    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-podinfo\") pod \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") "
Jul 10 15:05:13.643608 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643549    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istiod-ca-cert\") pod \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") "
Jul 10 15:05:13.643608 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643587    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-token\") pod \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\" (UID: \"2e76d305-2fde-4e44-8c23-ba8ff1835c15\") "
Jul 10 15:05:13.644078 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.643874    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:13.644078 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.644064    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e76d305-2fde-4e44-8c23-ba8ff1835c15" (UID: "2e76d305-2fde-4e44-8c23-ba8ff1835c15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:05:13.644280 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.644168    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e76d305-2fde-4e44-8c23-ba8ff1835c15" (UID: "2e76d305-2fde-4e44-8c23-ba8ff1835c15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:05:13.644280 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.644235    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e76d305-2fde-4e44-8c23-ba8ff1835c15" (UID: "2e76d305-2fde-4e44-8c23-ba8ff1835c15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:05:13.644614 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.644570    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e76d305-2fde-4e44-8c23-ba8ff1835c15" (UID: "2e76d305-2fde-4e44-8c23-ba8ff1835c15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:05:13.646498 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.646465    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e76d305-2fde-4e44-8c23-ba8ff1835c15" (UID: "2e76d305-2fde-4e44-8c23-ba8ff1835c15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:05:13.646621 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.646571    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-kube-api-access-zwqkp" (OuterVolumeSpecName: "kube-api-access-zwqkp") pod "2e76d305-2fde-4e44-8c23-ba8ff1835c15" (UID: "2e76d305-2fde-4e44-8c23-ba8ff1835c15"). InnerVolumeSpecName "kube-api-access-zwqkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:05:13.646691 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.646668    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e76d305-2fde-4e44-8c23-ba8ff1835c15" (UID: "2e76d305-2fde-4e44-8c23-ba8ff1835c15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 15:05:13.647074 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.647054    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e76d305-2fde-4e44-8c23-ba8ff1835c15" (UID: "2e76d305-2fde-4e44-8c23-ba8ff1835c15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:05:13.744690 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.744643    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:13.744690 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.744684    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:13.744690 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.744697    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:13.745001 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.744713    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwqkp\" (UniqueName: \"kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-kube-api-access-zwqkp\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:13.745001 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.744729    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e76d305-2fde-4e44-8c23-ba8ff1835c15-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:13.745001 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.744741    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:13.745001 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.744773    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:13.745001 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.744785    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e76d305-2fde-4e44-8c23-ba8ff1835c15-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:13.760205 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:13.760079    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"]
Jul 10 15:05:13.762983 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:05:13.762953    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb58d14_1a10_450e_b243_0cd7bf0ecd53.slice/crio-87502c620e9e0583675feed85063acb43329da5ae61607e52972e24b5c3d5b56 WatchSource:0}: Error finding container 87502c620e9e0583675feed85063acb43329da5ae61607e52972e24b5c3d5b56: Status 404 returned error can't find the container with id 87502c620e9e0583675feed85063acb43329da5ae61607e52972e24b5c3d5b56
Jul 10 15:05:14.310434 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.310407    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527" event={"ID":"ddb58d14-1a10-450e-b243-0cd7bf0ecd53","Type":"ContainerStarted","Data":"f564a16725ca1cf0f67c451f98fa709a154311f83a7b228176846208fc902451"}
Jul 10 15:05:14.310563 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.310454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527" event={"ID":"ddb58d14-1a10-450e-b243-0cd7bf0ecd53","Type":"ContainerStarted","Data":"87502c620e9e0583675feed85063acb43329da5ae61607e52972e24b5c3d5b56"}
Jul 10 15:05:14.310627 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.310607    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:14.312144 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.312124    2564 generic.go:356] "Generic (PLEG): container finished" podID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerID="f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951" exitCode=0
Jul 10 15:05:14.312207 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.312166    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"
Jul 10 15:05:14.312252 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.312202    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" event={"ID":"2e76d305-2fde-4e44-8c23-ba8ff1835c15","Type":"ContainerDied","Data":"f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951"}
Jul 10 15:05:14.312252 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.312243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9" event={"ID":"2e76d305-2fde-4e44-8c23-ba8ff1835c15","Type":"ContainerDied","Data":"0f4d9eca9592a2998815141a1203a93c35c55fe68bf31b624bf7433e0d14efa3"}
Jul 10 15:05:14.312326 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.312266    2564 scope.go:117] "RemoveContainer" containerID="f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951"
Jul 10 15:05:14.321143 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.321128    2564 scope.go:117] "RemoveContainer" containerID="7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278"
Jul 10 15:05:14.328708 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.328665    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527" podStartSLOduration=1.863339342 podStartE2EDuration="2.328651553s" totalImagesPullingTime="465.312211ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:05:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:05:14.326990404 +0000 UTC m=+2026.279880485" watchObservedRunningTime="2026-07-10 15:05:14.328651553 +0000 UTC m=+2026.281541629"
Jul 10 15:05:14.329578 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.329562    2564 scope.go:117] "RemoveContainer" containerID="f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951"
Jul 10 15:05:14.329921 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:05:14.329892    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951\": container with ID starting with f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951 not found: ID does not exist" containerID="f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951"
Jul 10 15:05:14.330007 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.329932    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951"} err="failed to get container status \"f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951\": rpc error: code = NotFound desc = could not find container \"f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951\": container with ID starting with f4e20a3ecbe9398615b461d11ad3b1e4c0301ae99516c3e44706cf044bc24951 not found: ID does not exist"
Jul 10 15:05:14.330007 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.329956    2564 scope.go:117] "RemoveContainer" containerID="7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278"
Jul 10 15:05:14.330212 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:05:14.330192    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278\": container with ID starting with 7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278 not found: ID does not exist" containerID="7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278"
Jul 10 15:05:14.330276 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.330218    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278"} err="failed to get container status \"7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278\": rpc error: code = NotFound desc = could not find container \"7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278\": container with ID starting with 7986ef531707baab70e7c220d8b5ecc1cb172bfb4bb64405ffce5644f8690278 not found: ID does not exist"
Jul 10 15:05:14.342702 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.342675    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"]
Jul 10 15:05:14.345905 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.345888    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a68a9f-openshift-default-7665f85cf7-wfrc9"]
Jul 10 15:05:14.565074 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:14.564997    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" path="/var/lib/kubelet/pods/2e76d305-2fde-4e44-8c23-ba8ff1835c15/volumes"
Jul 10 15:05:17.161887 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.161850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:17.668608 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.668556    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:17.980280 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.980124    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"]
Jul 10 15:05:17.980880 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.980856    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy"
Jul 10 15:05:17.980880 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.980882    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy"
Jul 10 15:05:17.981040 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.980899    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy"
Jul 10 15:05:17.981040 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.980908    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy"
Jul 10 15:05:17.981040 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.981035    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy"
Jul 10 15:05:17.981174 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.981044    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e76d305-2fde-4e44-8c23-ba8ff1835c15" containerName="istio-proxy"
Jul 10 15:05:17.985711 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.985692    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:17.988917 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.988896    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1026a0-openshift-default-dockercfg-dblmf\""
Jul 10 15:05:17.999408 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:17.999387    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"]
Jul 10 15:05:18.006777 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.006738    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:05:18.013120 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.013086    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:18.086913 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.086889    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-token\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.087045 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.086927    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-socket\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.087045 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.086950    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-envoy\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.087120 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.087048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istiod-ca-cert\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.087120 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.087078    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9759\" (UniqueName: \"kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-kube-api-access-g9759\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.087187 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.087173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-data\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.087325 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.087308    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-credential-socket\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.087362 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.087333    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-podinfo\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.087431 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.087410    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-certs\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.133604 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.133573    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:18.188696 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.188667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-credential-socket\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.188696 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.188696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-podinfo\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189174 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.188725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-certs\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189174 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.188785    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-token\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189174 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.188814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-socket\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189174 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.188833    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-envoy\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189174 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.188849    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istiod-ca-cert\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189174 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.188868    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9759\" (UniqueName: \"kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-kube-api-access-g9759\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189174 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.189137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-credential-socket\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189174 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.189160    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-certs\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189620 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.189201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-data\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189620 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.189221    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-socket\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189620 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.189492    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-data\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.189740 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.189626    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istiod-ca-cert\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.191371 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.191341    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-envoy\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.192207 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.192189    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-podinfo\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.205051 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.204999    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-token\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.205200 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.205066    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9759\" (UniqueName: \"kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-kube-api-access-g9759\") pod \"e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") " pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.296336 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.296265    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:18.436520 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.436487    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"]
Jul 10 15:05:18.440129 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:05:18.440099    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded07d14a_c9e6_47b5_836e_8f46ff6bb84b.slice/crio-eedc2f1639f354f624ba3725d715e5f6b1ee64ca92cc468b6eb5c7554598483c WatchSource:0}: Error finding container eedc2f1639f354f624ba3725d715e5f6b1ee64ca92cc468b6eb5c7554598483c: Status 404 returned error can't find the container with id eedc2f1639f354f624ba3725d715e5f6b1ee64ca92cc468b6eb5c7554598483c
Jul 10 15:05:18.442499 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.442459    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:05:18.442596 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.442541    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:05:18.442596 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:18.442584    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:05:19.344204 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:19.344162    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" event={"ID":"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b","Type":"ContainerStarted","Data":"060c23ec8e0efa672244d4f8da654850bd09c92587fa1043977c0a8f54888273"}
Jul 10 15:05:19.344587 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:19.344223    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" event={"ID":"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b","Type":"ContainerStarted","Data":"eedc2f1639f354f624ba3725d715e5f6b1ee64ca92cc468b6eb5c7554598483c"}
Jul 10 15:05:19.364830 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:19.364788    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" podStartSLOduration=2.364746127 podStartE2EDuration="2.364746127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:05:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:05:19.3632679 +0000 UTC m=+2031.316157980" watchObservedRunningTime="2026-07-10 15:05:19.364746127 +0000 UTC m=+2031.317636206"
Jul 10 15:05:20.296556 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:20.296521    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:20.301463 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:20.301439    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:20.324505 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:20.324479    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:20.349910 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:20.349881    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:20.350986 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:20.350963    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:21.333154 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.333116    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:21.406375 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.406343    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"]
Jul 10 15:05:21.410479 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.410459    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.413124 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.413106    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1026a0-serving-cert\""
Jul 10 15:05:21.421828 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.421794    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"]
Jul 10 15:05:21.430141 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.430109    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:21.500491 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.500455    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:21.521952 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.521928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5db2512-b348-42da-9850-f08bb4818d68-maas-api-tls\") pod \"maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.522099 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.522066    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5db2512-b348-42da-9850-f08bb4818d68-openshift-service-ca\") pod \"maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.522177 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.522105    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42gkp\" (UniqueName: \"kubernetes.io/projected/d5db2512-b348-42da-9850-f08bb4818d68-kube-api-access-42gkp\") pod \"maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.623595 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.623567    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5db2512-b348-42da-9850-f08bb4818d68-openshift-service-ca\") pod \"maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.623801 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.623608    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42gkp\" (UniqueName: \"kubernetes.io/projected/d5db2512-b348-42da-9850-f08bb4818d68-kube-api-access-42gkp\") pod \"maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.623801 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.623651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5db2512-b348-42da-9850-f08bb4818d68-maas-api-tls\") pod \"maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.624245 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.624220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5db2512-b348-42da-9850-f08bb4818d68-openshift-service-ca\") pod \"maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.626093 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.626071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5db2512-b348-42da-9850-f08bb4818d68-maas-api-tls\") pod \"maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.634903 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.634879    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42gkp\" (UniqueName: \"kubernetes.io/projected/d5db2512-b348-42da-9850-f08bb4818d68-kube-api-access-42gkp\") pod \"maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.659806 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.659776    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:21.724919 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.724884    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:21.886129 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.886046    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:21.894364 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.894336    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"]
Jul 10 15:05:21.896107 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:05:21.896083    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5db2512_b348_42da_9850_f08bb4818d68.slice/crio-9603514355a29b852685e3c2ba0aa9a783b89e1c52d4a8c41df4b61e02acd9ae WatchSource:0}: Error finding container 9603514355a29b852685e3c2ba0aa9a783b89e1c52d4a8c41df4b61e02acd9ae: Status 404 returned error can't find the container with id 9603514355a29b852685e3c2ba0aa9a783b89e1c52d4a8c41df4b61e02acd9ae
Jul 10 15:05:21.987010 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:21.986974    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:22.362211 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:22.362168    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p" event={"ID":"d5db2512-b348-42da-9850-f08bb4818d68","Type":"ContainerStarted","Data":"9603514355a29b852685e3c2ba0aa9a783b89e1c52d4a8c41df4b61e02acd9ae"}
Jul 10 15:05:23.369275 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:23.369235    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p" event={"ID":"d5db2512-b348-42da-9850-f08bb4818d68","Type":"ContainerStarted","Data":"a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4"}
Jul 10 15:05:23.369677 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:23.369301    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:23.391730 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:23.391687    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p" podStartSLOduration=1.940855065 podStartE2EDuration="2.391672966s" totalImagesPullingTime="450.817901ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:05:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:05:23.389273088 +0000 UTC m=+2035.342163189" watchObservedRunningTime="2026-07-10 15:05:23.391672966 +0000 UTC m=+2035.344563043"
Jul 10 15:05:25.874993 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:25.874950    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:29.381124 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:29.381095    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:30.994256 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:30.994219    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:05:34.056896 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.056861    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:34.150858 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.150818    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:34.252261 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.252188    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:34.299111 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.299069    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"]
Jul 10 15:05:34.299425 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.299393    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527" podUID="ddb58d14-1a10-450e-b243-0cd7bf0ecd53" containerName="maas-api" containerID="cri-o://f564a16725ca1cf0f67c451f98fa709a154311f83a7b228176846208fc902451" gracePeriod=30
Jul 10 15:05:34.330678 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.330653    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:34.438372 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.438192    2564 generic.go:356] "Generic (PLEG): container finished" podID="ddb58d14-1a10-450e-b243-0cd7bf0ecd53" containerID="f564a16725ca1cf0f67c451f98fa709a154311f83a7b228176846208fc902451" exitCode=0
Jul 10 15:05:34.438372 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.438263    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527" event={"ID":"ddb58d14-1a10-450e-b243-0cd7bf0ecd53","Type":"ContainerDied","Data":"f564a16725ca1cf0f67c451f98fa709a154311f83a7b228176846208fc902451"}
Jul 10 15:05:34.593180 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.593158    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:34.632159 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.632125    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:34.756776 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.756017    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-maas-api-tls\") pod \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") "
Jul 10 15:05:34.756776 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.756079    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-openshift-service-ca\") pod \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") "
Jul 10 15:05:34.756776 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.756176    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zxmq\" (UniqueName: \"kubernetes.io/projected/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-kube-api-access-4zxmq\") pod \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\" (UID: \"ddb58d14-1a10-450e-b243-0cd7bf0ecd53\") "
Jul 10 15:05:34.757151 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.757055    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ddb58d14-1a10-450e-b243-0cd7bf0ecd53" (UID: "ddb58d14-1a10-450e-b243-0cd7bf0ecd53"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:05:34.765794 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.765443    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ddb58d14-1a10-450e-b243-0cd7bf0ecd53" (UID: "ddb58d14-1a10-450e-b243-0cd7bf0ecd53"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 15:05:34.765922 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.765825    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-kube-api-access-4zxmq" (OuterVolumeSpecName: "kube-api-access-4zxmq") pod "ddb58d14-1a10-450e-b243-0cd7bf0ecd53" (UID: "ddb58d14-1a10-450e-b243-0cd7bf0ecd53"). InnerVolumeSpecName "kube-api-access-4zxmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:05:34.857240 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.857209    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zxmq\" (UniqueName: \"kubernetes.io/projected/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-kube-api-access-4zxmq\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:34.857408 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.857394    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:34.857514 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:34.857501    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddb58d14-1a10-450e-b243-0cd7bf0ecd53-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:35.448367 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:35.448330    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527" event={"ID":"ddb58d14-1a10-450e-b243-0cd7bf0ecd53","Type":"ContainerDied","Data":"87502c620e9e0583675feed85063acb43329da5ae61607e52972e24b5c3d5b56"}
Jul 10 15:05:35.448943 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:35.448923    2564 scope.go:117] "RemoveContainer" containerID="f564a16725ca1cf0f67c451f98fa709a154311f83a7b228176846208fc902451"
Jul 10 15:05:35.449151 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:35.448641    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"
Jul 10 15:05:35.482539 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:35.482510    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"]
Jul 10 15:05:35.489773 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:35.488367    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6d41a0-dbb74cb96-fq527"]
Jul 10 15:05:36.434445 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:36.434414    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:36.566164 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:36.566118    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddb58d14-1a10-450e-b243-0cd7bf0ecd53" path="/var/lib/kubelet/pods/ddb58d14-1a10-450e-b243-0cd7bf0ecd53/volumes"
Jul 10 15:05:39.474153 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:39.474121    2564 generic.go:356] "Generic (PLEG): container finished" podID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerID="060c23ec8e0efa672244d4f8da654850bd09c92587fa1043977c0a8f54888273" exitCode=0
Jul 10 15:05:39.474681 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:39.474197    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" event={"ID":"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b","Type":"ContainerDied","Data":"060c23ec8e0efa672244d4f8da654850bd09c92587fa1043977c0a8f54888273"}
Jul 10 15:05:39.474789 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:39.474698    2564 scope.go:117] "RemoveContainer" containerID="060c23ec8e0efa672244d4f8da654850bd09c92587fa1043977c0a8f54888273"
Jul 10 15:05:39.475803 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:39.475775    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:05:39.475875 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:39.475849    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:05:39.475914 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:39.475883    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:05:40.296518 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:40.296484    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:40.366913 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:40.366866    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:40.481919 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:40.481883    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" event={"ID":"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b","Type":"ContainerStarted","Data":"bf52b3d2222b1bbad1ff3d8d5e2325f7e6b7cb424b84396a28ac7c0fdfdfb733"}
Jul 10 15:05:40.573481 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:40.573302    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:40.812296 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:40.812257    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:40.965969 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:40.964163    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:41.297008 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:41.296920    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:41.297171 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:41.297108    2564 patch_prober.go:28] interesting pod/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Jul 10 15:05:41.297224 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:41.297162    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Jul 10 15:05:41.413135 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:41.413077    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:41.534916 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:41.534886    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:41.632840 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:41.632789    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:41.771843 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:41.771805    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"]
Jul 10 15:05:41.772092 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:41.772055    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p" podUID="d5db2512-b348-42da-9850-f08bb4818d68" containerName="maas-api" containerID="cri-o://a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4" gracePeriod=30
Jul 10 15:05:41.798437 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:41.798301    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:42.073968 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.073942    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:42.125401 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.125371    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5db2512-b348-42da-9850-f08bb4818d68-maas-api-tls\") pod \"d5db2512-b348-42da-9850-f08bb4818d68\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") "
Jul 10 15:05:42.125569 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.125418    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42gkp\" (UniqueName: \"kubernetes.io/projected/d5db2512-b348-42da-9850-f08bb4818d68-kube-api-access-42gkp\") pod \"d5db2512-b348-42da-9850-f08bb4818d68\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") "
Jul 10 15:05:42.125569 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.125455    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5db2512-b348-42da-9850-f08bb4818d68-openshift-service-ca\") pod \"d5db2512-b348-42da-9850-f08bb4818d68\" (UID: \"d5db2512-b348-42da-9850-f08bb4818d68\") "
Jul 10 15:05:42.125885 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.125858    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5db2512-b348-42da-9850-f08bb4818d68-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5db2512-b348-42da-9850-f08bb4818d68" (UID: "d5db2512-b348-42da-9850-f08bb4818d68"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:05:42.127576 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.127557    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5db2512-b348-42da-9850-f08bb4818d68-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5db2512-b348-42da-9850-f08bb4818d68" (UID: "d5db2512-b348-42da-9850-f08bb4818d68"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 15:05:42.127654 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.127633    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5db2512-b348-42da-9850-f08bb4818d68-kube-api-access-42gkp" (OuterVolumeSpecName: "kube-api-access-42gkp") pod "d5db2512-b348-42da-9850-f08bb4818d68" (UID: "d5db2512-b348-42da-9850-f08bb4818d68"). InnerVolumeSpecName "kube-api-access-42gkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:05:42.226392 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.226312    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5db2512-b348-42da-9850-f08bb4818d68-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:42.226392 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.226338    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42gkp\" (UniqueName: \"kubernetes.io/projected/d5db2512-b348-42da-9850-f08bb4818d68-kube-api-access-42gkp\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:42.226392 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.226349    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5db2512-b348-42da-9850-f08bb4818d68-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:42.296817 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.296783    2564 patch_prober.go:28] interesting pod/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Jul 10 15:05:42.296971 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.296852    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Jul 10 15:05:42.495772 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.495666    2564 generic.go:356] "Generic (PLEG): container finished" podID="d5db2512-b348-42da-9850-f08bb4818d68" containerID="a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4" exitCode=0
Jul 10 15:05:42.495772 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.495711    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"
Jul 10 15:05:42.495772 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.495714    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p" event={"ID":"d5db2512-b348-42da-9850-f08bb4818d68","Type":"ContainerDied","Data":"a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4"}
Jul 10 15:05:42.496234 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.495857    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p" event={"ID":"d5db2512-b348-42da-9850-f08bb4818d68","Type":"ContainerDied","Data":"9603514355a29b852685e3c2ba0aa9a783b89e1c52d4a8c41df4b61e02acd9ae"}
Jul 10 15:05:42.496234 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.495889    2564 scope.go:117] "RemoveContainer" containerID="a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4"
Jul 10 15:05:42.506435 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.506412    2564 scope.go:117] "RemoveContainer" containerID="a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4"
Jul 10 15:05:42.506686 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:05:42.506666    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4\": container with ID starting with a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4 not found: ID does not exist" containerID="a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4"
Jul 10 15:05:42.506729 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.506695    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4"} err="failed to get container status \"a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4\": rpc error: code = NotFound desc = could not find container \"a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4\": container with ID starting with a07b4b3fc8ed1e32607774ac2b3bd4b8912d00a6e9bba620c194fc0d7c5820c4 not found: ID does not exist"
Jul 10 15:05:42.518202 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.518182    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"]
Jul 10 15:05:42.520439 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.520417    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1026a0-7fbfc5685-fl67p"]
Jul 10 15:05:42.567111 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:42.567085    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5db2512-b348-42da-9850-f08bb4818d68" path="/var/lib/kubelet/pods/d5db2512-b348-42da-9850-f08bb4818d68/volumes"
Jul 10 15:05:43.297288 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:43.297256    2564 patch_prober.go:28] interesting pod/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Jul 10 15:05:43.297458 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:43.297308    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Jul 10 15:05:44.302376 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:44.302346    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:44.302864 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:44.302636    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:44.303398 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:44.303378    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:46.892617 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:46.892585    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:05:47.168699 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:47.168615    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:47.269364 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:47.269324    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:47.418357 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:47.418321    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"]
Jul 10 15:05:47.418639 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:47.418610    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerName="istio-proxy" containerID="cri-o://bf52b3d2222b1bbad1ff3d8d5e2325f7e6b7cb424b84396a28ac7c0fdfdfb733" gracePeriod=30
Jul 10 15:05:47.441505 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:47.441475    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:47.672805 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:47.672690    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:48.050548 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:48.050467    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:48.476476 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:48.476440    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:48.781153 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:48.781034    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:51.832908 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.832874    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:51.905430 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.905397    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"]
Jul 10 15:05:51.906055 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.906030    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb58d14-1a10-450e-b243-0cd7bf0ecd53" containerName="maas-api"
Jul 10 15:05:51.906055 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.906053    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb58d14-1a10-450e-b243-0cd7bf0ecd53" containerName="maas-api"
Jul 10 15:05:51.906276 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.906068    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5db2512-b348-42da-9850-f08bb4818d68" containerName="maas-api"
Jul 10 15:05:51.906276 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.906077    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5db2512-b348-42da-9850-f08bb4818d68" containerName="maas-api"
Jul 10 15:05:51.906276 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.906174    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddb58d14-1a10-450e-b243-0cd7bf0ecd53" containerName="maas-api"
Jul 10 15:05:51.906276 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.906188    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5db2512-b348-42da-9850-f08bb4818d68" containerName="maas-api"
Jul 10 15:05:51.910366 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.910316    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:51.910995 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.910977    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:51.913618 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.913597    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-1f1c9a-serving-cert\""
Jul 10 15:05:51.920274 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.920231    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"]
Jul 10 15:05:51.981543 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:51.981509    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:52.008036 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.008006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c95661-3316-4d06-bbbe-19859cfe30b8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:52.008171 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.008133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c95661-3316-4d06-bbbe-19859cfe30b8-maas-api-tls\") pod \"maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:52.008171 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.008163    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77p7m\" (UniqueName: \"kubernetes.io/projected/54c95661-3316-4d06-bbbe-19859cfe30b8-kube-api-access-77p7m\") pod \"maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:52.080876 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.080841    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:52.109123 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.109095    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c95661-3316-4d06-bbbe-19859cfe30b8-maas-api-tls\") pod \"maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:52.109258 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.109127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77p7m\" (UniqueName: \"kubernetes.io/projected/54c95661-3316-4d06-bbbe-19859cfe30b8-kube-api-access-77p7m\") pod \"maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:52.109258 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.109191    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c95661-3316-4d06-bbbe-19859cfe30b8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:52.109851 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.109806    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c95661-3316-4d06-bbbe-19859cfe30b8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:52.111619 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.111599    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c95661-3316-4d06-bbbe-19859cfe30b8-maas-api-tls\") pod \"maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:52.123464 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.123439    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77p7m\" (UniqueName: \"kubernetes.io/projected/54c95661-3316-4d06-bbbe-19859cfe30b8-kube-api-access-77p7m\") pod \"maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:52.223301 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.222491    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:52.366942 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.366915    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"]
Jul 10 15:05:52.368845 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:05:52.368821    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c95661_3316_4d06_bbbe_19859cfe30b8.slice/crio-740c3c2cd59578222aa79adf25d311c0cca3d705cb0e74223ae236c4fb19217c WatchSource:0}: Error finding container 740c3c2cd59578222aa79adf25d311c0cca3d705cb0e74223ae236c4fb19217c: Status 404 returned error can't find the container with id 740c3c2cd59578222aa79adf25d311c0cca3d705cb0e74223ae236c4fb19217c
Jul 10 15:05:52.373508 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.373480    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:52.474593 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.474566    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:52.556025 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.555992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64" event={"ID":"54c95661-3316-4d06-bbbe-19859cfe30b8","Type":"ContainerStarted","Data":"740c3c2cd59578222aa79adf25d311c0cca3d705cb0e74223ae236c4fb19217c"}
Jul 10 15:05:52.558085 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.558058    2564 generic.go:356] "Generic (PLEG): container finished" podID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerID="bf52b3d2222b1bbad1ff3d8d5e2325f7e6b7cb424b84396a28ac7c0fdfdfb733" exitCode=0
Jul 10 15:05:52.564084 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.564060    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" event={"ID":"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b","Type":"ContainerDied","Data":"bf52b3d2222b1bbad1ff3d8d5e2325f7e6b7cb424b84396a28ac7c0fdfdfb733"}
Jul 10 15:05:52.564190 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.564113    2564 scope.go:117] "RemoveContainer" containerID="060c23ec8e0efa672244d4f8da654850bd09c92587fa1043977c0a8f54888273"
Jul 10 15:05:52.664612 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.664588    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:52.714220 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714183    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-certs\") pod \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") "
Jul 10 15:05:52.714220 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714219    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-token\") pod \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") "
Jul 10 15:05:52.714453 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714253    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-data\") pod \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") "
Jul 10 15:05:52.714453 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714299    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-socket\") pod \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") "
Jul 10 15:05:52.714453 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714340    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-credential-socket\") pod \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") "
Jul 10 15:05:52.714453 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714374    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istiod-ca-cert\") pod \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") "
Jul 10 15:05:52.714453 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714414    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9759\" (UniqueName: \"kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-kube-api-access-g9759\") pod \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") "
Jul 10 15:05:52.714719 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714485    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-podinfo\") pod \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") "
Jul 10 15:05:52.714719 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714530    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-envoy\") pod \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\" (UID: \"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b\") "
Jul 10 15:05:52.714860 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714480    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" (UID: "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:05:52.714860 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714571    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" (UID: "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:05:52.714860 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.714811    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" (UID: "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:05:52.715287 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.715237    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" (UID: "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:05:52.715400 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.715340    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" (UID: "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:05:52.716731 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.716708    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" (UID: "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:05:52.716938 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.716920    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" (UID: "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 15:05:52.717263 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.717241    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" (UID: "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:05:52.717313 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.717245    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-kube-api-access-g9759" (OuterVolumeSpecName: "kube-api-access-g9759") pod "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" (UID: "ed07d14a-c9e6-47b5-836e-8f46ff6bb84b"). InnerVolumeSpecName "kube-api-access-g9759". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:05:52.815429 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.815403    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:52.815429 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.815428    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:52.815429 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.815438    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:52.815622 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.815450    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:52.815622 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.815462    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:52.815622 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.815474    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:52.815622 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.815487    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:52.815622 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.815499    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:52.815622 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:52.815512    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9759\" (UniqueName: \"kubernetes.io/projected/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b-kube-api-access-g9759\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:05:53.565647 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:53.565550    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64" event={"ID":"54c95661-3316-4d06-bbbe-19859cfe30b8","Type":"ContainerStarted","Data":"efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470"}
Jul 10 15:05:53.565647 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:53.565614    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:53.566820 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:53.566802    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"
Jul 10 15:05:53.566976 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:53.566804    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6" event={"ID":"ed07d14a-c9e6-47b5-836e-8f46ff6bb84b","Type":"ContainerDied","Data":"eedc2f1639f354f624ba3725d715e5f6b1ee64ca92cc468b6eb5c7554598483c"}
Jul 10 15:05:53.566976 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:53.566940    2564 scope.go:117] "RemoveContainer" containerID="bf52b3d2222b1bbad1ff3d8d5e2325f7e6b7cb424b84396a28ac7c0fdfdfb733"
Jul 10 15:05:53.585010 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:53.584963    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64" podStartSLOduration=2.138095839 podStartE2EDuration="2.584948372s" totalImagesPullingTime="446.852533ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:05:53.584382441 +0000 UTC m=+2065.537272515" watchObservedRunningTime="2026-07-10 15:05:53.584948372 +0000 UTC m=+2065.537838449"
Jul 10 15:05:53.602282 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:53.602260    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"]
Jul 10 15:05:53.607107 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:53.607087    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1026a0-openshift-default-66dd96c66f-gcpk6"]
Jul 10 15:05:54.565176 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:54.565139    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" path="/var/lib/kubelet/pods/ed07d14a-c9e6-47b5-836e-8f46ff6bb84b/volumes"
Jul 10 15:05:56.378472 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:56.378433    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:56.739488 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:56.739387    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:57.067360 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.067259    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"]
Jul 10 15:05:57.067910 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.067882    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerName="istio-proxy"
Jul 10 15:05:57.067910 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.067906    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerName="istio-proxy"
Jul 10 15:05:57.068128 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.067941    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerName="istio-proxy"
Jul 10 15:05:57.068128 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.067949    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerName="istio-proxy"
Jul 10 15:05:57.068128 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.068041    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerName="istio-proxy"
Jul 10 15:05:57.072625 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.072604    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.075333 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.075311    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-f923ab-openshift-default-dockercfg-77v9b\""
Jul 10 15:05:57.085339 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.084891    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"]
Jul 10 15:05:57.100413 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.100389    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:57.156253 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.156228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-envoy\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.156396 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.156276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-credential-socket\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.156396 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.156362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q6hc\" (UniqueName: \"kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-kube-api-access-2q6hc\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.156396 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.156390    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-token\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.156543 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.156430    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-podinfo\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.156543 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.156495    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-data\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.156543 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.156531    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-socket\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.156653 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.156553    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80365911-f635-42bb-90a4-d01fe0e4caf5-istiod-ca-cert\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.156653 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.156572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-certs\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.191673 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.191647    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:05:57.258009 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.257974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-envoy\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258192 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-credential-socket\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258192 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258107    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q6hc\" (UniqueName: \"kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-kube-api-access-2q6hc\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258307 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258251    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-token\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258362 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258335    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-podinfo\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258426 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-data\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258514 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-socket\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258514 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258492    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80365911-f635-42bb-90a4-d01fe0e4caf5-istiod-ca-cert\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258633 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-certs\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258685 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258493    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-credential-socket\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258789 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-data\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.258873 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.258849    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-socket\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.259054 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.259031    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-certs\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.259439 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.259410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80365911-f635-42bb-90a4-d01fe0e4caf5-istiod-ca-cert\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.260598 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.260576    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-envoy\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.260968 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.260949    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-podinfo\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.266102 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.266083    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-token\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.266419 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.266399    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q6hc\" (UniqueName: \"kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-kube-api-access-2q6hc\") pod \"e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") " pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.384583 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.384557    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:57.530563 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.530539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"]
Jul 10 15:05:57.532408 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:05:57.532382    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80365911_f635_42bb_90a4_d01fe0e4caf5.slice/crio-118f3508129e0b44bbb07d7c1d93c0363210a514aa93b020c035c8932fbcd4a5 WatchSource:0}: Error finding container 118f3508129e0b44bbb07d7c1d93c0363210a514aa93b020c035c8932fbcd4a5: Status 404 returned error can't find the container with id 118f3508129e0b44bbb07d7c1d93c0363210a514aa93b020c035c8932fbcd4a5
Jul 10 15:05:57.534727 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.534692    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:05:57.534831 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.534809    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:05:57.534888 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.534852    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:05:57.591450 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:57.591425    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" event={"ID":"80365911-f635-42bb-90a4-d01fe0e4caf5","Type":"ContainerStarted","Data":"118f3508129e0b44bbb07d7c1d93c0363210a514aa93b020c035c8932fbcd4a5"}
Jul 10 15:05:58.598457 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:58.598421    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" event={"ID":"80365911-f635-42bb-90a4-d01fe0e4caf5","Type":"ContainerStarted","Data":"e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9"}
Jul 10 15:05:58.623476 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:58.623437    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" podStartSLOduration=1.6234228609999999 podStartE2EDuration="1.623422861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:05:58.622455977 +0000 UTC m=+2070.575346074" watchObservedRunningTime="2026-07-10 15:05:58.623422861 +0000 UTC m=+2070.576313011"
Jul 10 15:05:59.385051 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:59.385020    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:59.389918 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:59.389894    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:59.579109 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:59.579081    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:05:59.603629 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:59.603602    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:59.604747 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:59.604727    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:05:59.886693 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:05:59.886662    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:06:00.625682 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.625619    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:00.704382 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.704352    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"]
Jul 10 15:06:00.704835 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.704812    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed07d14a-c9e6-47b5-836e-8f46ff6bb84b" containerName="istio-proxy"
Jul 10 15:06:00.707951 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.707909    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:00.710789 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.710746    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f923ab-serving-cert\""
Jul 10 15:06:00.717136 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.717080    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:00.722403 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.722377    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"]
Jul 10 15:06:00.792215 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.792182    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2df23f-dd5a-4a74-9ffa-adf4488028db-maas-api-tls\") pod \"maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:00.792378 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.792228    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbmb4\" (UniqueName: \"kubernetes.io/projected/1e2df23f-dd5a-4a74-9ffa-adf4488028db-kube-api-access-lbmb4\") pod \"maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:00.792464 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.792373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2df23f-dd5a-4a74-9ffa-adf4488028db-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:00.802518 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.802487    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:00.893243 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.893161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbmb4\" (UniqueName: \"kubernetes.io/projected/1e2df23f-dd5a-4a74-9ffa-adf4488028db-kube-api-access-lbmb4\") pod \"maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:00.893384 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.893258    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2df23f-dd5a-4a74-9ffa-adf4488028db-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:00.893384 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.893339    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2df23f-dd5a-4a74-9ffa-adf4488028db-maas-api-tls\") pod \"maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:00.894040 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.894021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2df23f-dd5a-4a74-9ffa-adf4488028db-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:00.895865 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.895845    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2df23f-dd5a-4a74-9ffa-adf4488028db-maas-api-tls\") pod \"maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:00.903476 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.903452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbmb4\" (UniqueName: \"kubernetes.io/projected/1e2df23f-dd5a-4a74-9ffa-adf4488028db-kube-api-access-lbmb4\") pod \"maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:00.943454 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:00.943422    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:01.021560 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:01.021535    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:01.182591 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:01.182568    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"]
Jul 10 15:06:01.184342 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:06:01.184316    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2df23f_dd5a_4a74_9ffa_adf4488028db.slice/crio-93fffed597f2a33a1d53945eed7fc149439e9a86c76721317519e736c04ae0c1 WatchSource:0}: Error finding container 93fffed597f2a33a1d53945eed7fc149439e9a86c76721317519e736c04ae0c1: Status 404 returned error can't find the container with id 93fffed597f2a33a1d53945eed7fc149439e9a86c76721317519e736c04ae0c1
Jul 10 15:06:01.353164 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:01.353133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:01.456608 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:01.456518    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:01.622269 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:01.622238    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5" event={"ID":"1e2df23f-dd5a-4a74-9ffa-adf4488028db","Type":"ContainerStarted","Data":"121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f"}
Jul 10 15:06:01.622413 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:01.622321    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5" event={"ID":"1e2df23f-dd5a-4a74-9ffa-adf4488028db","Type":"ContainerStarted","Data":"93fffed597f2a33a1d53945eed7fc149439e9a86c76721317519e736c04ae0c1"}
Jul 10 15:06:01.622588 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:01.622565    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:01.642169 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:01.642115    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5" podStartSLOduration=1.287363227 podStartE2EDuration="1.642096134s" totalImagesPullingTime="354.732907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:06:01.639096782 +0000 UTC m=+2073.591986885" watchObservedRunningTime="2026-07-10 15:06:01.642096134 +0000 UTC m=+2073.594986215"
Jul 10 15:06:05.150580 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:05.150539    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:08.649067 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:08.649035    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:06:12.402727 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:12.402688    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:06:13.188636 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:13.188603    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:13.289472 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:13.289375    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:14.604738 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:14.604707    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 10 15:06:14.605173 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:14.604780    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 10 15:06:14.702716 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:14.702647    2564 generic.go:356] "Generic (PLEG): container finished" podID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerID="e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9" exitCode=0
Jul 10 15:06:14.702863 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:14.702721    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" event={"ID":"80365911-f635-42bb-90a4-d01fe0e4caf5","Type":"ContainerDied","Data":"e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9"}
Jul 10 15:06:14.703139 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:14.703126    2564 scope.go:117] "RemoveContainer" containerID="e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9"
Jul 10 15:06:14.704177 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:14.704108    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:06:14.704177 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:14.704175    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:06:14.704322 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:14.704208    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 10 15:06:15.710732 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:15.710699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" event={"ID":"80365911-f635-42bb-90a4-d01fe0e4caf5","Type":"ContainerStarted","Data":"85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901"}
Jul 10 15:06:16.385333 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:16.385292    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:06:16.385540 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:16.385516    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 10 15:06:16.385613 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:16.385595    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 10 15:06:16.545919 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:16.545884    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:17.385343 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:17.385303    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 10 15:06:17.385838 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:17.385363    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 10 15:06:18.385505 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:18.385464    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 10 15:06:18.386010 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:18.385540    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 10 15:06:19.385459 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:19.385424    2564 patch_prober.go:28] interesting pod/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Jul 10 15:06:19.385643 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:19.385478    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Jul 10 15:06:20.388971 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:20.388939    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:06:20.389338 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:20.389225    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:06:20.389904 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:20.389884    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:06:22.067086 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:22.067041    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:22.166256 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:22.166222    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:22.787464 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:22.787432    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:06:28.145351 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:28.145312    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:28.245936 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:28.245890    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:28.634575 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:28.634545    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 15:06:28.635716 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:28.635692    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 15:06:47.031275 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:47.031231    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:06:50.591166 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:06:50.591133    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:07:07.492873 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:07:07.492839    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:07:16.602907 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:07:16.602869    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:07:23.287586 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:07:23.287372    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:07:38.095436 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:07:38.095395    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:07:52.389079 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:07:52.389044    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:08:09.287941 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:08:09.287904    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:08:14.952167 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:08:14.952133    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:08:15.057131 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:08:15.057088    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:08:23.986843 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:08:23.986807    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:08:40.781510 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:08:40.781417    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:08:45.203012 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:08:45.202979    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:08:46.024264 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:08:46.024230    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:08:58.293538 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:08:58.293506    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:09:07.035473 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:09:07.035432    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:09:10.594980 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:09:10.594947    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:09:32.882171 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:09:32.882141    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:09:38.087671 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:09:38.087633    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:09:57.093674 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:09:57.093638    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:10:13.314511 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:10:13.314466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:10:13.414490 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:10:13.414459    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:10:15.488089 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:10:15.488056    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:10:18.827000 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:10:18.826915    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:10:18.886945 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:10:18.886903    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:10:21.498242 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:10:21.498179    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:10:22.329587 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:10:22.329560    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:10:25.837255 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:10:25.837214    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:10:33.893199 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:10:33.893167    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:10:57.210567 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:10:57.210531    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:11:01.094944 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:01.094908    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:11:13.870368 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:13.870331    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:11:13.973462 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:13.973426    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:11:22.730867 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:22.730825    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:11:22.829305 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:22.829275    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:11:26.582623 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:26.582594    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:11:28.673320 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:28.673293    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 15:11:28.676193 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:28.676173    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 15:11:28.974470 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:28.974366    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:11:29.075722 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:29.075688    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:11:45.088825 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:45.088791    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:11:49.332808 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:49.332698    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:11:50.204914 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:50.204878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:11:51.276911 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:51.276873    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7255-139986671085616"]
Jul 10 15:11:51.280029 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:51.280007    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986671085616"
Jul 10 15:11:51.282799 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:51.282775    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-bjbcq\""
Jul 10 15:11:51.285920 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:51.285893    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986671085616"]
Jul 10 15:11:51.423803 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:51.423772    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr75c\" (UniqueName: \"kubernetes.io/projected/95c98a3f-7552-437d-9d61-6452b38f0820-kube-api-access-rr75c\") pod \"test-curl-7255-139986671085616\" (UID: \"95c98a3f-7552-437d-9d61-6452b38f0820\") " pod="openshift-ingress/test-curl-7255-139986671085616"
Jul 10 15:11:51.524578 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:51.524548    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr75c\" (UniqueName: \"kubernetes.io/projected/95c98a3f-7552-437d-9d61-6452b38f0820-kube-api-access-rr75c\") pod \"test-curl-7255-139986671085616\" (UID: \"95c98a3f-7552-437d-9d61-6452b38f0820\") " pod="openshift-ingress/test-curl-7255-139986671085616"
Jul 10 15:11:51.533482 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:51.533412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr75c\" (UniqueName: \"kubernetes.io/projected/95c98a3f-7552-437d-9d61-6452b38f0820-kube-api-access-rr75c\") pod \"test-curl-7255-139986671085616\" (UID: \"95c98a3f-7552-437d-9d61-6452b38f0820\") " pod="openshift-ingress/test-curl-7255-139986671085616"
Jul 10 15:11:51.589607 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:51.589581    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986671085616"
Jul 10 15:11:51.726127 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:51.726100    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986671085616"]
Jul 10 15:11:51.728956 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:11:51.728924    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95c98a3f_7552_437d_9d61_6452b38f0820.slice/crio-b94f2271ac31adfb88b3d635a5713c429c245716af3357edb35359011785447b WatchSource:0}: Error finding container b94f2271ac31adfb88b3d635a5713c429c245716af3357edb35359011785447b: Status 404 returned error can't find the container with id b94f2271ac31adfb88b3d635a5713c429c245716af3357edb35359011785447b
Jul 10 15:11:51.730161 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:51.730137    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 15:11:52.587958 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:52.587817    2564 generic.go:356] "Generic (PLEG): container finished" podID="95c98a3f-7552-437d-9d61-6452b38f0820" containerID="3decd20f4a227255c0f5fee0db96addf6e83887e9122186697ed8043960087c7" exitCode=0
Jul 10 15:11:52.587958 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:52.587856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986671085616" event={"ID":"95c98a3f-7552-437d-9d61-6452b38f0820","Type":"ContainerDied","Data":"3decd20f4a227255c0f5fee0db96addf6e83887e9122186697ed8043960087c7"}
Jul 10 15:11:52.587958 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:52.587898    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986671085616" event={"ID":"95c98a3f-7552-437d-9d61-6452b38f0820","Type":"ContainerStarted","Data":"b94f2271ac31adfb88b3d635a5713c429c245716af3357edb35359011785447b"}
Jul 10 15:11:53.744217 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.744190    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986671085616"
Jul 10 15:11:53.764199 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.764172    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7255-139986671085616_95c98a3f-7552-437d-9d61-6452b38f0820/test-curl-7255-139986671085616/0.log"
Jul 10 15:11:53.789948 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.789908    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7255-139986671085616"]
Jul 10 15:11:53.792459 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.792437    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7255-139986671085616"]
Jul 10 15:11:53.848174 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.848113    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rr75c\" (UniqueName: \"kubernetes.io/projected/95c98a3f-7552-437d-9d61-6452b38f0820-kube-api-access-rr75c\") pod \"95c98a3f-7552-437d-9d61-6452b38f0820\" (UID: \"95c98a3f-7552-437d-9d61-6452b38f0820\") "
Jul 10 15:11:53.850273 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.850243    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95c98a3f-7552-437d-9d61-6452b38f0820-kube-api-access-rr75c" (OuterVolumeSpecName: "kube-api-access-rr75c") pod "95c98a3f-7552-437d-9d61-6452b38f0820" (UID: "95c98a3f-7552-437d-9d61-6452b38f0820"). InnerVolumeSpecName "kube-api-access-rr75c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:11:53.928028 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.927983    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7255-139986671085872"]
Jul 10 15:11:53.928403 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.928390    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95c98a3f-7552-437d-9d61-6452b38f0820" containerName="test-curl-7255-139986671085616"
Jul 10 15:11:53.928446 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.928406    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="95c98a3f-7552-437d-9d61-6452b38f0820" containerName="test-curl-7255-139986671085616"
Jul 10 15:11:53.928485 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.928469    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="95c98a3f-7552-437d-9d61-6452b38f0820" containerName="test-curl-7255-139986671085616"
Jul 10 15:11:53.931485 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.931470    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986671085872"
Jul 10 15:11:53.937034 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.937007    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986671085872"]
Jul 10 15:11:53.949173 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:53.949148    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rr75c\" (UniqueName: \"kubernetes.io/projected/95c98a3f-7552-437d-9d61-6452b38f0820-kube-api-access-rr75c\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:11:54.050588 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:54.050547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdsc5\" (UniqueName: \"kubernetes.io/projected/de958547-e776-46fe-af62-d11c602e1133-kube-api-access-xdsc5\") pod \"test-curl-7255-139986671085872\" (UID: \"de958547-e776-46fe-af62-d11c602e1133\") " pod="openshift-ingress/test-curl-7255-139986671085872"
Jul 10 15:11:54.151226 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:54.151200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdsc5\" (UniqueName: \"kubernetes.io/projected/de958547-e776-46fe-af62-d11c602e1133-kube-api-access-xdsc5\") pod \"test-curl-7255-139986671085872\" (UID: \"de958547-e776-46fe-af62-d11c602e1133\") " pod="openshift-ingress/test-curl-7255-139986671085872"
Jul 10 15:11:54.164943 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:54.164916    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdsc5\" (UniqueName: \"kubernetes.io/projected/de958547-e776-46fe-af62-d11c602e1133-kube-api-access-xdsc5\") pod \"test-curl-7255-139986671085872\" (UID: \"de958547-e776-46fe-af62-d11c602e1133\") " pod="openshift-ingress/test-curl-7255-139986671085872"
Jul 10 15:11:54.243360 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:54.243337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986671085872"
Jul 10 15:11:54.385692 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:54.385669    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986671085872"]
Jul 10 15:11:54.387799 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:11:54.387744    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde958547_e776_46fe_af62_d11c602e1133.slice/crio-5778a51fb9d720b7ef5b8ba9abb582a47faceca8df8d5c50d2cbfc6faed53360 WatchSource:0}: Error finding container 5778a51fb9d720b7ef5b8ba9abb582a47faceca8df8d5c50d2cbfc6faed53360: Status 404 returned error can't find the container with id 5778a51fb9d720b7ef5b8ba9abb582a47faceca8df8d5c50d2cbfc6faed53360
Jul 10 15:11:54.564923 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:54.564898    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95c98a3f-7552-437d-9d61-6452b38f0820" path="/var/lib/kubelet/pods/95c98a3f-7552-437d-9d61-6452b38f0820/volumes"
Jul 10 15:11:54.600724 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:54.600691    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986671085872" event={"ID":"de958547-e776-46fe-af62-d11c602e1133","Type":"ContainerStarted","Data":"5778a51fb9d720b7ef5b8ba9abb582a47faceca8df8d5c50d2cbfc6faed53360"}
Jul 10 15:11:54.601924 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:54.601906    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986671085616"
Jul 10 15:11:54.602028 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:54.601908    2564 scope.go:117] "RemoveContainer" containerID="3decd20f4a227255c0f5fee0db96addf6e83887e9122186697ed8043960087c7"
Jul 10 15:11:55.608664 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:55.608618    2564 generic.go:356] "Generic (PLEG): container finished" podID="de958547-e776-46fe-af62-d11c602e1133" containerID="36b7be933f44a147b13de0750ba317f63df89376af9e7091f09bb0490b7449cd" exitCode=0
Jul 10 15:11:55.609112 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:55.608681    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986671085872" event={"ID":"de958547-e776-46fe-af62-d11c602e1133","Type":"ContainerDied","Data":"36b7be933f44a147b13de0750ba317f63df89376af9e7091f09bb0490b7449cd"}
Jul 10 15:11:56.754870 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.754845    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986671085872"
Jul 10 15:11:56.773708 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.773676    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7255-139986671085872_de958547-e776-46fe-af62-d11c602e1133/test-curl-7255-139986671085872/0.log"
Jul 10 15:11:56.796648 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.796619    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7255-139986671085872"]
Jul 10 15:11:56.801049 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.801027    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7255-139986671085872"]
Jul 10 15:11:56.875960 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.875884    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdsc5\" (UniqueName: \"kubernetes.io/projected/de958547-e776-46fe-af62-d11c602e1133-kube-api-access-xdsc5\") pod \"de958547-e776-46fe-af62-d11c602e1133\" (UID: \"de958547-e776-46fe-af62-d11c602e1133\") "
Jul 10 15:11:56.878222 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.878197    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de958547-e776-46fe-af62-d11c602e1133-kube-api-access-xdsc5" (OuterVolumeSpecName: "kube-api-access-xdsc5") pod "de958547-e776-46fe-af62-d11c602e1133" (UID: "de958547-e776-46fe-af62-d11c602e1133"). InnerVolumeSpecName "kube-api-access-xdsc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:11:56.976641 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.976606    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdsc5\" (UniqueName: \"kubernetes.io/projected/de958547-e776-46fe-af62-d11c602e1133-kube-api-access-xdsc5\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:11:56.980864 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.980835    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7255-139986670981312"]
Jul 10 15:11:56.981337 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.981320    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de958547-e776-46fe-af62-d11c602e1133" containerName="test-curl-7255-139986671085872"
Jul 10 15:11:56.981438 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.981341    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="de958547-e776-46fe-af62-d11c602e1133" containerName="test-curl-7255-139986671085872"
Jul 10 15:11:56.981490 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.981461    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="de958547-e776-46fe-af62-d11c602e1133" containerName="test-curl-7255-139986671085872"
Jul 10 15:11:56.984556 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.984538    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:11:56.991024 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:56.990995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986670981312"]
Jul 10 15:11:57.077864 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:57.077831    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mk8t\" (UniqueName: \"kubernetes.io/projected/5252eacd-7bc2-4137-bb15-85680976244d-kube-api-access-5mk8t\") pod \"test-curl-7255-139986670981312\" (UID: \"5252eacd-7bc2-4137-bb15-85680976244d\") " pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:11:57.179237 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:57.179153    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mk8t\" (UniqueName: \"kubernetes.io/projected/5252eacd-7bc2-4137-bb15-85680976244d-kube-api-access-5mk8t\") pod \"test-curl-7255-139986670981312\" (UID: \"5252eacd-7bc2-4137-bb15-85680976244d\") " pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:11:57.188972 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:57.188942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mk8t\" (UniqueName: \"kubernetes.io/projected/5252eacd-7bc2-4137-bb15-85680976244d-kube-api-access-5mk8t\") pod \"test-curl-7255-139986670981312\" (UID: \"5252eacd-7bc2-4137-bb15-85680976244d\") " pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:11:57.294814 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:57.294789    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:11:57.429574 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:57.429505    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986670981312"]
Jul 10 15:11:57.432058 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:11:57.432031    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5252eacd_7bc2_4137_bb15_85680976244d.slice/crio-fcbf9afbb153120ee0b520fc6f8423680e63064d7fe12721e5bc72a4dcda9f73 WatchSource:0}: Error finding container fcbf9afbb153120ee0b520fc6f8423680e63064d7fe12721e5bc72a4dcda9f73: Status 404 returned error can't find the container with id fcbf9afbb153120ee0b520fc6f8423680e63064d7fe12721e5bc72a4dcda9f73
Jul 10 15:11:57.621182 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:57.621155    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986671085872"
Jul 10 15:11:57.621182 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:57.621166    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5778a51fb9d720b7ef5b8ba9abb582a47faceca8df8d5c50d2cbfc6faed53360"
Jul 10 15:11:57.622471 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:57.622443    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986670981312" event={"ID":"5252eacd-7bc2-4137-bb15-85680976244d","Type":"ContainerStarted","Data":"fcbf9afbb153120ee0b520fc6f8423680e63064d7fe12721e5bc72a4dcda9f73"}
Jul 10 15:11:57.632033 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:11:57.632007    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7255-139986671085872\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="de958547-e776-46fe-af62-d11c602e1133" pod="openshift-ingress/test-curl-7255-139986671085872"
Jul 10 15:11:58.563461 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:11:58.563417    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7255-139986671085872\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="de958547-e776-46fe-af62-d11c602e1133" pod="openshift-ingress/test-curl-7255-139986671085872"
Jul 10 15:11:58.564875 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:58.564854    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de958547-e776-46fe-af62-d11c602e1133" path="/var/lib/kubelet/pods/de958547-e776-46fe-af62-d11c602e1133/volumes"
Jul 10 15:11:58.628567 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:58.628533    2564 generic.go:356] "Generic (PLEG): container finished" podID="5252eacd-7bc2-4137-bb15-85680976244d" containerID="00bed5b9e3babebb046b94e4d35517716147cf622716c1bad885aed39806caad" exitCode=0
Jul 10 15:11:58.628699 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:58.628624    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986670981312" event={"ID":"5252eacd-7bc2-4137-bb15-85680976244d","Type":"ContainerDied","Data":"00bed5b9e3babebb046b94e4d35517716147cf622716c1bad885aed39806caad"}
Jul 10 15:11:59.781086 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.781059    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:11:59.800885 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.800865    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7255-139986670981312_5252eacd-7bc2-4137-bb15-85680976244d/test-curl-7255-139986670981312/0.log"
Jul 10 15:11:59.826233 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.826194    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7255-139986670981312"]
Jul 10 15:11:59.828433 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.828415    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7255-139986670981312"]
Jul 10 15:11:59.901944 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.901857    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mk8t\" (UniqueName: \"kubernetes.io/projected/5252eacd-7bc2-4137-bb15-85680976244d-kube-api-access-5mk8t\") pod \"5252eacd-7bc2-4137-bb15-85680976244d\" (UID: \"5252eacd-7bc2-4137-bb15-85680976244d\") "
Jul 10 15:11:59.904101 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.904080    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5252eacd-7bc2-4137-bb15-85680976244d-kube-api-access-5mk8t" (OuterVolumeSpecName: "kube-api-access-5mk8t") pod "5252eacd-7bc2-4137-bb15-85680976244d" (UID: "5252eacd-7bc2-4137-bb15-85680976244d"). InnerVolumeSpecName "kube-api-access-5mk8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:11:59.951332 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.951305    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7255-139986670981312"]
Jul 10 15:11:59.951763 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.951732    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5252eacd-7bc2-4137-bb15-85680976244d" containerName="test-curl-7255-139986670981312"
Jul 10 15:11:59.951819 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.951772    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5252eacd-7bc2-4137-bb15-85680976244d" containerName="test-curl-7255-139986670981312"
Jul 10 15:11:59.951874 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.951864    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5252eacd-7bc2-4137-bb15-85680976244d" containerName="test-curl-7255-139986670981312"
Jul 10 15:11:59.954686 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.954673    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:11:59.961438 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:11:59.961412    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986670981312"]
Jul 10 15:12:00.002817 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:00.002792    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mk8t\" (UniqueName: \"kubernetes.io/projected/5252eacd-7bc2-4137-bb15-85680976244d-kube-api-access-5mk8t\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:00.103837 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:00.103803    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88bn9\" (UniqueName: \"kubernetes.io/projected/494d16cd-6d62-4441-8717-0dab652b48ce-kube-api-access-88bn9\") pod \"test-curl-7255-139986670981312\" (UID: \"494d16cd-6d62-4441-8717-0dab652b48ce\") " pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:12:00.204795 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:00.204675    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88bn9\" (UniqueName: \"kubernetes.io/projected/494d16cd-6d62-4441-8717-0dab652b48ce-kube-api-access-88bn9\") pod \"test-curl-7255-139986670981312\" (UID: \"494d16cd-6d62-4441-8717-0dab652b48ce\") " pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:12:00.213473 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:00.213443    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88bn9\" (UniqueName: \"kubernetes.io/projected/494d16cd-6d62-4441-8717-0dab652b48ce-kube-api-access-88bn9\") pod \"test-curl-7255-139986670981312\" (UID: \"494d16cd-6d62-4441-8717-0dab652b48ce\") " pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:12:00.265169 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:00.265145    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:12:00.396982 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:00.396958    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986670981312"]
Jul 10 15:12:00.398401 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:12:00.398372    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod494d16cd_6d62_4441_8717_0dab652b48ce.slice/crio-40e455200e88298f08a3e19fa06f620f3571e4329a9fff4e418317017d0b3f13 WatchSource:0}: Error finding container 40e455200e88298f08a3e19fa06f620f3571e4329a9fff4e418317017d0b3f13: Status 404 returned error can't find the container with id 40e455200e88298f08a3e19fa06f620f3571e4329a9fff4e418317017d0b3f13
Jul 10 15:12:00.565017 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:00.564953    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5252eacd-7bc2-4137-bb15-85680976244d" path="/var/lib/kubelet/pods/5252eacd-7bc2-4137-bb15-85680976244d/volumes"
Jul 10 15:12:00.642107 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:00.642078    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:12:00.642265 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:00.642110    2564 scope.go:117] "RemoveContainer" containerID="00bed5b9e3babebb046b94e4d35517716147cf622716c1bad885aed39806caad"
Jul 10 15:12:00.643546 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:00.643512    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986670981312" event={"ID":"494d16cd-6d62-4441-8717-0dab652b48ce","Type":"ContainerStarted","Data":"40e455200e88298f08a3e19fa06f620f3571e4329a9fff4e418317017d0b3f13"}
Jul 10 15:12:01.650359 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:01.650321    2564 generic.go:356] "Generic (PLEG): container finished" podID="494d16cd-6d62-4441-8717-0dab652b48ce" containerID="1d42daef687eb74b7191cd56f2077e63a9e78ae2a674149c81a88ca5fde2fd5c" exitCode=0
Jul 10 15:12:01.650735 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:01.650401    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986670981312" event={"ID":"494d16cd-6d62-4441-8717-0dab652b48ce","Type":"ContainerDied","Data":"1d42daef687eb74b7191cd56f2077e63a9e78ae2a674149c81a88ca5fde2fd5c"}
Jul 10 15:12:02.383505 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.383472    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:12:02.801399 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.801374    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:12:02.821004 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.820972    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7255-139986670981312_494d16cd-6d62-4441-8717-0dab652b48ce/test-curl-7255-139986670981312/0.log"
Jul 10 15:12:02.843652 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.843622    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7255-139986670981312"]
Jul 10 15:12:02.846178 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.846153    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7255-139986670981312"]
Jul 10 15:12:02.928133 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.928057    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88bn9\" (UniqueName: \"kubernetes.io/projected/494d16cd-6d62-4441-8717-0dab652b48ce-kube-api-access-88bn9\") pod \"494d16cd-6d62-4441-8717-0dab652b48ce\" (UID: \"494d16cd-6d62-4441-8717-0dab652b48ce\") "
Jul 10 15:12:02.930235 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.930212    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/494d16cd-6d62-4441-8717-0dab652b48ce-kube-api-access-88bn9" (OuterVolumeSpecName: "kube-api-access-88bn9") pod "494d16cd-6d62-4441-8717-0dab652b48ce" (UID: "494d16cd-6d62-4441-8717-0dab652b48ce"). InnerVolumeSpecName "kube-api-access-88bn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:12:02.984229 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.984201    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7255-139986670982320"]
Jul 10 15:12:02.984586 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.984575    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="494d16cd-6d62-4441-8717-0dab652b48ce" containerName="test-curl-7255-139986670981312"
Jul 10 15:12:02.984630 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.984588    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="494d16cd-6d62-4441-8717-0dab652b48ce" containerName="test-curl-7255-139986670981312"
Jul 10 15:12:02.984664 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.984659    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="494d16cd-6d62-4441-8717-0dab652b48ce" containerName="test-curl-7255-139986670981312"
Jul 10 15:12:02.987641 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.987627    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:02.994859 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:02.994838    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986670982320"]
Jul 10 15:12:03.029362 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:03.029300    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88bn9\" (UniqueName: \"kubernetes.io/projected/494d16cd-6d62-4441-8717-0dab652b48ce-kube-api-access-88bn9\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:03.130626 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:03.130594    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pr8g\" (UniqueName: \"kubernetes.io/projected/b4ce9e84-430e-4a81-ba0d-cfe156556f6d-kube-api-access-8pr8g\") pod \"test-curl-7255-139986670982320\" (UID: \"b4ce9e84-430e-4a81-ba0d-cfe156556f6d\") " pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:03.231197 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:03.231123    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pr8g\" (UniqueName: \"kubernetes.io/projected/b4ce9e84-430e-4a81-ba0d-cfe156556f6d-kube-api-access-8pr8g\") pod \"test-curl-7255-139986670982320\" (UID: \"b4ce9e84-430e-4a81-ba0d-cfe156556f6d\") " pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:03.240465 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:03.240438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pr8g\" (UniqueName: \"kubernetes.io/projected/b4ce9e84-430e-4a81-ba0d-cfe156556f6d-kube-api-access-8pr8g\") pod \"test-curl-7255-139986670982320\" (UID: \"b4ce9e84-430e-4a81-ba0d-cfe156556f6d\") " pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:03.297852 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:03.297827    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:03.444168 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:03.444125    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986670982320"]
Jul 10 15:12:03.446492 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:12:03.446464    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4ce9e84_430e_4a81_ba0d_cfe156556f6d.slice/crio-5e0d5108a8dda483fdcfc0019bbeb5bc342bf26143f7d1366f6c13cd290ecd8d WatchSource:0}: Error finding container 5e0d5108a8dda483fdcfc0019bbeb5bc342bf26143f7d1366f6c13cd290ecd8d: Status 404 returned error can't find the container with id 5e0d5108a8dda483fdcfc0019bbeb5bc342bf26143f7d1366f6c13cd290ecd8d
Jul 10 15:12:03.663495 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:03.663458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986670982320" event={"ID":"b4ce9e84-430e-4a81-ba0d-cfe156556f6d","Type":"ContainerStarted","Data":"5e0d5108a8dda483fdcfc0019bbeb5bc342bf26143f7d1366f6c13cd290ecd8d"}
Jul 10 15:12:03.664792 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:03.664775    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40e455200e88298f08a3e19fa06f620f3571e4329a9fff4e418317017d0b3f13"
Jul 10 15:12:03.664906 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:03.664799    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:12:03.674839 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:12:03.674813    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7255-139986670981312\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="494d16cd-6d62-4441-8717-0dab652b48ce" pod="openshift-ingress/test-curl-7255-139986670981312"
Jul 10 15:12:04.564286 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:04.564253    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="494d16cd-6d62-4441-8717-0dab652b48ce" path="/var/lib/kubelet/pods/494d16cd-6d62-4441-8717-0dab652b48ce/volumes"
Jul 10 15:12:04.671813 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:04.671774    2564 generic.go:356] "Generic (PLEG): container finished" podID="b4ce9e84-430e-4a81-ba0d-cfe156556f6d" containerID="45dd632618a9a623be345fe6ffcf429f80363b67737ca6687fd6ef8ca7be4db6" exitCode=0
Jul 10 15:12:04.671972 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:04.671855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986670982320" event={"ID":"b4ce9e84-430e-4a81-ba0d-cfe156556f6d","Type":"ContainerDied","Data":"45dd632618a9a623be345fe6ffcf429f80363b67737ca6687fd6ef8ca7be4db6"}
Jul 10 15:12:05.824544 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:05.824518    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:05.844253 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:05.844219    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7255-139986670982320_b4ce9e84-430e-4a81-ba0d-cfe156556f6d/test-curl-7255-139986670982320/0.log"
Jul 10 15:12:05.873377 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:05.873347    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7255-139986670982320"]
Jul 10 15:12:05.876271 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:05.876247    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7255-139986670982320"]
Jul 10 15:12:05.956549 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:05.956461    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pr8g\" (UniqueName: \"kubernetes.io/projected/b4ce9e84-430e-4a81-ba0d-cfe156556f6d-kube-api-access-8pr8g\") pod \"b4ce9e84-430e-4a81-ba0d-cfe156556f6d\" (UID: \"b4ce9e84-430e-4a81-ba0d-cfe156556f6d\") "
Jul 10 15:12:05.958711 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:05.958685    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4ce9e84-430e-4a81-ba0d-cfe156556f6d-kube-api-access-8pr8g" (OuterVolumeSpecName: "kube-api-access-8pr8g") pod "b4ce9e84-430e-4a81-ba0d-cfe156556f6d" (UID: "b4ce9e84-430e-4a81-ba0d-cfe156556f6d"). InnerVolumeSpecName "kube-api-access-8pr8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:12:06.004545 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.004521    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7255-139986670982320"]
Jul 10 15:12:06.004900 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.004887    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ce9e84-430e-4a81-ba0d-cfe156556f6d" containerName="test-curl-7255-139986670982320"
Jul 10 15:12:06.004941 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.004901    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ce9e84-430e-4a81-ba0d-cfe156556f6d" containerName="test-curl-7255-139986670982320"
Jul 10 15:12:06.004985 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.004977    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ce9e84-430e-4a81-ba0d-cfe156556f6d" containerName="test-curl-7255-139986670982320"
Jul 10 15:12:06.007991 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.007977    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:06.014202 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.014179    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986670982320"]
Jul 10 15:12:06.057588 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.057557    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pr8g\" (UniqueName: \"kubernetes.io/projected/b4ce9e84-430e-4a81-ba0d-cfe156556f6d-kube-api-access-8pr8g\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:06.158656 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.158618    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4k2n\" (UniqueName: \"kubernetes.io/projected/7531b77c-31d2-4867-9dff-8a5d5d53b4e4-kube-api-access-s4k2n\") pod \"test-curl-7255-139986670982320\" (UID: \"7531b77c-31d2-4867-9dff-8a5d5d53b4e4\") " pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:06.259798 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.259709    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4k2n\" (UniqueName: \"kubernetes.io/projected/7531b77c-31d2-4867-9dff-8a5d5d53b4e4-kube-api-access-s4k2n\") pod \"test-curl-7255-139986670982320\" (UID: \"7531b77c-31d2-4867-9dff-8a5d5d53b4e4\") " pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:06.270131 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.270102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4k2n\" (UniqueName: \"kubernetes.io/projected/7531b77c-31d2-4867-9dff-8a5d5d53b4e4-kube-api-access-s4k2n\") pod \"test-curl-7255-139986670982320\" (UID: \"7531b77c-31d2-4867-9dff-8a5d5d53b4e4\") " pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:06.318017 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.317992    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:06.449719 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.449692    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7255-139986670982320"]
Jul 10 15:12:06.450885 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:12:06.450862    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7531b77c_31d2_4867_9dff_8a5d5d53b4e4.slice/crio-9ef88e9812f875dc2230737c67ba4e7f18fab1463b51e0f4d1af0cd3fd76f6be WatchSource:0}: Error finding container 9ef88e9812f875dc2230737c67ba4e7f18fab1463b51e0f4d1af0cd3fd76f6be: Status 404 returned error can't find the container with id 9ef88e9812f875dc2230737c67ba4e7f18fab1463b51e0f4d1af0cd3fd76f6be
Jul 10 15:12:06.565941 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.565877    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ce9e84-430e-4a81-ba0d-cfe156556f6d" path="/var/lib/kubelet/pods/b4ce9e84-430e-4a81-ba0d-cfe156556f6d/volumes"
Jul 10 15:12:06.684682 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.684655    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986670982320" event={"ID":"7531b77c-31d2-4867-9dff-8a5d5d53b4e4","Type":"ContainerStarted","Data":"9ef88e9812f875dc2230737c67ba4e7f18fab1463b51e0f4d1af0cd3fd76f6be"}
Jul 10 15:12:06.686061 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.686044    2564 scope.go:117] "RemoveContainer" containerID="45dd632618a9a623be345fe6ffcf429f80363b67737ca6687fd6ef8ca7be4db6"
Jul 10 15:12:06.686199 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:06.686045    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:07.693361 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:07.693322    2564 generic.go:356] "Generic (PLEG): container finished" podID="7531b77c-31d2-4867-9dff-8a5d5d53b4e4" containerID="7350fd80c82e968bc913945e8c94be86e3c3bda765fa0211ad881386f3d32601" exitCode=0
Jul 10 15:12:07.693818 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:07.693409    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7255-139986670982320" event={"ID":"7531b77c-31d2-4867-9dff-8a5d5d53b4e4","Type":"ContainerDied","Data":"7350fd80c82e968bc913945e8c94be86e3c3bda765fa0211ad881386f3d32601"}
Jul 10 15:12:08.857223 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:08.857196    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:08.884529 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:08.884499    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7255-139986670982320_7531b77c-31d2-4867-9dff-8a5d5d53b4e4/test-curl-7255-139986670982320/0.log"
Jul 10 15:12:08.891280 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:08.891258    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4k2n\" (UniqueName: \"kubernetes.io/projected/7531b77c-31d2-4867-9dff-8a5d5d53b4e4-kube-api-access-s4k2n\") pod \"7531b77c-31d2-4867-9dff-8a5d5d53b4e4\" (UID: \"7531b77c-31d2-4867-9dff-8a5d5d53b4e4\") "
Jul 10 15:12:08.893266 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:08.893243    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7531b77c-31d2-4867-9dff-8a5d5d53b4e4-kube-api-access-s4k2n" (OuterVolumeSpecName: "kube-api-access-s4k2n") pod "7531b77c-31d2-4867-9dff-8a5d5d53b4e4" (UID: "7531b77c-31d2-4867-9dff-8a5d5d53b4e4"). InnerVolumeSpecName "kube-api-access-s4k2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:12:08.912398 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:08.912373    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7255-139986670982320"]
Jul 10 15:12:08.916125 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:08.916106    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7255-139986670982320"]
Jul 10 15:12:08.991980 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:08.991914    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4k2n\" (UniqueName: \"kubernetes.io/projected/7531b77c-31d2-4867-9dff-8a5d5d53b4e4-kube-api-access-s4k2n\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:09.154916 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:09.154878    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:09.559571 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:09.559534    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:09.664863 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:09.664826    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:09.708185 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:09.708159    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9ef88e9812f875dc2230737c67ba4e7f18fab1463b51e0f4d1af0cd3fd76f6be"
Jul 10 15:12:09.708185 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:09.708161    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:09.722056 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:12:09.722021    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7255-139986670982320\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="7531b77c-31d2-4867-9dff-8a5d5d53b4e4" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:09.788798 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:09.788738    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"]
Jul 10 15:12:09.789055 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:09.789027    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64" podUID="54c95661-3316-4d06-bbbe-19859cfe30b8" containerName="maas-api" containerID="cri-o://efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470" gracePeriod=30
Jul 10 15:12:09.808731 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:12:09.808697    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7255-139986670982320\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="7531b77c-31d2-4867-9dff-8a5d5d53b4e4" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:09.810897 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:09.810830    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:10.043135 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.043111    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:12:10.088274 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:12:10.088191    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7255-139986670982320\" is forbidden: User \"system:node:ip-10-0-141-223.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-141-223.ec2.internal' and this object" podUID="7531b77c-31d2-4867-9dff-8a5d5d53b4e4" pod="openshift-ingress/test-curl-7255-139986670982320"
Jul 10 15:12:10.100297 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.100271    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77p7m\" (UniqueName: \"kubernetes.io/projected/54c95661-3316-4d06-bbbe-19859cfe30b8-kube-api-access-77p7m\") pod \"54c95661-3316-4d06-bbbe-19859cfe30b8\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") "
Jul 10 15:12:10.100425 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.100323    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c95661-3316-4d06-bbbe-19859cfe30b8-maas-api-tls\") pod \"54c95661-3316-4d06-bbbe-19859cfe30b8\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") "
Jul 10 15:12:10.100425 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.100406    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c95661-3316-4d06-bbbe-19859cfe30b8-openshift-service-ca\") pod \"54c95661-3316-4d06-bbbe-19859cfe30b8\" (UID: \"54c95661-3316-4d06-bbbe-19859cfe30b8\") "
Jul 10 15:12:10.100811 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.100783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54c95661-3316-4d06-bbbe-19859cfe30b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "54c95661-3316-4d06-bbbe-19859cfe30b8" (UID: "54c95661-3316-4d06-bbbe-19859cfe30b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:12:10.102590 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.102565    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54c95661-3316-4d06-bbbe-19859cfe30b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "54c95661-3316-4d06-bbbe-19859cfe30b8" (UID: "54c95661-3316-4d06-bbbe-19859cfe30b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 15:12:10.102685 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.102629    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54c95661-3316-4d06-bbbe-19859cfe30b8-kube-api-access-77p7m" (OuterVolumeSpecName: "kube-api-access-77p7m") pod "54c95661-3316-4d06-bbbe-19859cfe30b8" (UID: "54c95661-3316-4d06-bbbe-19859cfe30b8"). InnerVolumeSpecName "kube-api-access-77p7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:12:10.201465 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.201424    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77p7m\" (UniqueName: \"kubernetes.io/projected/54c95661-3316-4d06-bbbe-19859cfe30b8-kube-api-access-77p7m\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:10.201465 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.201462    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c95661-3316-4d06-bbbe-19859cfe30b8-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:10.201465 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.201472    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c95661-3316-4d06-bbbe-19859cfe30b8-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:10.564956 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.564922    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7531b77c-31d2-4867-9dff-8a5d5d53b4e4" path="/var/lib/kubelet/pods/7531b77c-31d2-4867-9dff-8a5d5d53b4e4/volumes"
Jul 10 15:12:10.715375 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.715344    2564 generic.go:356] "Generic (PLEG): container finished" podID="54c95661-3316-4d06-bbbe-19859cfe30b8" containerID="efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470" exitCode=0
Jul 10 15:12:10.715524 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.715392    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"
Jul 10 15:12:10.715524 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.715430    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64" event={"ID":"54c95661-3316-4d06-bbbe-19859cfe30b8","Type":"ContainerDied","Data":"efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470"}
Jul 10 15:12:10.715524 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.715487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64" event={"ID":"54c95661-3316-4d06-bbbe-19859cfe30b8","Type":"ContainerDied","Data":"740c3c2cd59578222aa79adf25d311c0cca3d705cb0e74223ae236c4fb19217c"}
Jul 10 15:12:10.715524 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.715511    2564 scope.go:117] "RemoveContainer" containerID="efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470"
Jul 10 15:12:10.725330 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.725307    2564 scope.go:117] "RemoveContainer" containerID="efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470"
Jul 10 15:12:10.725600 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:12:10.725580    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470\": container with ID starting with efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470 not found: ID does not exist" containerID="efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470"
Jul 10 15:12:10.725673 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.725612    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470"} err="failed to get container status \"efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470\": rpc error: code = NotFound desc = could not find container \"efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470\": container with ID starting with efb649d8c991cd90013e60a0b3edd00584488edeb35809bc38aaea315d733470 not found: ID does not exist"
Jul 10 15:12:10.733723 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.733703    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"]
Jul 10 15:12:10.742228 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:10.742207    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1f1c9a-6964b6f444-tmp64"]
Jul 10 15:12:12.565674 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:12.565642    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54c95661-3316-4d06-bbbe-19859cfe30b8" path="/var/lib/kubelet/pods/54c95661-3316-4d06-bbbe-19859cfe30b8/volumes"
Jul 10 15:12:14.793504 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:14.793470    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:12:15.496559 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:15.496524    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:15.599188 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:15.599146    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:15.796860 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:15.796734    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:16.035514 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:16.035476    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:16.204374 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:16.204333    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:16.678312 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:16.678277    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:16.793448 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:16.793417    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:16.894881 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:16.894850    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:16.997990 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:16.997892    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"]
Jul 10 15:12:16.998262 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:16.998232    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5" podUID="1e2df23f-dd5a-4a74-9ffa-adf4488028db" containerName="maas-api" containerID="cri-o://121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f" gracePeriod=30
Jul 10 15:12:17.023333 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.023309    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:17.263635 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.263575    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:12:17.366831 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.366785    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbmb4\" (UniqueName: \"kubernetes.io/projected/1e2df23f-dd5a-4a74-9ffa-adf4488028db-kube-api-access-lbmb4\") pod \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") "
Jul 10 15:12:17.367025 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.366891    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2df23f-dd5a-4a74-9ffa-adf4488028db-openshift-service-ca\") pod \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") "
Jul 10 15:12:17.367025 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.366959    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2df23f-dd5a-4a74-9ffa-adf4488028db-maas-api-tls\") pod \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\" (UID: \"1e2df23f-dd5a-4a74-9ffa-adf4488028db\") "
Jul 10 15:12:17.367330 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.367294    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2df23f-dd5a-4a74-9ffa-adf4488028db-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1e2df23f-dd5a-4a74-9ffa-adf4488028db" (UID: "1e2df23f-dd5a-4a74-9ffa-adf4488028db"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:12:17.369038 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.369015    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2df23f-dd5a-4a74-9ffa-adf4488028db-kube-api-access-lbmb4" (OuterVolumeSpecName: "kube-api-access-lbmb4") pod "1e2df23f-dd5a-4a74-9ffa-adf4488028db" (UID: "1e2df23f-dd5a-4a74-9ffa-adf4488028db"). InnerVolumeSpecName "kube-api-access-lbmb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:12:17.369524 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.369490    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e2df23f-dd5a-4a74-9ffa-adf4488028db-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1e2df23f-dd5a-4a74-9ffa-adf4488028db" (UID: "1e2df23f-dd5a-4a74-9ffa-adf4488028db"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 15:12:17.468548 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.468516    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2df23f-dd5a-4a74-9ffa-adf4488028db-openshift-service-ca\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:17.468548 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.468543    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1e2df23f-dd5a-4a74-9ffa-adf4488028db-maas-api-tls\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:17.468548 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.468552    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbmb4\" (UniqueName: \"kubernetes.io/projected/1e2df23f-dd5a-4a74-9ffa-adf4488028db-kube-api-access-lbmb4\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:17.757707 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.757674    2564 generic.go:356] "Generic (PLEG): container finished" podID="1e2df23f-dd5a-4a74-9ffa-adf4488028db" containerID="121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f" exitCode=0
Jul 10 15:12:17.757895 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.757732    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"
Jul 10 15:12:17.757895 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.757772    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5" event={"ID":"1e2df23f-dd5a-4a74-9ffa-adf4488028db","Type":"ContainerDied","Data":"121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f"}
Jul 10 15:12:17.757895 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.757829    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5" event={"ID":"1e2df23f-dd5a-4a74-9ffa-adf4488028db","Type":"ContainerDied","Data":"93fffed597f2a33a1d53945eed7fc149439e9a86c76721317519e736c04ae0c1"}
Jul 10 15:12:17.757895 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.757853    2564 scope.go:117] "RemoveContainer" containerID="121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f"
Jul 10 15:12:17.770143 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.770126    2564 scope.go:117] "RemoveContainer" containerID="121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f"
Jul 10 15:12:17.770408 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:12:17.770389    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f\": container with ID starting with 121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f not found: ID does not exist" containerID="121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f"
Jul 10 15:12:17.770470 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.770416    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f"} err="failed to get container status \"121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f\": rpc error: code = NotFound desc = could not find container \"121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f\": container with ID starting with 121d043f9803b4db8982326d85a3928dc8a88223f6be6c7fa0f8d54c62b3893f not found: ID does not exist"
Jul 10 15:12:17.779591 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.779568    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"]
Jul 10 15:12:17.783439 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:17.783417    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f923ab-7b45649f7c-s29q5"]
Jul 10 15:12:18.564182 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:18.564148    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e2df23f-dd5a-4a74-9ffa-adf4488028db" path="/var/lib/kubelet/pods/1e2df23f-dd5a-4a74-9ffa-adf4488028db/volumes"
Jul 10 15:12:22.564584 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:22.564535    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:22.634122 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:22.634099    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:22.866609 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:22.866582    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"]
Jul 10 15:12:22.866827 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:22.866805    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy" containerID="cri-o://85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901" gracePeriod=30
Jul 10 15:12:22.878842 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:22.878814    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:23.146383 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:23.146293    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:23.645363 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:23.645329    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86cc75879-4rfjk_76c7b395-1671-42ae-823f-d986a8c1406e/authorino/0.log"
Jul 10 15:12:25.782177 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:25.782139    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nb8kq"]
Jul 10 15:12:28.122605 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.122585    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:12:28.261662 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.261578    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q6hc\" (UniqueName: \"kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-kube-api-access-2q6hc\") pod \"80365911-f635-42bb-90a4-d01fe0e4caf5\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") "
Jul 10 15:12:28.261662 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.261631    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-podinfo\") pod \"80365911-f635-42bb-90a4-d01fe0e4caf5\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") "
Jul 10 15:12:28.261662 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.261655    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-token\") pod \"80365911-f635-42bb-90a4-d01fe0e4caf5\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") "
Jul 10 15:12:28.261991 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.261686    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-envoy\") pod \"80365911-f635-42bb-90a4-d01fe0e4caf5\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") "
Jul 10 15:12:28.261991 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.261710    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-certs\") pod \"80365911-f635-42bb-90a4-d01fe0e4caf5\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") "
Jul 10 15:12:28.261991 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.261776    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-socket\") pod \"80365911-f635-42bb-90a4-d01fe0e4caf5\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") "
Jul 10 15:12:28.261991 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.261819    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-data\") pod \"80365911-f635-42bb-90a4-d01fe0e4caf5\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") "
Jul 10 15:12:28.261991 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.261871    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-credential-socket\") pod \"80365911-f635-42bb-90a4-d01fe0e4caf5\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") "
Jul 10 15:12:28.261991 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.261928    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80365911-f635-42bb-90a4-d01fe0e4caf5-istiod-ca-cert\") pod \"80365911-f635-42bb-90a4-d01fe0e4caf5\" (UID: \"80365911-f635-42bb-90a4-d01fe0e4caf5\") "
Jul 10 15:12:28.262290 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.262094    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "80365911-f635-42bb-90a4-d01fe0e4caf5" (UID: "80365911-f635-42bb-90a4-d01fe0e4caf5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:12:28.262290 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.262253    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-certs\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:28.262568 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.262310    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "80365911-f635-42bb-90a4-d01fe0e4caf5" (UID: "80365911-f635-42bb-90a4-d01fe0e4caf5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:12:28.262776 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.262726    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80365911-f635-42bb-90a4-d01fe0e4caf5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "80365911-f635-42bb-90a4-d01fe0e4caf5" (UID: "80365911-f635-42bb-90a4-d01fe0e4caf5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 15:12:28.262924 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.262710    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "80365911-f635-42bb-90a4-d01fe0e4caf5" (UID: "80365911-f635-42bb-90a4-d01fe0e4caf5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:12:28.263164 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.263133    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-data" (OuterVolumeSpecName: "istio-data") pod "80365911-f635-42bb-90a4-d01fe0e4caf5" (UID: "80365911-f635-42bb-90a4-d01fe0e4caf5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:12:28.264168 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.264135    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "80365911-f635-42bb-90a4-d01fe0e4caf5" (UID: "80365911-f635-42bb-90a4-d01fe0e4caf5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 15:12:28.264268 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.264238    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-token" (OuterVolumeSpecName: "istio-token") pod "80365911-f635-42bb-90a4-d01fe0e4caf5" (UID: "80365911-f635-42bb-90a4-d01fe0e4caf5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:12:28.264268 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.264247    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-kube-api-access-2q6hc" (OuterVolumeSpecName: "kube-api-access-2q6hc") pod "80365911-f635-42bb-90a4-d01fe0e4caf5" (UID: "80365911-f635-42bb-90a4-d01fe0e4caf5"). InnerVolumeSpecName "kube-api-access-2q6hc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 15:12:28.264268 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.264249    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "80365911-f635-42bb-90a4-d01fe0e4caf5" (UID: "80365911-f635-42bb-90a4-d01fe0e4caf5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 15:12:28.363508 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.363482    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/80365911-f635-42bb-90a4-d01fe0e4caf5-istiod-ca-cert\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:28.363508 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.363504    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q6hc\" (UniqueName: \"kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-kube-api-access-2q6hc\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:28.363508 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.363514    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-podinfo\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:28.363734 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.363522    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-token\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:28.363734 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.363531    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-envoy\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:28.363734 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.363541    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-workload-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:28.363734 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.363548    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-istio-data\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:28.363734 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.363558    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/80365911-f635-42bb-90a4-d01fe0e4caf5-credential-socket\") on node \"ip-10-0-141-223.ec2.internal\" DevicePath \"\""
Jul 10 15:12:28.821177 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.821147    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8jjbr_90712a9e-d8f7-4672-9f0c-cf135c490015/manager/0.log"
Jul 10 15:12:28.823253 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.823190    2564 generic.go:356] "Generic (PLEG): container finished" podID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerID="85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901" exitCode=0
Jul 10 15:12:28.823253 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.823231    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"
Jul 10 15:12:28.823418 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.823279    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" event={"ID":"80365911-f635-42bb-90a4-d01fe0e4caf5","Type":"ContainerDied","Data":"85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901"}
Jul 10 15:12:28.823418 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.823339    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv" event={"ID":"80365911-f635-42bb-90a4-d01fe0e4caf5","Type":"ContainerDied","Data":"118f3508129e0b44bbb07d7c1d93c0363210a514aa93b020c035c8932fbcd4a5"}
Jul 10 15:12:28.823418 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.823363    2564 scope.go:117] "RemoveContainer" containerID="85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901"
Jul 10 15:12:28.832819 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.832801    2564 scope.go:117] "RemoveContainer" containerID="e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9"
Jul 10 15:12:28.841559 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.841542    2564 scope.go:117] "RemoveContainer" containerID="85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901"
Jul 10 15:12:28.841803 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.841783    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"]
Jul 10 15:12:28.841989 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:12:28.841957    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901\": container with ID starting with 85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901 not found: ID does not exist" containerID="85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901"
Jul 10 15:12:28.842070 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.841987    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901"} err="failed to get container status \"85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901\": rpc error: code = NotFound desc = could not find container \"85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901\": container with ID starting with 85f919bf0770a40d157d5fa026cf02ae84924523e0600e479048a9f0a14e3901 not found: ID does not exist"
Jul 10 15:12:28.842070 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.842012    2564 scope.go:117] "RemoveContainer" containerID="e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9"
Jul 10 15:12:28.842674 ip-10-0-141-223 kubenswrapper[2564]: E0710 15:12:28.842652    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9\": container with ID starting with e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9 not found: ID does not exist" containerID="e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9"
Jul 10 15:12:28.842794 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.842682    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9"} err="failed to get container status \"e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9\": rpc error: code = NotFound desc = could not find container \"e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9\": container with ID starting with e292d28a29418100d12f0d36d1726feb4e372433a9a938edce38b3895b7772a9 not found: ID does not exist"
Jul 10 15:12:28.845293 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.845268    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-f923ab-openshift-default-79d866b8b7-5g4jv"]
Jul 10 15:12:28.953058 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:28.953035    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-t9xg8_3c030ca8-d04a-4e18-91fc-70bd31711bfe/manager/0.log"
Jul 10 15:12:29.084763 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:29.084676    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7cdcdc785b-x546f_bf4f7402-132b-40ea-b5e4-2aab58b4394f/manager/0.log"
Jul 10 15:12:29.197240 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:29.197217    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6dqdp_21b5624d-af8e-43a1-9c08-bff53f83a926/server/0.log"
Jul 10 15:12:29.333880 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:29.333848    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lzj5g_fdc79147-acf9-4840-a97e-59cd7c790ce7/manager/0.log"
Jul 10 15:12:29.464905 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:29.464875    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547957cd78-6ncbf_57cfab74-0237-4755-911e-f81e5c7d56a1/copy-manifests/0.log"
Jul 10 15:12:29.472335 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:29.472308    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547957cd78-6ncbf_57cfab74-0237-4755-911e-f81e5c7d56a1/manager/0.log"
Jul 10 15:12:30.137184 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:30.137146    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6c4df6cbf-fzkts_f06c9d41-e061-42e2-8f06-9a3d749f4176/maas-api/0.log"
Jul 10 15:12:30.564525 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:30.564443    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" path="/var/lib/kubelet/pods/80365911-f635-42bb-90a4-d01fe0e4caf5/volumes"
Jul 10 15:12:31.099012 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.098978    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c_6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61/util/0.log"
Jul 10 15:12:31.111709 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.111679    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c_6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61/pull/0.log"
Jul 10 15:12:31.118250 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.118225    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c_6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61/extract/0.log"
Jul 10 15:12:31.237403 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.237372    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq_e36da4f3-9ae5-45b3-9273-6e87ecd9d908/util/0.log"
Jul 10 15:12:31.247122 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.247092    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq_e36da4f3-9ae5-45b3-9273-6e87ecd9d908/pull/0.log"
Jul 10 15:12:31.256765 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.256729    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq_e36da4f3-9ae5-45b3-9273-6e87ecd9d908/extract/0.log"
Jul 10 15:12:31.378698 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.378668    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8_8521f8c6-ed6b-400d-8673-244061bbd0e1/util/0.log"
Jul 10 15:12:31.387984 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.387965    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8_8521f8c6-ed6b-400d-8673-244061bbd0e1/pull/0.log"
Jul 10 15:12:31.396659 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.396636    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8_8521f8c6-ed6b-400d-8673-244061bbd0e1/extract/0.log"
Jul 10 15:12:31.517596 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.517574    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4_0d895ceb-92c8-48b4-8a19-cd410a882a97/util/0.log"
Jul 10 15:12:31.529839 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.529818    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4_0d895ceb-92c8-48b4-8a19-cd410a882a97/pull/0.log"
Jul 10 15:12:31.541733 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.541700    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4_0d895ceb-92c8-48b4-8a19-cd410a882a97/extract/0.log"
Jul 10 15:12:31.675926 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.675846    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86cc75879-4rfjk_76c7b395-1671-42ae-823f-d986a8c1406e/authorino/0.log"
Jul 10 15:12:31.814439 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:31.814413    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xn6pq_3bbba577-ab58-4f88-a821-dbc644c6371d/manager/0.log"
Jul 10 15:12:32.061703 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:32.061632    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gd47v_657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7/kuadrant-console-plugin/0.log"
Jul 10 15:12:32.196738 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:32.196706    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s4scn_5474441b-e5f9-4637-a6ec-9f0a677d52db/registry-server/0.log"
Jul 10 15:12:32.336048 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:32.335949    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-twbrm_2ef64430-eeb7-4279-8d68-fc339a84e8d7/manager/0.log"
Jul 10 15:12:32.489719 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:32.489686    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nb8kq_5185b3d3-31cf-44cc-99db-cc59fd6618d7/limitador/0.log"
Jul 10 15:12:33.284908 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:33.284877    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d766598b-7f7tq_a8743cee-ba5f-4fac-9f4a-9b2b831c1f14/kube-auth-proxy/0.log"
Jul 10 15:12:33.550166 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:33.550091    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9b5v6_3e5cd76b-5232-479b-8568-ce9eaa22d341/istio-proxy/1.log"
Jul 10 15:12:33.806577 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:33.806498    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2nhzm_7e9f548c-3396-4138-837d-6e9bb50158a6/payload-processing/0.log"
Jul 10 15:12:34.290465 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:34.290432    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mwkgj_a4ad0d22-33b3-4eb8-8d4d-59c2eebf9e15/main/0.log"
Jul 10 15:12:39.143713 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.143678    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n89zh/must-gather-2nmrq"]
Jul 10 15:12:39.144183 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144088    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy"
Jul 10 15:12:39.144183 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144100    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy"
Jul 10 15:12:39.144183 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144111    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54c95661-3316-4d06-bbbe-19859cfe30b8" containerName="maas-api"
Jul 10 15:12:39.144183 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144116    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="54c95661-3316-4d06-bbbe-19859cfe30b8" containerName="maas-api"
Jul 10 15:12:39.144183 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144135    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7531b77c-31d2-4867-9dff-8a5d5d53b4e4" containerName="test-curl-7255-139986670982320"
Jul 10 15:12:39.144183 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144143    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7531b77c-31d2-4867-9dff-8a5d5d53b4e4" containerName="test-curl-7255-139986670982320"
Jul 10 15:12:39.144183 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144156    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e2df23f-dd5a-4a74-9ffa-adf4488028db" containerName="maas-api"
Jul 10 15:12:39.144183 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144161    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e2df23f-dd5a-4a74-9ffa-adf4488028db" containerName="maas-api"
Jul 10 15:12:39.144606 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144214    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e2df23f-dd5a-4a74-9ffa-adf4488028db" containerName="maas-api"
Jul 10 15:12:39.144606 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144224    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy"
Jul 10 15:12:39.144606 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144234    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="54c95661-3316-4d06-bbbe-19859cfe30b8" containerName="maas-api"
Jul 10 15:12:39.144606 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144240    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7531b77c-31d2-4867-9dff-8a5d5d53b4e4" containerName="test-curl-7255-139986670982320"
Jul 10 15:12:39.144606 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144248    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy"
Jul 10 15:12:39.144606 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144336    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy"
Jul 10 15:12:39.144606 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.144342    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="80365911-f635-42bb-90a4-d01fe0e4caf5" containerName="istio-proxy"
Jul 10 15:12:39.147441 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.147425    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n89zh/must-gather-2nmrq"
Jul 10 15:12:39.150272 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.150245    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n89zh\"/\"openshift-service-ca.crt\""
Jul 10 15:12:39.150419 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.150290    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n89zh\"/\"kube-root-ca.crt\""
Jul 10 15:12:39.150419 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.150389    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n89zh\"/\"default-dockercfg-h7l2f\""
Jul 10 15:12:39.156165 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.156138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n89zh/must-gather-2nmrq"]
Jul 10 15:12:39.160493 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.160466    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:39.228768 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.228716    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:39.257878 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.257851    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2j5p\" (UniqueName: \"kubernetes.io/projected/84f52216-9c54-4986-a2ab-fbbb63332437-kube-api-access-g2j5p\") pod \"must-gather-2nmrq\" (UID: \"84f52216-9c54-4986-a2ab-fbbb63332437\") " pod="openshift-must-gather-n89zh/must-gather-2nmrq"
Jul 10 15:12:39.258005 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.257885    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/84f52216-9c54-4986-a2ab-fbbb63332437-must-gather-output\") pod \"must-gather-2nmrq\" (UID: \"84f52216-9c54-4986-a2ab-fbbb63332437\") " pod="openshift-must-gather-n89zh/must-gather-2nmrq"
Jul 10 15:12:39.359257 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.359224    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2j5p\" (UniqueName: \"kubernetes.io/projected/84f52216-9c54-4986-a2ab-fbbb63332437-kube-api-access-g2j5p\") pod \"must-gather-2nmrq\" (UID: \"84f52216-9c54-4986-a2ab-fbbb63332437\") " pod="openshift-must-gather-n89zh/must-gather-2nmrq"
Jul 10 15:12:39.359257 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.359260    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/84f52216-9c54-4986-a2ab-fbbb63332437-must-gather-output\") pod \"must-gather-2nmrq\" (UID: \"84f52216-9c54-4986-a2ab-fbbb63332437\") " pod="openshift-must-gather-n89zh/must-gather-2nmrq"
Jul 10 15:12:39.359653 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.359632    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/84f52216-9c54-4986-a2ab-fbbb63332437-must-gather-output\") pod \"must-gather-2nmrq\" (UID: \"84f52216-9c54-4986-a2ab-fbbb63332437\") " pod="openshift-must-gather-n89zh/must-gather-2nmrq"
Jul 10 15:12:39.367522 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.367492    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2j5p\" (UniqueName: \"kubernetes.io/projected/84f52216-9c54-4986-a2ab-fbbb63332437-kube-api-access-g2j5p\") pod \"must-gather-2nmrq\" (UID: \"84f52216-9c54-4986-a2ab-fbbb63332437\") " pod="openshift-must-gather-n89zh/must-gather-2nmrq"
Jul 10 15:12:39.457162 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.457100    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n89zh/must-gather-2nmrq"
Jul 10 15:12:39.592951 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.592924    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n89zh/must-gather-2nmrq"]
Jul 10 15:12:39.594737 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:12:39.594712    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84f52216_9c54_4986_a2ab_fbbb63332437.slice/crio-21ef8c543382c5e000f50a97c476922ac84b16283e30c0df4b6f926281312abc WatchSource:0}: Error finding container 21ef8c543382c5e000f50a97c476922ac84b16283e30c0df4b6f926281312abc: Status 404 returned error can't find the container with id 21ef8c543382c5e000f50a97c476922ac84b16283e30c0df4b6f926281312abc
Jul 10 15:12:39.885581 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:39.885553    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n89zh/must-gather-2nmrq" event={"ID":"84f52216-9c54-4986-a2ab-fbbb63332437","Type":"ContainerStarted","Data":"21ef8c543382c5e000f50a97c476922ac84b16283e30c0df4b6f926281312abc"}
Jul 10 15:12:40.895213 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:40.894478    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n89zh/must-gather-2nmrq" event={"ID":"84f52216-9c54-4986-a2ab-fbbb63332437","Type":"ContainerStarted","Data":"242f847f2670a0b47d531e792d561f42ebba2fc6167cd7a4cd92dbc45578afba"}
Jul 10 15:12:40.895213 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:40.894531    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n89zh/must-gather-2nmrq" event={"ID":"84f52216-9c54-4986-a2ab-fbbb63332437","Type":"ContainerStarted","Data":"141305dbae289110135cffa935645ef8dddafe69e4f656c86798b54385f5001a"}
Jul 10 15:12:40.913155 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:40.913109    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n89zh/must-gather-2nmrq" podStartSLOduration=1.223130215 podStartE2EDuration="1.913094115s" totalImagesPullingTime="689.9639ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:12:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:12:40.909647627 +0000 UTC m=+2472.862537705" watchObservedRunningTime="2026-07-10 15:12:40.913094115 +0000 UTC m=+2472.865984243"
Jul 10 15:12:41.764819 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:41.764781    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kvhmz_1264b577-71fc-4fe2-b67a-d75ed2254b01/global-pull-secret-syncer/0.log"
Jul 10 15:12:41.879591 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:41.879553    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log"
Jul 10 15:12:42.011600 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:42.011565    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-223.ec2.internal_8bd5008cbd0ebf5bf387f822976f37c2/haproxy/0.log"
Jul 10 15:12:46.594626 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.594588    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c_6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61/extract/0.log"
Jul 10 15:12:46.620281 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.620173    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c_6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61/util/0.log"
Jul 10 15:12:46.638696 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.638671    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759jtb4c_6f8f06e6-09d3-4e79-9db1-7f43b2ca4d61/pull/0.log"
Jul 10 15:12:46.662509 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.662482    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq_e36da4f3-9ae5-45b3-9273-6e87ecd9d908/extract/0.log"
Jul 10 15:12:46.682149 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.682112    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq_e36da4f3-9ae5-45b3-9273-6e87ecd9d908/util/0.log"
Jul 10 15:12:46.704951 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.704904    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0n59lq_e36da4f3-9ae5-45b3-9273-6e87ecd9d908/pull/0.log"
Jul 10 15:12:46.731368 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.731288    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8_8521f8c6-ed6b-400d-8673-244061bbd0e1/extract/0.log"
Jul 10 15:12:46.757295 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.757260    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8_8521f8c6-ed6b-400d-8673-244061bbd0e1/util/0.log"
Jul 10 15:12:46.780317 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.780284    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lnqk8_8521f8c6-ed6b-400d-8673-244061bbd0e1/pull/0.log"
Jul 10 15:12:46.811067 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.811035    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4_0d895ceb-92c8-48b4-8a19-cd410a882a97/extract/0.log"
Jul 10 15:12:46.830299 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.830275    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4_0d895ceb-92c8-48b4-8a19-cd410a882a97/util/0.log"
Jul 10 15:12:46.850709 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:46.850625    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cj7p4_0d895ceb-92c8-48b4-8a19-cd410a882a97/pull/0.log"
Jul 10 15:12:47.348773 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:47.346777    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-86cc75879-4rfjk_76c7b395-1671-42ae-823f-d986a8c1406e/authorino/0.log"
Jul 10 15:12:47.416492 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:47.416456    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-xn6pq_3bbba577-ab58-4f88-a821-dbc644c6371d/manager/0.log"
Jul 10 15:12:47.468843 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:47.468808    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gd47v_657f1e58-bf9e-48c0-8c61-9d6c8cc0dfd7/kuadrant-console-plugin/0.log"
Jul 10 15:12:47.525824 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:47.525653    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-s4scn_5474441b-e5f9-4637-a6ec-9f0a677d52db/registry-server/0.log"
Jul 10 15:12:47.665801 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:47.663880    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-twbrm_2ef64430-eeb7-4279-8d68-fc339a84e8d7/manager/0.log"
Jul 10 15:12:47.691229 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:47.691198    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nb8kq_5185b3d3-31cf-44cc-99db-cc59fd6618d7/limitador/0.log"
Jul 10 15:12:49.652907 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:49.652874    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-2khvk_6f179613-f936-4dd6-8a94-71e932403be6/kube-state-metrics/0.log"
Jul 10 15:12:49.672015 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:49.671986    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-2khvk_6f179613-f936-4dd6-8a94-71e932403be6/kube-rbac-proxy-main/0.log"
Jul 10 15:12:49.692820 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:49.692777    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-2khvk_6f179613-f936-4dd6-8a94-71e932403be6/kube-rbac-proxy-self/0.log"
Jul 10 15:12:49.720395 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:49.720367    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c49c9ddcc-5cpxb_3c5c1b43-0fc3-4f9f-b493-d30727194c82/metrics-server/0.log"
Jul 10 15:12:49.842287 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:49.842258    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8qwj7_9e27744b-90b1-449b-a5fe-88e1e086c3d1/node-exporter/0.log"
Jul 10 15:12:49.869240 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:49.869213    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8qwj7_9e27744b-90b1-449b-a5fe-88e1e086c3d1/kube-rbac-proxy/0.log"
Jul 10 15:12:49.888943 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:49.888918    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8qwj7_9e27744b-90b1-449b-a5fe-88e1e086c3d1/init-textfile/0.log"
Jul 10 15:12:49.978590 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:49.978523    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-g7dg6_9c4ffc4b-a0da-458d-a837-30033b10e321/kube-rbac-proxy-main/0.log"
Jul 10 15:12:49.997502 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:49.997475    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-g7dg6_9c4ffc4b-a0da-458d-a837-30033b10e321/kube-rbac-proxy-self/0.log"
Jul 10 15:12:50.020062 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:50.020007    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-g7dg6_9c4ffc4b-a0da-458d-a837-30033b10e321/openshift-state-metrics/0.log"
Jul 10 15:12:51.792574 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:51.792201    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"]
Jul 10 15:12:51.801600 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:51.801574    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:51.803096 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:51.803064    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"]
Jul 10 15:12:51.991332 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:51.991297    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-podres\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:51.991651 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:51.991628    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-lib-modules\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:51.991833 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:51.991815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-proc\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:51.992023 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:51.991999    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjjp2\" (UniqueName: \"kubernetes.io/projected/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-kube-api-access-wjjp2\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:51.992130 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:51.992041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-sys\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.093347 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.093254    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-lib-modules\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.093543 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.093359    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-proc\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.093543 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.093434    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-lib-modules\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.093543 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.093444    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjjp2\" (UniqueName: \"kubernetes.io/projected/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-kube-api-access-wjjp2\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.093543 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.093501    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-sys\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.093816 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.093544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-sys\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.093816 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.093554    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-podres\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.093816 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.093497    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-proc\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.093816 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.093691    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-podres\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.103094 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.103038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjjp2\" (UniqueName: \"kubernetes.io/projected/db92eeb2-57bb-4297-a38f-c5f2b3039fb0-kube-api-access-wjjp2\") pod \"perf-node-gather-daemonset-4gp5t\" (UID: \"db92eeb2-57bb-4297-a38f-c5f2b3039fb0\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.117533 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.117493    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:52.323857 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.323831    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"]
Jul 10 15:12:52.324599 ip-10-0-141-223 kubenswrapper[2564]: W0710 15:12:52.324577    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb92eeb2_57bb_4297_a38f_c5f2b3039fb0.slice/crio-e0bf0b395c48f1b6d7087b6d2bfe856f35c7d438ecee4fdbd53ee3fd6d90e25c WatchSource:0}: Error finding container e0bf0b395c48f1b6d7087b6d2bfe856f35c7d438ecee4fdbd53ee3fd6d90e25c: Status 404 returned error can't find the container with id e0bf0b395c48f1b6d7087b6d2bfe856f35c7d438ecee4fdbd53ee3fd6d90e25c
Jul 10 15:12:52.460654 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.460628    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:12:52.683218 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.683187    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5cc8787fbf-lb9j6_3dbf00e7-26c9-4aff-a794-8b7886ce636d/console/0.log"
Jul 10 15:12:52.993024 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.992936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t" event={"ID":"db92eeb2-57bb-4297-a38f-c5f2b3039fb0","Type":"ContainerStarted","Data":"bd29a85c08903b48c3ce2c07c92e1a43915f9d2829661d169529a9a24552dc48"}
Jul 10 15:12:52.993024 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.993005    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t" event={"ID":"db92eeb2-57bb-4297-a38f-c5f2b3039fb0","Type":"ContainerStarted","Data":"e0bf0b395c48f1b6d7087b6d2bfe856f35c7d438ecee4fdbd53ee3fd6d90e25c"}
Jul 10 15:12:52.993889 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:52.993862    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:12:53.012190 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:53.012141    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t" podStartSLOduration=2.012126444 podStartE2EDuration="2.012126444s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:12:53.00962464 +0000 UTC m=+2484.962514717" watchObservedRunningTime="2026-07-10 15:12:53.012126444 +0000 UTC m=+2484.965016520"
Jul 10 15:12:54.259958 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:54.259898    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x2ztj_203f87c9-e57c-4034-8e9e-2dab6d56cd43/dns/0.log"
Jul 10 15:12:54.276145 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:54.276119    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x2ztj_203f87c9-e57c-4034-8e9e-2dab6d56cd43/kube-rbac-proxy/0.log"
Jul 10 15:12:54.313225 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:54.313194    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fcxcl_56fd283f-02c5-4ef4-bb01-ca6634416c8c/dns-node-resolver/0.log"
Jul 10 15:12:54.824797 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:54.824762    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-857c4f75fd-ht495_b79ed7a5-c3a8-42f2-a4a7-a27bb46b039d/registry/0.log"
Jul 10 15:12:54.866624 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:54.866594    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fz28k_2b46e1a8-bc65-4c92-9284-9d62f2643289/node-ca/0.log"
Jul 10 15:12:55.964118 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:55.964077    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d766598b-7f7tq_a8743cee-ba5f-4fac-9f4a-9b2b831c1f14/kube-auth-proxy/0.log"
Jul 10 15:12:56.008336 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:56.008300    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9b5v6_3e5cd76b-5232-479b-8568-ce9eaa22d341/istio-proxy/0.log"
Jul 10 15:12:56.074585 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:56.074549    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9b5v6_3e5cd76b-5232-479b-8568-ce9eaa22d341/istio-proxy/1.log"
Jul 10 15:12:56.142767 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:56.142715    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2nhzm_7e9f548c-3396-4138-837d-6e9bb50158a6/payload-processing/0.log"
Jul 10 15:12:56.818601 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:56.818561    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7skr9_c4193abf-2819-46cd-8570-c28e870d7279/serve-healthcheck-canary/0.log"
Jul 10 15:12:57.286389 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:57.286351    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2md87_66607373-dee2-4c64-8d4c-7553b5b9478b/kube-rbac-proxy/0.log"
Jul 10 15:12:57.302919 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:57.302887    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2md87_66607373-dee2-4c64-8d4c-7553b5b9478b/exporter/0.log"
Jul 10 15:12:57.320917 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:57.320883    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2md87_66607373-dee2-4c64-8d4c-7553b5b9478b/extractor/0.log"
Jul 10 15:12:59.452930 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:59.452901    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-8jjbr_90712a9e-d8f7-4672-9f0c-cf135c490015/manager/0.log"
Jul 10 15:12:59.706380 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:59.706281    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-t9xg8_3c030ca8-d04a-4e18-91fc-70bd31711bfe/manager/0.log"
Jul 10 15:12:59.875622 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:59.875582    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7cdcdc785b-x546f_bf4f7402-132b-40ea-b5e4-2aab58b4394f/manager/0.log"
Jul 10 15:12:59.895914 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:12:59.895889    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6dqdp_21b5624d-af8e-43a1-9c08-bff53f83a926/server/0.log"
Jul 10 15:13:00.004113 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:00.003991    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-lzj5g_fdc79147-acf9-4840-a97e-59cd7c790ce7/manager/0.log"
Jul 10 15:13:00.027778 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:00.026886    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-4gp5t"
Jul 10 15:13:00.032403 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:00.032378    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547957cd78-6ncbf_57cfab74-0237-4755-911e-f81e5c7d56a1/manager/0.log"
Jul 10 15:13:00.051694 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:00.051672    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547957cd78-6ncbf_57cfab74-0237-4755-911e-f81e5c7d56a1/copy-manifests/0.log"
Jul 10 15:13:02.467778 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:02.467727    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d766598b-7f7tq_a8743cee-ba5f-4fac-9f4a-9b2b831c1f14/kube-auth-proxy/0.log"
Jul 10 15:13:02.511431 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:02.511394    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9b5v6_3e5cd76b-5232-479b-8568-ce9eaa22d341/istio-proxy/0.log"
Jul 10 15:13:02.577292 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:02.577215    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9b5v6_3e5cd76b-5232-479b-8568-ce9eaa22d341/istio-proxy/1.log"
Jul 10 15:13:02.626502 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:02.626466    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2nhzm_7e9f548c-3396-4138-837d-6e9bb50158a6/payload-processing/0.log"
Jul 10 15:13:04.016852 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:04.016818    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d766598b-7f7tq_a8743cee-ba5f-4fac-9f4a-9b2b831c1f14/kube-auth-proxy/0.log"
Jul 10 15:13:04.056317 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:04.056280    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9b5v6_3e5cd76b-5232-479b-8568-ce9eaa22d341/istio-proxy/0.log"
Jul 10 15:13:04.117647 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:04.117612    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9b5v6_3e5cd76b-5232-479b-8568-ce9eaa22d341/istio-proxy/1.log"
Jul 10 15:13:04.167215 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:04.167129    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2nhzm_7e9f548c-3396-4138-837d-6e9bb50158a6/payload-processing/0.log"
Jul 10 15:13:04.430549 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:04.430511    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:13:04.489805 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:04.489767    2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4mjkq_1fa3c17a-ecb7-4804-8244-3aadc6a4ef91/konnectivity-agent/0.log" limit=1024
Jul 10 15:13:07.715105 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:07.715042    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8g8zm_8fa24274-f5c5-4019-b48b-da6121ab2cfc/kube-multus/0.log"
Jul 10 15:13:08.035368 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:08.035271    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skbsn_682aeedf-019e-47da-bba8-a60e9d430381/kube-multus-additional-cni-plugins/0.log"
Jul 10 15:13:08.054549 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:08.054525    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skbsn_682aeedf-019e-47da-bba8-a60e9d430381/egress-router-binary-copy/0.log"
Jul 10 15:13:08.070850 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:08.070829    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skbsn_682aeedf-019e-47da-bba8-a60e9d430381/cni-plugins/0.log"
Jul 10 15:13:08.086506 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:08.086484    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skbsn_682aeedf-019e-47da-bba8-a60e9d430381/bond-cni-plugin/0.log"
Jul 10 15:13:08.103468 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:08.103447    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skbsn_682aeedf-019e-47da-bba8-a60e9d430381/routeoverride-cni/0.log"
Jul 10 15:13:08.120297 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:08.120275    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skbsn_682aeedf-019e-47da-bba8-a60e9d430381/whereabouts-cni-bincopy/0.log"
Jul 10 15:13:08.137642 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:08.137617    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-skbsn_682aeedf-019e-47da-bba8-a60e9d430381/whereabouts-cni/0.log"
Jul 10 15:13:08.295480 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:08.295395    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zqgjg_5945701c-79c9-494b-bc92-3f0b8e754baf/network-metrics-daemon/0.log"
Jul 10 15:13:08.312109 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:08.312086    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-zqgjg_5945701c-79c9-494b-bc92-3f0b8e754baf/kube-rbac-proxy/0.log"
Jul 10 15:13:09.283333 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:09.283300    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-controller/0.log"
Jul 10 15:13:09.296895 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:09.296857    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/1.log"
Jul 10 15:13:09.296895 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:09.296894    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovn-acl-logging/0.log"
Jul 10 15:13:09.311659 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:09.311626    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/kube-rbac-proxy-node/0.log"
Jul 10 15:13:09.328706 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:09.328674    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/kube-rbac-proxy-ovn-metrics/0.log"
Jul 10 15:13:09.346057 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:09.346031    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/northd/0.log"
Jul 10 15:13:09.364095 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:09.364077    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/nbdb/0.log"
Jul 10 15:13:09.380344 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:09.380323    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/sbdb/0.log"
Jul 10 15:13:09.466906 ip-10-0-141-223 kubenswrapper[2564]: I0710 15:13:09.466879    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cqlrr_ac78210f-b14e-4300-bd29-22ad3d8e49ee/ovnkube-controller/0.log"