Jul 23 18:00:30.030376 ip-10-0-143-41 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 18:00:30.030388 ip-10-0-143-41 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 18:00:30.030397 ip-10-0-143-41 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 18:00:30.030954 ip-10-0-143-41 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 18:00:40.239866 ip-10-0-143-41 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 18:00:40.239884 ip-10-0-143-41 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c45a3c1c3de84f2a9eb099b2cc8f850d --
Jul 23 18:02:19.524518 ip-10-0-143-41 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 18:02:19.923311 ip-10-0-143-41 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:02:19.923311 ip-10-0-143-41 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 18:02:19.923311 ip-10-0-143-41 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:02:19.923311 ip-10-0-143-41 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 18:02:19.923311 ip-10-0-143-41 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 18:02:19.925188 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.925103    2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 18:02:19.931251 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931217    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:19.931251 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931247    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:19.931251 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931253    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:19.931251 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931257    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931262    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931266    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931270    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931275    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931279    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931284    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931287    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931291    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931295    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931300    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931303    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931309    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931314    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931318    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931323    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931327    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931331    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931335    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:19.931496 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931340    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931345    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931349    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931354    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931359    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931363    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931368    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931371    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931376    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931380    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931384    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931388    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931392    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931396    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931401    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931405    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931409    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931416    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931422    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931426    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:19.932286 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931431    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931435    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931440    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931444    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931448    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931452    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931456    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931460    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931464    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931468    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931473    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931477    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931481    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931485    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931490    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931494    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931497    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931502    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931507    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931511    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:19.933133 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931515    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931519    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931523    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931528    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931533    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931537    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931545    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931551    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931556    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931560    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931566    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931571    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931575    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931581    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931585    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931590    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931595    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931599    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931603    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:19.933910 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931607    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931611    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931615    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931619    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931624    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931628    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931633    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931637    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931641    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931646    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931651    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931655    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931659    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931663    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931668    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931672    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931676    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.931680    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932859    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:19.934402 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932869    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932874    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932878    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932884    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932888    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932893    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932897    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932901    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932906    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932911    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932915    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932919    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932923    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932928    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932932    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932936    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932941    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932945    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932949    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:19.934854 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932953    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932957    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932961    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932965    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932970    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932974    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932978    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932983    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932987    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932991    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932995    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.932999    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933007    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933013    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933019    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933025    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933030    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933034    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933038    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:19.935338 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933042    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933046    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933050    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933055    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933060    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933065    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933069    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933073    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933077    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933081    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933086    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933090    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933094    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933098    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933105    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933110    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933114    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933118    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933122    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933126    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:19.935803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933130    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933134    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933138    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933142    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933146    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933149    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933153    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933157    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933162    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933167    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933171    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933176    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933180    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933186    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933190    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933194    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933199    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933203    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933207    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933211    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:19.936291 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933216    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933237    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933242    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933246    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933250    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933255    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933259    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933264    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933268    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933273    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933277    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933281    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933285    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933292    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933297    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933302    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933306    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933311    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933315    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933320    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:19.936793 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933925    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933938    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933942    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933945    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933949    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933952    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933955    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933958    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933961    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933964    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933967    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933969    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933972    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933975    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933977    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933980    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933983    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933985    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933988    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933990    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:19.937353 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933993    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933995    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.933998    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934001    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934004    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934006    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934009    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934011    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934014    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934016    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934018    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934021    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934024    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934028    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934030    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934033    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934035    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934038    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934041    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934043    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:19.937838 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934046    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934048    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934051    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934053    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934055    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934058    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934060    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934063    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934067    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934071    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934074    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934077    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934081    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934084    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934088    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934092    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934095    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934098    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934101    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:19.938379 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934104    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934107    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934109    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934112    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934114    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934117    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934120    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934124    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934128    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934131    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934134    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934138    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934140    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934143    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934145    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934148    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934150    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934153    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934155    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:19.938824 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934158    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934161    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934163    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934165    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934168    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934170    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934173    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934175    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934178    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934180    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934182    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934185    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934188    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934190    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934193    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934195    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934198    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934200    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934205    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:19.939302 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934209    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.934212    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934296    2574 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934304    2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934311    2574 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934316    2574 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934320    2574 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934323    2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934327    2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934332    2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934335    2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934338    2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934341    2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934344    2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934347    2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934350    2574 flags.go:64] FLAG: --cgroup-root=""
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934353    2574 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934356    2574 flags.go:64] FLAG: --client-ca-file=""
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934359    2574 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934362    2574 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934366    2574 flags.go:64] FLAG: --cluster-domain=""
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934369    2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934371    2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934375    2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 18:02:19.939774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934378    2574 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934381    2574 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934385    2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934388    2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934391    2574 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934394    2574 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934397    2574 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934401    2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934406    2574 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934409    2574 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934413    2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934417    2574 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934420    2574 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934423    2574 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934426    2574 flags.go:64] FLAG: --enable-server="true"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.934429    2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935100    2574 flags.go:64] FLAG: --event-burst="100"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935104    2574 flags.go:64] FLAG: --event-qps="50"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935107    2574 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935111    2574 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935114    2574 flags.go:64] FLAG: --eviction-hard=""
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935118    2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935121    2574 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935124    2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935127    2574 flags.go:64] FLAG: --eviction-soft=""
Jul 23 18:02:19.940354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935130    2574 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935133    2574 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935136    2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935139    2574 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935142    2574 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935145    2574 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935147    2574 flags.go:64] FLAG: --feature-gates=""
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935151    2574 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935154    2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935157    2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935160    2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935163    2574 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935166    2574 flags.go:64] FLAG: --help="false"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935169    2574 flags.go:64] FLAG: --hostname-override="ip-10-0-143-41.ec2.internal"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935173    2574 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935178    2574 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935181    2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935184    2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935188    2574 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935191    2574 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935194    2574 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935197    2574 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935200    2574 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 18:02:19.940946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935203    2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935206    2574 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935209    2574 flags.go:64] FLAG: --kube-reserved=""
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935212    2574 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935214    2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935217    2574 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935233    2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935236    2574 flags.go:64] FLAG: --lock-file=""
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935239    2574 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935242    2574 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935245    2574 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935250    2574 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935253    2574 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935256    2574 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935259    2574 flags.go:64] FLAG: --logging-format="text"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935262    2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935265    2574 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935268    2574 flags.go:64] FLAG: --manifest-url=""
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935271    2574 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935275    2574 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935278    2574 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935282    2574 flags.go:64] FLAG: --max-pods="110"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935285    2574 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935288    2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935293    2574 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 18:02:19.941601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935296    2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935299    2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935302    2574 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935305    2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935314    2574 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935317    2574 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935320    2574 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935323    2574 flags.go:64] FLAG: --pod-cidr=""
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935326    2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935332    2574 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935334    2574 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935337    2574 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935341    2574 flags.go:64] FLAG: --port="10250"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935344    2574 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935347    2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0626ec6cf3204f98f"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935350    2574 flags.go:64] FLAG: --qos-reserved=""
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935353    2574 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935356    2574 flags.go:64] FLAG: --register-node="true"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935359    2574 flags.go:64] FLAG: --register-with-taints=""
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935363    2574 flags.go:64] FLAG: --registry-burst="10"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935365    2574 flags.go:64] FLAG: --registry-qps="5"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935368    2574 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935371    2574 flags.go:64] FLAG: --reserved-memory=""
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935375    2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935377    2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 18:02:19.942200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935380    2574 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935384    2574 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935387    2574 flags.go:64] FLAG: --runonce="false"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935389    2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935392    2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935396    2574 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935399    2574 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935403    2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935406    2574 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935409    2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935412    2574 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935415    2574 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935418    2574 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935421    2574 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935424    2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935427    2574 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935430    2574 flags.go:64] FLAG: --system-cgroups=""
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935432    2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935438    2574 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935441    2574 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935443    2574 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935448    2574 flags.go:64] FLAG: --tls-min-version=""
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935450    2574 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935453    2574 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935456    2574 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 18:02:19.942819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935459    2574 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935462    2574 flags.go:64] FLAG: --v="2"
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935466    2574 flags.go:64] FLAG: --version="false"
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935470    2574 flags.go:64] FLAG: --vmodule=""
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935473    2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.935477    2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936117    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936122    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936125    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936128    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936131    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936133    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936136    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936138    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936143    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936146    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936149    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936151    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936154    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936156    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936159    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936162    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:19.943580 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936165    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936167    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936170    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936172    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936175    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936178    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936180    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936183    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936187    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936189    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936192    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936194    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936197    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936200    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936202    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936206    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936209    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936212    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936214    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:19.944118 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936217    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936231    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936234    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936236    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936239    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936244    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936246    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936249    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936252    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936256    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936260    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936263    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936266    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936269    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936271    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936274    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936276    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936279    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936281    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936284    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:19.944602 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936287    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936292    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936294    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936297    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936300    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936303    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936306    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936308    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936311    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936314    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936317    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936319    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936322    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936324    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936327    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936330    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936332    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936336    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936339    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936343    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:19.945094 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936346    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936349    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936351    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936354    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936357    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936360    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936363    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936366    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936368    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936371    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936373    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936376    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936378    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936382    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936385    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936387    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936389    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936392    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936394    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936397    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:19.945606 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936399    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936402    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936405    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.936407    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.936412    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.943060    2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.943075    2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.943094    2574 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.943099    2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943169    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943174    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943178    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943181    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943190    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:19.946085 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943195    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943198    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943201    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943204    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943207    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943209    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943212    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943215    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943217    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943237    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943241    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943243    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943246    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943249    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943251    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943255    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943259    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943262    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943265    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:19.946516 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943268    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943271    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943273    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943292    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943296    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943300    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943303    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943306    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943308    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943311    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943314    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943316    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943319    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943327    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943330    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943333    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943335    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943337    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943340    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943342    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:19.946973 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943345    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943347    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943350    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943352    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943354    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943357    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943359    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943362    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943364    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943367    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943370    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943372    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943375    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943377    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943379    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943383    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943385    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943388    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943391    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943393    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:19.947667 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943396    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943398    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943401    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943403    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943406    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943408    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943416    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943419    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943421    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943424    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943426    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943429    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943431    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943434    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943436    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943440    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943443    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943446    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943448    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:19.948139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943451    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943454    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943457    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943460    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943463    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943465    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943468    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943471    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943474    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943476    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943479    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943481    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943483    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943486    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943488    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:19.948655 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943491    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.943496    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943658    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943663    2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943666    2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943677    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943680    2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943682    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943685    2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943688    2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943691    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943694    2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943697    2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943700    2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943703    2574 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 18:02:19.949025 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943705    2574 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943708    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943710    2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943713    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943716    2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943718    2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943721    2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943723    2574 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943726    2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943734    2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943737    2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943739    2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943741    2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943745    2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943749    2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943753    2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943756    2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943759    2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943762    2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 18:02:19.949414 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943765    2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943768    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943771    2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943773    2574 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943781    2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943785    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943788    2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943790    2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943793    2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943796    2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943798    2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943801    2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943804    2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943806    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943809    2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943811    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943814    2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943816    2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943819    2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 18:02:19.949866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943821    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943825    2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943828    2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943831    2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943834    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943837    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943839    2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943842    2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943844    2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943847    2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943850    2574 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943852    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943855    2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943857    2574 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943860    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943862    2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943865    2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943867    2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943876    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 18:02:19.950348 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943879    2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943881    2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943884    2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943887    2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943889    2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943892    2574 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943894    2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943897    2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943899    2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943902    2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943904    2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943909    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943911    2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943914    2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943916    2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943919    2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943921    2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943924    2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943926    2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943929    2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 18:02:19.950803 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943931    2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943934    2574 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943936    2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943939    2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943942    2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943944    2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943947    2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943949    2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:19.943951    2574 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.943956    2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.944066    2574 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 18:02:19.951319 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.946113    2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 18:02:19.951585 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.951385    2574 server.go:1019] "Starting client certificate rotation"
Jul 23 18:02:19.951585 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.951488    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 18:02:19.952355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.952343    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 18:02:19.953952 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.953939    2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 18:02:19.956720 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.956703    2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 18:02:19.968290 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.968272    2574 log.go:25] "Validated CRI v1 runtime API"
Jul 23 18:02:19.970723 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.970712    2574 log.go:25] "Validated CRI v1 image API"
Jul 23 18:02:19.971981 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.971965    2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 18:02:19.975856 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.975835    2574 fs.go:135] Filesystem UUIDs: map[1187c91a-10e3-4930-ba2b-5cc8e7d4f14e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9bada52f-036f-46b0-b91b-34f00376da24:/dev/nvme0n1p4]
Jul 23 18:02:19.975941 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.975854    2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 18:02:19.980826 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.980799    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 18:02:19.981493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.981383    2574 manager.go:216] Machine: {Timestamp:2026-07-23 18:02:19.979843942 +0000 UTC m=+0.342687782 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098276 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24a210efacdbb62c1b647b6f8e9cda SystemUUID:ec24a210-efac-dbb6-2c1b-647b6f8e9cda BootID:c45a3c1c-3de8-4f2a-9eb0-99b2cc8f850d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f1:a3:6b:49:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f1:a3:6b:49:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:63:08:73:9d:57 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 18:02:19.981493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.981491    2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 18:02:19.981588 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.981563    2574 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 18:02:19.984527 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.984505    2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 18:02:19.984666 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.984538    2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-41.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 18:02:19.985165 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.985155    2574 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 18:02:19.985196 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.985168    2574 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 18:02:19.985196 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.985176    2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 18:02:19.986137 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.986126    2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 18:02:19.988130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.988120    2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 18:02:19.991118 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.991102    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 18:02:19.991264 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.991253    2574 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 18:02:19.991312 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.991286    2574 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 18:02:19.991312 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.991298    2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 18:02:19.991312 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.991312    2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 18:02:19.991419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.991321    2574 kubelet.go:398] "Adding apiserver pod source"
Jul 23 18:02:19.991419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.991330    2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 18:02:19.991687 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.991674    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 18:02:19.991750 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.991692    2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 18:02:19.993963 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.993944    2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 18:02:19.995143 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.995130    2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 18:02:19.995193 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.995160    2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 18:02:19.995950 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.995938    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 18:02:19.995983 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.995961    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 18:02:19.995983 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.995970    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 18:02:19.995983 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.995980    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 18:02:19.996061 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.995990    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 18:02:19.996061 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.995997    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 18:02:19.996195 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.996187    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 18:02:19.996242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.996195    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 18:02:19.996242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.996202    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 18:02:19.996242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.996208    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 18:02:19.996242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.996216    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 18:02:19.996242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.996243    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 18:02:19.996952 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.996943    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 18:02:19.996952 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:19.996951    2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 18:02:20.000211 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.000197    2574 server.go:1268] "Started kubelet"
Jul 23 18:02:20.000588 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.000458    2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 18:02:20.000850 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.000803    2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 18:02:20.001168 ip-10-0-143-41 systemd[1]: Started Kubernetes Kubelet.
Jul 23 18:02:20.001337 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.001164    2574 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 18:02:20.002195 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.002183    2574 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 18:02:20.004568 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.004547    2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 18:02:20.005889 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.005853    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 18:02:20.005889 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.005857    2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-41.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 18:02:20.006024 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.005942    2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 18:02:20.006065 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.006040    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 18:02:20.006968 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.005983    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-41.ec2.internal.18c4fd312d43486a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-41.ec2.internal,UID:ip-10-0-143-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-41.ec2.internal,},FirstTimestamp:2026-07-23 18:02:20.000168042 +0000 UTC m=+0.363011902,LastTimestamp:2026-07-23 18:02:20.000168042 +0000 UTC m=+0.363011902,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-41.ec2.internal,}"
Jul 23 18:02:20.009080 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.009065    2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 18:02:20.009149 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.009086    2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 18:02:20.009433 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.009209    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.009625 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.009584    2574 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 18:02:20.009699 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.009627    2574 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 18:02:20.009753 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.009728    2574 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 18:02:20.009753 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.009738    2574 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 18:02:20.009852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.009784    2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 18:02:20.010207 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.010193    2574 factory.go:55] Registering systemd factory
Jul 23 18:02:20.010294 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.010215    2574 factory.go:223] Registration of the systemd container factory successfully
Jul 23 18:02:20.010499 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.010486    2574 factory.go:153] Registering CRI-O factory
Jul 23 18:02:20.010567 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.010501    2574 factory.go:223] Registration of the crio container factory successfully
Jul 23 18:02:20.010715 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.010553    2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 18:02:20.010715 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.010591    2574 factory.go:103] Registering Raw factory
Jul 23 18:02:20.010715 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.010606    2574 manager.go:1196] Started watching for new ooms in manager
Jul 23 18:02:20.011098 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.011079    2574 manager.go:349] Starting recovery of all containers
Jul 23 18:02:20.016498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.016471    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8z5kf"
Jul 23 18:02:20.019391 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.019211    2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 18:02:20.019391 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.019346    2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-41.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 18:02:20.022643 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.022627    2574 manager.go:354] Recovery completed
Jul 23 18:02:20.025698 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.025679    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8z5kf"
Jul 23 18:02:20.027007 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.026993    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:20.028735 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.028718    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:20.028836 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.028746    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:20.028836 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.028757    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:20.029318 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.029303    2574 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 18:02:20.029372 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.029319    2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 18:02:20.029372 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.029336    2574 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 18:02:20.029372 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.029311    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:20.029956 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.029944    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:20.030016 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.029966    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:20.030016 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.029976    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:20.030304 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.030294    2574 policy_none.go:49] "None policy: Start"
Jul 23 18:02:20.030339 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.030308    2574 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 18:02:20.030339 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.030318    2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 18:02:20.030874 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.030812    2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-41.ec2.internal.18c4fd312ef7254c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-41.ec2.internal,UID:ip-10-0-143-41.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-41.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-41.ec2.internal,},FirstTimestamp:2026-07-23 18:02:20.028732748 +0000 UTC m=+0.391576588,LastTimestamp:2026-07-23 18:02:20.028732748 +0000 UTC m=+0.391576588,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-41.ec2.internal,}"
Jul 23 18:02:20.031307 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.031295    2574 policy_none.go:47] "Start"
Jul 23 18:02:20.068832 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.068819    2574 manager.go:337] "Starting Device Plugin manager"
Jul 23 18:02:20.083456 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.068864    2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 18:02:20.083456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.068878    2574 server.go:87] "Starting device plugin registration server"
Jul 23 18:02:20.083456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.069078    2574 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 18:02:20.083456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.069087    2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 18:02:20.083456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.069187    2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 18:02:20.083456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.069293    2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 18:02:20.083456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.069301    2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 18:02:20.083456 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.069777    2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 18:02:20.083456 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.069825    2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.169240 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.169201    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:20.170067 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.170050    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:20.170159 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.170083    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:20.170159 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.170099    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:20.170159 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.170133    2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.177576 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.177520    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 18:02:20.178755 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.178727    2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 18:02:20.178838 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.178775    2574 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 18:02:20.178838 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.178799    2574 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 18:02:20.178942 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.178837    2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 18:02:20.178942 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.178881    2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.178942 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.178906    2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-41.ec2.internal\": node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.180901 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.180882    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:20.223601 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.223580    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.281196 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.281167    2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal"]
Jul 23 18:02:20.281299 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.281246    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:20.282699 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.282681    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:20.282778 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.282715    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:20.282778 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.282729    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:20.283970 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.283957    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:20.284104 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.284090    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.284188 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.284116    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:20.284685 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.284670    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:20.284756 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.284700    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:20.284756 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.284712    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:20.284756 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.284724    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:20.284756 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.284745    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:20.284756 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.284754    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:20.285904 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.285890    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.285950 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.285915    2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 18:02:20.286558 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.286541    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 18:02:20.286627 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.286571    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 18:02:20.286627 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.286589    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeHasSufficientPID"
Jul 23 18:02:20.311017 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.310992    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-41.ec2.internal\" not found" node="ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.315733 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.315713    2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-41.ec2.internal\" not found" node="ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.324137 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.324119    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.411098 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.411073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4ebf2cd5ac2a098d3f1139aeb6ec6b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal\" (UID: \"a4ebf2cd5ac2a098d3f1139aeb6ec6b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.411198 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.411112    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4ebf2cd5ac2a098d3f1139aeb6ec6b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal\" (UID: \"a4ebf2cd5ac2a098d3f1139aeb6ec6b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.411198 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.411141    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51be1d98ce7a93e78550fbe38c9a87e2-config\") pod \"kube-apiserver-proxy-ip-10-0-143-41.ec2.internal\" (UID: \"51be1d98ce7a93e78550fbe38c9a87e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.425192 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.425169    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.511698 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.511641    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4ebf2cd5ac2a098d3f1139aeb6ec6b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal\" (UID: \"a4ebf2cd5ac2a098d3f1139aeb6ec6b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.511698 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.511603    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a4ebf2cd5ac2a098d3f1139aeb6ec6b6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal\" (UID: \"a4ebf2cd5ac2a098d3f1139aeb6ec6b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.511819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.511717    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4ebf2cd5ac2a098d3f1139aeb6ec6b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal\" (UID: \"a4ebf2cd5ac2a098d3f1139aeb6ec6b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.511819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.511747    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51be1d98ce7a93e78550fbe38c9a87e2-config\") pod \"kube-apiserver-proxy-ip-10-0-143-41.ec2.internal\" (UID: \"51be1d98ce7a93e78550fbe38c9a87e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.511819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.511803    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4ebf2cd5ac2a098d3f1139aeb6ec6b6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal\" (UID: \"a4ebf2cd5ac2a098d3f1139aeb6ec6b6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.511819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.511805    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/51be1d98ce7a93e78550fbe38c9a87e2-config\") pod \"kube-apiserver-proxy-ip-10-0-143-41.ec2.internal\" (UID: \"51be1d98ce7a93e78550fbe38c9a87e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.525749 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.525729    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.615849 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.615808    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.620567 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.620237    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:20.626776 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.626759    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.727177 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.727143    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.828071 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.827993    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.928957 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:20.928930    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:20.951793 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.951755    2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 18:02:20.951937 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:20.951917    2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 18:02:21.029877 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:21.029856    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:21.029877 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.029870    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 17:57:20 +0000 UTC" deadline="2027-12-24 13:02:10.371580178 +0000 UTC"
Jul 23 18:02:21.030019 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.029892    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12450h59m49.341691451s"
Jul 23 18:02:21.053309 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.053224    2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:21.130905 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:21.130843    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:21.231370 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:21.231342    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:21.316105 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:21.316072    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51be1d98ce7a93e78550fbe38c9a87e2.slice/crio-918d9a6b11f1e0147acf680215592827886fa8b47dbc438e5445cade807e32ef WatchSource:0}: Error finding container 918d9a6b11f1e0147acf680215592827886fa8b47dbc438e5445cade807e32ef: Status 404 returned error can't find the container with id 918d9a6b11f1e0147acf680215592827886fa8b47dbc438e5445cade807e32ef
Jul 23 18:02:21.316564 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:21.316543    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4ebf2cd5ac2a098d3f1139aeb6ec6b6.slice/crio-24e3e75eea74b8f3297741d0edb9efd6bfa0b4135416cf3139c14c94571c9b02 WatchSource:0}: Error finding container 24e3e75eea74b8f3297741d0edb9efd6bfa0b4135416cf3139c14c94571c9b02: Status 404 returned error can't find the container with id 24e3e75eea74b8f3297741d0edb9efd6bfa0b4135416cf3139c14c94571c9b02
Jul 23 18:02:21.320855 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.320837    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:02:21.331964 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:21.331935    2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-41.ec2.internal\" not found"
Jul 23 18:02:21.381728 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.381669    2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:21.410115 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.410086    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:21.425303 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.425285    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 18:02:21.426517 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.426504    2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal"
Jul 23 18:02:21.434145 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.434130    2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 18:02:21.584150 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.584122    2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:21.943119 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.943071    2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 18:02:21.993815 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:21.993785    2574 apiserver.go:52] "Watching apiserver"
Jul 23 18:02:22.002207 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.002181    2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 18:02:22.002667 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.002641    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-cm7th","openshift-network-diagnostics/network-check-target-fj4n8","openshift-ovn-kubernetes/ovnkube-node-lz6x9","kube-system/konnectivity-agent-mw7kn","openshift-dns/node-resolver-nv8r5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal","openshift-multus/multus-additional-cni-plugins-tb7x4","openshift-multus/network-metrics-daemon-5ff94","openshift-network-operator/iptables-alerter-cd8w6","kube-system/global-pull-secret-syncer-sn5fv","kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl","openshift-cluster-node-tuning-operator/tuned-5pfgf","openshift-image-registry/node-ca-6sx4r"]
Jul 23 18:02:22.004523 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.004499    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.005879 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.005854    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.007130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.007106    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 18:02:22.007773 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.007471    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c6rhp\""
Jul 23 18:02:22.007773 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.007646    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.007773 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.007690    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 18:02:22.007969 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.007895    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 18:02:22.008576 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.008473    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 18:02:22.008710 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.008686    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 18:02:22.009800 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.008783    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:22.009800 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.009231    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 18:02:22.009800 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.009442    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:02:22.009800 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.009675    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k8xqv\""
Jul 23 18:02:22.010072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.009872    2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 18:02:22.011206 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.011186    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 18:02:22.011318 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.011236    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 18:02:22.011383 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.011191    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 18:02:22.011653 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.011627    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5864v\""
Jul 23 18:02:22.011765 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.011709    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 18:02:22.011835 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.011771    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 18:02:22.011889 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.011878    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 18:02:22.012183 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.012015    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 18:02:22.012183 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.012060    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.012576 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.012557    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.014237 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.013661    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 18:02:22.014237 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.013848    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-chwbz\""
Jul 23 18:02:22.015817 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.015216    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gcpcl\""
Jul 23 18:02:22.015817 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.015775    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.017365 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.016690    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.018087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.017746    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 18:02:22.018087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.017870    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 18:02:22.018087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.017890    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 18:02:22.018394 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.018373    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5l8qc\""
Jul 23 18:02:22.018465 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.018438    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 18:02:22.018684 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.018668    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:02:22.018754 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.018699    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 18:02:22.019577 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.019557    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 18:02:22.019838 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.019817    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:22.019941 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.019856    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9zv88\""
Jul 23 18:02:22.019941 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.019913    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:22.020059 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.019969    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2dtxg\""
Jul 23 18:02:22.020218 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.020200    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 18:02:22.020693 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.020631    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 18:02:22.022206 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.021951    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:22.022206 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.022030    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:22.022814 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.022791    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-lib-modules\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.022923 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.022848    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f758607d-d388-4071-b4a8-6ab868b3ab4a-tmp\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.022923 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.022874    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-run-systemd\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.022923 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.022898    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-run-ovn\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023076 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.022921    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-cni-bin\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023076 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.022949    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74f57d07-1d4c-4e29-b373-899b525352d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.023076 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.022983    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-var-lib-kubelet\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.023076 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023015    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-slash\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023076 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023040    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-cni-netd\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edee6867-7351-4508-9888-a8898e804e21-env-overrides\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023131    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fblj5\" (UniqueName: \"kubernetes.io/projected/058016a0-d6ab-4363-bc0a-f804b1b5716f-kube-api-access-fblj5\") pod \"node-resolver-nv8r5\" (UID: \"058016a0-d6ab-4363-bc0a-f804b1b5716f\") " pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.023355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-sysconfig\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.023355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-kubernetes\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.023355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023217    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-sysctl-conf\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.023355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023240    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-sys\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.023355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023265    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-kubelet\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023289    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-log-socket\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023406    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edee6867-7351-4508-9888-a8898e804e21-ovnkube-config\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023433    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-modprobe-d\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023458    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-tuned\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023479    2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023483    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023543    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edee6867-7351-4508-9888-a8898e804e21-ovn-node-metrics-cert\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023573    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edee6867-7351-4508-9888-a8898e804e21-ovnkube-script-lib\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023598    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-cnibin\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023638    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-os-release\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023673    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023703    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-systemd\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023677    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.023748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023726    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-run\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023762    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-etc-openvswitch\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023788    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77049378-df66-46f7-8e93-f0a08ea49b3e-agent-certs\") pod \"konnectivity-agent-mw7kn\" (UID: \"77049378-df66-46f7-8e93-f0a08ea49b3e\") " pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023834    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77049378-df66-46f7-8e93-f0a08ea49b3e-konnectivity-ca\") pod \"konnectivity-agent-mw7kn\" (UID: \"77049378-df66-46f7-8e93-f0a08ea49b3e\") " pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023873    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-system-cni-dir\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023922    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74f57d07-1d4c-4e29-b373-899b525352d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023957    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfv4\" (UniqueName: \"kubernetes.io/projected/74f57d07-1d4c-4e29-b373-899b525352d6-kube-api-access-ggfv4\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.023985    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-host\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g95vf\" (UniqueName: \"kubernetes.io/projected/f758607d-d388-4071-b4a8-6ab868b3ab4a-kube-api-access-g95vf\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024077    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-run-netns\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024103    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-var-lib-openvswitch\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024128    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-run-openvswitch\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024161    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-run-ovn-kubernetes\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024199    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj8xx\" (UniqueName: \"kubernetes.io/projected/edee6867-7351-4508-9888-a8898e804e21-kube-api-access-mj8xx\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024223    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-node-log\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024247    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/058016a0-d6ab-4363-bc0a-f804b1b5716f-hosts-file\") pod \"node-resolver-nv8r5\" (UID: \"058016a0-d6ab-4363-bc0a-f804b1b5716f\") " pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.024406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024287    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058016a0-d6ab-4363-bc0a-f804b1b5716f-tmp-dir\") pod \"node-resolver-nv8r5\" (UID: \"058016a0-d6ab-4363-bc0a-f804b1b5716f\") " pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.025200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024312    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74f57d07-1d4c-4e29-b373-899b525352d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.025200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024336    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-sysctl-d\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.025200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.024358    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-systemd-units\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.025200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.025121    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:22.025200 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.025183    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:22.026320 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.026279    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zvmtx\""
Jul 23 18:02:22.026418 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.026286    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 18:02:22.026418 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.026368    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 18:02:22.026418 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.026331    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 18:02:22.110998 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.110972    2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 18:02:22.121177 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.121151    2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cqdxz"
Jul 23 18:02:22.125421 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125394    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-sys\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.125525 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125438    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-kubelet\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.125525 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125467    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-sys\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.125525 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125477    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-sys-fs\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.125525 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125511    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-etc-kubernetes\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.125722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125534    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgdxd\" (UniqueName: \"kubernetes.io/projected/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-kube-api-access-wgdxd\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.125722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125549    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-kubelet\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.125722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.125722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125602    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.125722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125596    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edee6867-7351-4508-9888-a8898e804e21-ovnkube-script-lib\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.125722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125645    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-etc-selinux\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.125722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125668    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1069ec60-3215-429b-b2e0-517286fe5600-host\") pod \"node-ca-6sx4r\" (UID: \"1069ec60-3215-429b-b2e0-517286fe5600\") " pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.125722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125704    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-run\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.126191 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125731    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-etc-openvswitch\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.126191 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125782    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-system-cni-dir\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.126191 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125793    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-run\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.126191 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74f57d07-1d4c-4e29-b373-899b525352d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.126456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126332    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-etc-openvswitch\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.126456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126349    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-system-cni-dir\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.126456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.125860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfv4\" (UniqueName: \"kubernetes.io/projected/74f57d07-1d4c-4e29-b373-899b525352d6-kube-api-access-ggfv4\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.126456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126389    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/74f57d07-1d4c-4e29-b373-899b525352d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.126456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-cni-binary-copy\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.126456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126436    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-run-multus-certs\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.126456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126390    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edee6867-7351-4508-9888-a8898e804e21-ovnkube-script-lib\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126468    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcf14205-3f73-4b29-ad41-afb60d083309-dbus\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126519    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-host\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126549    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g95vf\" (UniqueName: \"kubernetes.io/projected/f758607d-d388-4071-b4a8-6ab868b3ab4a-kube-api-access-g95vf\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-run-netns\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126598    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-var-lib-openvswitch\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126632    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-run-openvswitch\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126659    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74f57d07-1d4c-4e29-b373-899b525352d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126663    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-host\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126683    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv7vk\" (UniqueName: \"kubernetes.io/projected/ece6ba8f-2935-454c-bfcb-2290b03d6753-kube-api-access-xv7vk\") pod \"iptables-alerter-cd8w6\" (UID: \"ece6ba8f-2935-454c-bfcb-2290b03d6753\") " pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126712    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-node-log\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126716    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-var-lib-openvswitch\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126746    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-run-openvswitch\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126755    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058016a0-d6ab-4363-bc0a-f804b1b5716f-tmp-dir\") pod \"node-resolver-nv8r5\" (UID: \"058016a0-d6ab-4363-bc0a-f804b1b5716f\") " pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.126813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126789    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-device-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126831    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v68p6\" (UniqueName: \"kubernetes.io/projected/3a2f2c12-a5c6-4e62-8340-722b2db7df28-kube-api-access-v68p6\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126854    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-node-log\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ece6ba8f-2935-454c-bfcb-2290b03d6753-iptables-alerter-script\") pod \"iptables-alerter-cd8w6\" (UID: \"ece6ba8f-2935-454c-bfcb-2290b03d6753\") " pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126790    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-run-netns\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126897    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-system-cni-dir\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126930    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-var-lib-kubelet\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-sysctl-d\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.126997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-var-lib-cni-bin\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127035    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wj95\" (UniqueName: \"kubernetes.io/projected/d29fc578-05c8-4db0-afe8-feb466c314a2-kube-api-access-7wj95\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127063    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f758607d-d388-4071-b4a8-6ab868b3ab4a-tmp\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127068    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-sysctl-d\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127091    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/058016a0-d6ab-4363-bc0a-f804b1b5716f-tmp-dir\") pod \"node-resolver-nv8r5\" (UID: \"058016a0-d6ab-4363-bc0a-f804b1b5716f\") " pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-run-systemd\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127155    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-run-ovn\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127157    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-run-systemd\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127187    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-cni-bin\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.127356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127202    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/74f57d07-1d4c-4e29-b373-899b525352d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127217    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1069ec60-3215-429b-b2e0-517286fe5600-serviceca\") pod \"node-ca-6sx4r\" (UID: \"1069ec60-3215-429b-b2e0-517286fe5600\") " pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127243    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-run-k8s-cni-cncf-io\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127257    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-cni-bin\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127261    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-daemon-config\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127340    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-run-ovn\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127385    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-var-lib-kubelet\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127414    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-slash\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127437    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-var-lib-kubelet\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-cni-netd\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127496    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rbxr\" (UniqueName: \"kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr\") pod \"network-check-target-fj4n8\" (UID: \"d37b367f-0f47-417e-87f2-254b46903ee1\") " pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127488    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-slash\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127521    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-cnibin\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127524    2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127534    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-cni-netd\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127548    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcf14205-3f73-4b29-ad41-afb60d083309-kubelet-config\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127596    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-sysconfig\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.128114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127630    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-kubernetes\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127648    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-sysconfig\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-kubernetes\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127682    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-sysctl-conf\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-log-socket\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edee6867-7351-4508-9888-a8898e804e21-ovnkube-config\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127794    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-log-socket\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127806    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127833    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-sysctl-conf\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127855    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-modprobe-d\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-tuned\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127923    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edee6867-7351-4508-9888-a8898e804e21-ovn-node-metrics-cert\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127947    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-cnibin\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127977    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.127978    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-os-release\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128042    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-os-release\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.129040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128047    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128073    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-socket-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-registration-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128154    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-modprobe-d\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128185    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-systemd\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77049378-df66-46f7-8e93-f0a08ea49b3e-agent-certs\") pod \"konnectivity-agent-mw7kn\" (UID: \"77049378-df66-46f7-8e93-f0a08ea49b3e\") " pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128288    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77049378-df66-46f7-8e93-f0a08ea49b3e-konnectivity-ca\") pod \"konnectivity-agent-mw7kn\" (UID: \"77049378-df66-46f7-8e93-f0a08ea49b3e\") " pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128316    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edee6867-7351-4508-9888-a8898e804e21-ovnkube-config\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128317    2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cqdxz"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128318    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6vb8\" (UniqueName: \"kubernetes.io/projected/1069ec60-3215-429b-b2e0-517286fe5600-kube-api-access-b6vb8\") pod \"node-ca-6sx4r\" (UID: \"1069ec60-3215-429b-b2e0-517286fe5600\") " pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128378    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-run-ovn-kubernetes\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128381    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/74f57d07-1d4c-4e29-b373-899b525352d6-cnibin\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128419    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-systemd\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128468    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj8xx\" (UniqueName: \"kubernetes.io/projected/edee6867-7351-4508-9888-a8898e804e21-kube-api-access-mj8xx\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128497    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/058016a0-d6ab-4363-bc0a-f804b1b5716f-hosts-file\") pod \"node-resolver-nv8r5\" (UID: \"058016a0-d6ab-4363-bc0a-f804b1b5716f\") " pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128540    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-run-netns\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128567    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-var-lib-cni-multus\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128588    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-hostroot\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.129940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128623    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ece6ba8f-2935-454c-bfcb-2290b03d6753-host-slash\") pod \"iptables-alerter-cd8w6\" (UID: \"ece6ba8f-2935-454c-bfcb-2290b03d6753\") " pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128645    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-os-release\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128689    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-systemd-units\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128724    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-conf-dir\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128751    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-lib-modules\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128837    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/058016a0-d6ab-4363-bc0a-f804b1b5716f-hosts-file\") pod \"node-resolver-nv8r5\" (UID: \"058016a0-d6ab-4363-bc0a-f804b1b5716f\") " pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128841    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-systemd-units\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128885    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edee6867-7351-4508-9888-a8898e804e21-host-run-ovn-kubernetes\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128929    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74f57d07-1d4c-4e29-b373-899b525352d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128947    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f758607d-d388-4071-b4a8-6ab868b3ab4a-lib-modules\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.128974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-cni-dir\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.129011    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-socket-dir-parent\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.129051    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edee6867-7351-4508-9888-a8898e804e21-env-overrides\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.129075    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fblj5\" (UniqueName: \"kubernetes.io/projected/058016a0-d6ab-4363-bc0a-f804b1b5716f-kube-api-access-fblj5\") pod \"node-resolver-nv8r5\" (UID: \"058016a0-d6ab-4363-bc0a-f804b1b5716f\") " pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.129467    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77049378-df66-46f7-8e93-f0a08ea49b3e-konnectivity-ca\") pod \"konnectivity-agent-mw7kn\" (UID: \"77049378-df66-46f7-8e93-f0a08ea49b3e\") " pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.129526    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/74f57d07-1d4c-4e29-b373-899b525352d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.130912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.129757    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edee6867-7351-4508-9888-a8898e804e21-env-overrides\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.131762 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.131272    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f758607d-d388-4071-b4a8-6ab868b3ab4a-tmp\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.131762 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.131539    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edee6867-7351-4508-9888-a8898e804e21-ovn-node-metrics-cert\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.131879 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.131801    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f758607d-d388-4071-b4a8-6ab868b3ab4a-etc-tuned\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.133207 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.133189    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77049378-df66-46f7-8e93-f0a08ea49b3e-agent-certs\") pod \"konnectivity-agent-mw7kn\" (UID: \"77049378-df66-46f7-8e93-f0a08ea49b3e\") " pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:22.139502 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.139475    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfv4\" (UniqueName: \"kubernetes.io/projected/74f57d07-1d4c-4e29-b373-899b525352d6-kube-api-access-ggfv4\") pod \"multus-additional-cni-plugins-tb7x4\" (UID: \"74f57d07-1d4c-4e29-b373-899b525352d6\") " pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.140257 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.139960    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj8xx\" (UniqueName: \"kubernetes.io/projected/edee6867-7351-4508-9888-a8898e804e21-kube-api-access-mj8xx\") pod \"ovnkube-node-lz6x9\" (UID: \"edee6867-7351-4508-9888-a8898e804e21\") " pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.141797 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.141774    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fblj5\" (UniqueName: \"kubernetes.io/projected/058016a0-d6ab-4363-bc0a-f804b1b5716f-kube-api-access-fblj5\") pod \"node-resolver-nv8r5\" (UID: \"058016a0-d6ab-4363-bc0a-f804b1b5716f\") " pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.144018 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.143975    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g95vf\" (UniqueName: \"kubernetes.io/projected/f758607d-d388-4071-b4a8-6ab868b3ab4a-kube-api-access-g95vf\") pod \"tuned-5pfgf\" (UID: \"f758607d-d388-4071-b4a8-6ab868b3ab4a\") " pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.185485 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.185431    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal" event={"ID":"51be1d98ce7a93e78550fbe38c9a87e2","Type":"ContainerStarted","Data":"918d9a6b11f1e0147acf680215592827886fa8b47dbc438e5445cade807e32ef"}
Jul 23 18:02:22.186957 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.186931    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal" event={"ID":"a4ebf2cd5ac2a098d3f1139aeb6ec6b6","Type":"ContainerStarted","Data":"24e3e75eea74b8f3297741d0edb9efd6bfa0b4135416cf3139c14c94571c9b02"}
Jul 23 18:02:22.230242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230144    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-cni-dir\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.230242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230188    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-socket-dir-parent\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.230242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230215    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-sys-fs\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230366    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-etc-kubernetes\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230397    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgdxd\" (UniqueName: \"kubernetes.io/projected/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-kube-api-access-wgdxd\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230402    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-cni-dir\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230422    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-etc-selinux\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230432    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-sys-fs\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230464    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-etc-kubernetes\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230466    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1069ec60-3215-429b-b2e0-517286fe5600-host\") pod \"node-ca-6sx4r\" (UID: \"1069ec60-3215-429b-b2e0-517286fe5600\") " pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230500    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1069ec60-3215-429b-b2e0-517286fe5600-host\") pod \"node-ca-6sx4r\" (UID: \"1069ec60-3215-429b-b2e0-517286fe5600\") " pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230502    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-socket-dir-parent\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230520    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-cni-binary-copy\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.230531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230528    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-etc-selinux\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230552    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-run-multus-certs\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230579    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcf14205-3f73-4b29-ad41-afb60d083309-dbus\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230610    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv7vk\" (UniqueName: \"kubernetes.io/projected/ece6ba8f-2935-454c-bfcb-2290b03d6753-kube-api-access-xv7vk\") pod \"iptables-alerter-cd8w6\" (UID: \"ece6ba8f-2935-454c-bfcb-2290b03d6753\") " pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230620    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-run-multus-certs\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230653    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-device-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230681    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v68p6\" (UniqueName: \"kubernetes.io/projected/3a2f2c12-a5c6-4e62-8340-722b2db7df28-kube-api-access-v68p6\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230709    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ece6ba8f-2935-454c-bfcb-2290b03d6753-iptables-alerter-script\") pod \"iptables-alerter-cd8w6\" (UID: \"ece6ba8f-2935-454c-bfcb-2290b03d6753\") " pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230729    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcf14205-3f73-4b29-ad41-afb60d083309-dbus\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230736    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-system-cni-dir\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230757    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-device-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230784    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-var-lib-kubelet\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230815    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-var-lib-cni-bin\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230825    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-system-cni-dir\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230843    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wj95\" (UniqueName: \"kubernetes.io/projected/d29fc578-05c8-4db0-afe8-feb466c314a2-kube-api-access-7wj95\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230870    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-var-lib-kubelet\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230872    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-var-lib-cni-bin\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230874    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1069ec60-3215-429b-b2e0-517286fe5600-serviceca\") pod \"node-ca-6sx4r\" (UID: \"1069ec60-3215-429b-b2e0-517286fe5600\") " pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230939    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-run-k8s-cni-cncf-io\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.230964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-daemon-config\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231033    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbxr\" (UniqueName: \"kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr\") pod \"network-check-target-fj4n8\" (UID: \"d37b367f-0f47-417e-87f2-254b46903ee1\") " pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231073    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-cnibin\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcf14205-3f73-4b29-ad41-afb60d083309-kubelet-config\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231164    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231166    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-cni-binary-copy\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231191    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-socket-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231216    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-registration-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231240    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-cnibin\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231245    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6vb8\" (UniqueName: \"kubernetes.io/projected/1069ec60-3215-429b-b2e0-517286fe5600-kube-api-access-b6vb8\") pod \"node-ca-6sx4r\" (UID: \"1069ec60-3215-429b-b2e0-517286fe5600\") " pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231296    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-run-netns\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231322    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-var-lib-cni-multus\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.231342    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231348    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-hostroot\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.231943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231355    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ece6ba8f-2935-454c-bfcb-2290b03d6753-iptables-alerter-script\") pod \"iptables-alerter-cd8w6\" (UID: \"ece6ba8f-2935-454c-bfcb-2290b03d6753\") " pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231347    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1069ec60-3215-429b-b2e0-517286fe5600-serviceca\") pod \"node-ca-6sx4r\" (UID: \"1069ec60-3215-429b-b2e0-517286fe5600\") " pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231381    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ece6ba8f-2935-454c-bfcb-2290b03d6753-host-slash\") pod \"iptables-alerter-cd8w6\" (UID: \"ece6ba8f-2935-454c-bfcb-2290b03d6753\") " pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.231428    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs podName:d29fc578-05c8-4db0-afe8-feb466c314a2 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:22.731388498 +0000 UTC m=+3.094232343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs") pod "network-metrics-daemon-5ff94" (UID: "d29fc578-05c8-4db0-afe8-feb466c314a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231432    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-registration-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231425    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-socket-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231464    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-os-release\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-conf-dir\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231514    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcf14205-3f73-4b29-ad41-afb60d083309-kubelet-config\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231559    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-var-lib-cni-multus\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.231600    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231605    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-hostroot\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231611    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-run-netns\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231426    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ece6ba8f-2935-454c-bfcb-2290b03d6753-host-slash\") pod \"iptables-alerter-cd8w6\" (UID: \"ece6ba8f-2935-454c-bfcb-2290b03d6753\") " pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231659    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-host-run-k8s-cni-cncf-io\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.231666    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret podName:dcf14205-3f73-4b29-ad41-afb60d083309 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:22.731646588 +0000 UTC m=+3.094490434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret") pod "global-pull-secret-syncer-sn5fv" (UID: "dcf14205-3f73-4b29-ad41-afb60d083309") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231660    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3a2f2c12-a5c6-4e62-8340-722b2db7df28-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.232852 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231687    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-conf-dir\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.233560 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.231731    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-os-release\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.233560 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.232036    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-multus-daemon-config\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.242743 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.242721    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:22.242743 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.242744    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:22.242929 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.242758    2574 projected.go:196] Error preparing data for projected volume kube-api-access-8rbxr for pod openshift-network-diagnostics/network-check-target-fj4n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:22.242929 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.242823    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr podName:d37b367f-0f47-417e-87f2-254b46903ee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:22.742804335 +0000 UTC m=+3.105648178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8rbxr" (UniqueName: "kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr") pod "network-check-target-fj4n8" (UID: "d37b367f-0f47-417e-87f2-254b46903ee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:22.244095 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.244047    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv7vk\" (UniqueName: \"kubernetes.io/projected/ece6ba8f-2935-454c-bfcb-2290b03d6753-kube-api-access-xv7vk\") pod \"iptables-alerter-cd8w6\" (UID: \"ece6ba8f-2935-454c-bfcb-2290b03d6753\") " pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.244959 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.244898    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgdxd\" (UniqueName: \"kubernetes.io/projected/3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935-kube-api-access-wgdxd\") pod \"multus-cm7th\" (UID: \"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935\") " pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.245326 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.245277    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6vb8\" (UniqueName: \"kubernetes.io/projected/1069ec60-3215-429b-b2e0-517286fe5600-kube-api-access-b6vb8\") pod \"node-ca-6sx4r\" (UID: \"1069ec60-3215-429b-b2e0-517286fe5600\") " pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.246573 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.246549    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v68p6\" (UniqueName: \"kubernetes.io/projected/3a2f2c12-a5c6-4e62-8340-722b2db7df28-kube-api-access-v68p6\") pod \"aws-ebs-csi-driver-node-pmxfl\" (UID: \"3a2f2c12-a5c6-4e62-8340-722b2db7df28\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.246711 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.246686    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wj95\" (UniqueName: \"kubernetes.io/projected/d29fc578-05c8-4db0-afe8-feb466c314a2-kube-api-access-7wj95\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:22.322976 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.322945    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tb7x4"
Jul 23 18:02:22.331892 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.331851    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5pfgf"
Jul 23 18:02:22.340771 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.340748    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:22.346591 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.346567    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:22.352734 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.352715    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nv8r5"
Jul 23 18:02:22.360560 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.360539    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6sx4r"
Jul 23 18:02:22.368291 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.368251    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cd8w6"
Jul 23 18:02:22.376028 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.376004    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cm7th"
Jul 23 18:02:22.381912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.381870    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl"
Jul 23 18:02:22.735796 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.735763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:22.735983 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.735823    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:22.735983 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.735953    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:22.735983 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.735974    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:22.736145 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.736033    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret podName:dcf14205-3f73-4b29-ad41-afb60d083309 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:23.736013372 +0000 UTC m=+4.098857200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret") pod "global-pull-secret-syncer-sn5fv" (UID: "dcf14205-3f73-4b29-ad41-afb60d083309") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:22.736145 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.736056    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs podName:d29fc578-05c8-4db0-afe8-feb466c314a2 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:23.736043122 +0000 UTC m=+4.098886951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs") pod "network-metrics-daemon-5ff94" (UID: "d29fc578-05c8-4db0-afe8-feb466c314a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:22.836966 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:22.836921    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbxr\" (UniqueName: \"kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr\") pod \"network-check-target-fj4n8\" (UID: \"d37b367f-0f47-417e-87f2-254b46903ee1\") " pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:22.837153 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.837114    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:22.837153 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.837140    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:22.837287 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.837157    2574 projected.go:196] Error preparing data for projected volume kube-api-access-8rbxr for pod openshift-network-diagnostics/network-check-target-fj4n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:22.837287 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:22.837232    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr podName:d37b367f-0f47-417e-87f2-254b46903ee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:23.837210503 +0000 UTC m=+4.200054350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rbxr" (UniqueName: "kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr") pod "network-check-target-fj4n8" (UID: "d37b367f-0f47-417e-87f2-254b46903ee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:23.132396 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:23.132303    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:57:22 +0000 UTC" deadline="2028-03-12 08:17:09.746316296 +0000 UTC"
Jul 23 18:02:23.132396 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:23.132343    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14342h14m46.613977756s"
Jul 23 18:02:23.300298 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:23.300263    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2f2c12_a5c6_4e62_8340_722b2db7df28.slice/crio-62f383529f2082680f7f8fbfe98484d4deb0c4072d156ca4721ba1cd0d4aac3e WatchSource:0}: Error finding container 62f383529f2082680f7f8fbfe98484d4deb0c4072d156ca4721ba1cd0d4aac3e: Status 404 returned error can't find the container with id 62f383529f2082680f7f8fbfe98484d4deb0c4072d156ca4721ba1cd0d4aac3e
Jul 23 18:02:23.301693 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:23.301666    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77049378_df66_46f7_8e93_f0a08ea49b3e.slice/crio-4586f1bf4f1ed1ec9b4aa37716a83f35141b0a66acad064c2a969e881fe0b861 WatchSource:0}: Error finding container 4586f1bf4f1ed1ec9b4aa37716a83f35141b0a66acad064c2a969e881fe0b861: Status 404 returned error can't find the container with id 4586f1bf4f1ed1ec9b4aa37716a83f35141b0a66acad064c2a969e881fe0b861
Jul 23 18:02:23.303399 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:23.303146    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf758607d_d388_4071_b4a8_6ab868b3ab4a.slice/crio-576a1255ba1dc5e91e03e158e97c214f4f5c2941bdc3227b842b858131ceb3cb WatchSource:0}: Error finding container 576a1255ba1dc5e91e03e158e97c214f4f5c2941bdc3227b842b858131ceb3cb: Status 404 returned error can't find the container with id 576a1255ba1dc5e91e03e158e97c214f4f5c2941bdc3227b842b858131ceb3cb
Jul 23 18:02:23.304700 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:23.304613    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058016a0_d6ab_4363_bc0a_f804b1b5716f.slice/crio-a2efee6ce87c6b659e07146157ea1a5c85cc9bc69a893af80627e0df9bdf5866 WatchSource:0}: Error finding container a2efee6ce87c6b659e07146157ea1a5c85cc9bc69a893af80627e0df9bdf5866: Status 404 returned error can't find the container with id a2efee6ce87c6b659e07146157ea1a5c85cc9bc69a893af80627e0df9bdf5866
Jul 23 18:02:23.307554 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:23.307528    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedee6867_7351_4508_9888_a8898e804e21.slice/crio-89b72b514eabf39643bf066a723731d070d2d025ff4e54a3891248a976bfb5f9 WatchSource:0}: Error finding container 89b72b514eabf39643bf066a723731d070d2d025ff4e54a3891248a976bfb5f9: Status 404 returned error can't find the container with id 89b72b514eabf39643bf066a723731d070d2d025ff4e54a3891248a976bfb5f9
Jul 23 18:02:23.308864 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:23.308309    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1069ec60_3215_429b_b2e0_517286fe5600.slice/crio-89f0a097514a03f069bb2acd3c0b65cacbe0206bb7c87c2f8ef9836065f2b902 WatchSource:0}: Error finding container 89f0a097514a03f069bb2acd3c0b65cacbe0206bb7c87c2f8ef9836065f2b902: Status 404 returned error can't find the container with id 89f0a097514a03f069bb2acd3c0b65cacbe0206bb7c87c2f8ef9836065f2b902
Jul 23 18:02:23.309176 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:23.309010    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece6ba8f_2935_454c_bfcb_2290b03d6753.slice/crio-91003562c474bd5ee2635640b61188c52396aa755e9a185797ee5d433964523b WatchSource:0}: Error finding container 91003562c474bd5ee2635640b61188c52396aa755e9a185797ee5d433964523b: Status 404 returned error can't find the container with id 91003562c474bd5ee2635640b61188c52396aa755e9a185797ee5d433964523b
Jul 23 18:02:23.310730 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:23.310299    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f57d07_1d4c_4e29_b373_899b525352d6.slice/crio-40f55ddcfb0c84cf12cf42828d6e83db5e828d1cfb05db2fb2fa0ede0db74c1d WatchSource:0}: Error finding container 40f55ddcfb0c84cf12cf42828d6e83db5e828d1cfb05db2fb2fa0ede0db74c1d: Status 404 returned error can't find the container with id 40f55ddcfb0c84cf12cf42828d6e83db5e828d1cfb05db2fb2fa0ede0db74c1d
Jul 23 18:02:23.311536 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:23.311511    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b45cd9a_3dc9_4efa_bc1a_d5a5fc1ad935.slice/crio-5bbb9d5d6de30d59ebaf889654f93fc8ac64de8f2506256fae8280a977061219 WatchSource:0}: Error finding container 5bbb9d5d6de30d59ebaf889654f93fc8ac64de8f2506256fae8280a977061219: Status 404 returned error can't find the container with id 5bbb9d5d6de30d59ebaf889654f93fc8ac64de8f2506256fae8280a977061219
Jul 23 18:02:23.745140 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:23.744616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:23.745306 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:23.744742    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:23.745306 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:23.745255    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:23.745306 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:23.745269    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs podName:d29fc578-05c8-4db0-afe8-feb466c314a2 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:25.7452253 +0000 UTC m=+6.108069144 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs") pod "network-metrics-daemon-5ff94" (UID: "d29fc578-05c8-4db0-afe8-feb466c314a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:23.745508 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:23.745335    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret podName:dcf14205-3f73-4b29-ad41-afb60d083309 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:25.74531187 +0000 UTC m=+6.108155717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret") pod "global-pull-secret-syncer-sn5fv" (UID: "dcf14205-3f73-4b29-ad41-afb60d083309") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:23.745508 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:23.745162    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:23.847964 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:23.847330    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbxr\" (UniqueName: \"kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr\") pod \"network-check-target-fj4n8\" (UID: \"d37b367f-0f47-417e-87f2-254b46903ee1\") " pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:23.847964 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:23.847518    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:23.847964 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:23.847540    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:23.847964 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:23.847555    2574 projected.go:196] Error preparing data for projected volume kube-api-access-8rbxr for pod openshift-network-diagnostics/network-check-target-fj4n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:23.847964 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:23.847618    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr podName:d37b367f-0f47-417e-87f2-254b46903ee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:25.847597311 +0000 UTC m=+6.210441143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rbxr" (UniqueName: "kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr") pod "network-check-target-fj4n8" (UID: "d37b367f-0f47-417e-87f2-254b46903ee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:24.133254 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.133122    2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:57:22 +0000 UTC" deadline="2028-02-26 01:09:16.360773501 +0000 UTC"
Jul 23 18:02:24.133254 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.133186    2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13975h6m52.22759224s"
Jul 23 18:02:24.181571 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.181543    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:24.181748 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:24.181671    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:24.182200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.182177    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:24.182328 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:24.182291    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:24.182406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.182384    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:24.182496 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:24.182473    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:24.194124 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.194008    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9" event={"ID":"edee6867-7351-4508-9888-a8898e804e21","Type":"ContainerStarted","Data":"89b72b514eabf39643bf066a723731d070d2d025ff4e54a3891248a976bfb5f9"}
Jul 23 18:02:24.195696 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.195669    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mw7kn" event={"ID":"77049378-df66-46f7-8e93-f0a08ea49b3e","Type":"ContainerStarted","Data":"4586f1bf4f1ed1ec9b4aa37716a83f35141b0a66acad064c2a969e881fe0b861"}
Jul 23 18:02:24.202204 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.202178    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl" event={"ID":"3a2f2c12-a5c6-4e62-8340-722b2db7df28","Type":"ContainerStarted","Data":"62f383529f2082680f7f8fbfe98484d4deb0c4072d156ca4721ba1cd0d4aac3e"}
Jul 23 18:02:24.214764 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.214738    2574 generic.go:356] "Generic (PLEG): container finished" podID="a4ebf2cd5ac2a098d3f1139aeb6ec6b6" containerID="b73e4b0914ddb2ed0dab41c5b4b91e259e63a83c3e69512901a1d3ac29181f2d" exitCode=0
Jul 23 18:02:24.215011 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.214987    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal" event={"ID":"a4ebf2cd5ac2a098d3f1139aeb6ec6b6","Type":"ContainerDied","Data":"b73e4b0914ddb2ed0dab41c5b4b91e259e63a83c3e69512901a1d3ac29181f2d"}
Jul 23 18:02:24.228469 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.228446    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cd8w6" event={"ID":"ece6ba8f-2935-454c-bfcb-2290b03d6753","Type":"ContainerStarted","Data":"91003562c474bd5ee2635640b61188c52396aa755e9a185797ee5d433964523b"}
Jul 23 18:02:24.231675 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.231650    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nv8r5" event={"ID":"058016a0-d6ab-4363-bc0a-f804b1b5716f","Type":"ContainerStarted","Data":"a2efee6ce87c6b659e07146157ea1a5c85cc9bc69a893af80627e0df9bdf5866"}
Jul 23 18:02:24.233562 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.233539    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5pfgf" event={"ID":"f758607d-d388-4071-b4a8-6ab868b3ab4a","Type":"ContainerStarted","Data":"576a1255ba1dc5e91e03e158e97c214f4f5c2941bdc3227b842b858131ceb3cb"}
Jul 23 18:02:24.245101 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.245073    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal" event={"ID":"51be1d98ce7a93e78550fbe38c9a87e2","Type":"ContainerStarted","Data":"8f0be3d30bdae7037f7857a3bcd2c0a5e194f277dfb17abb58e1a4e26f4e77c2"}
Jul 23 18:02:24.252746 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.252720    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6sx4r" event={"ID":"1069ec60-3215-429b-b2e0-517286fe5600","Type":"ContainerStarted","Data":"89f0a097514a03f069bb2acd3c0b65cacbe0206bb7c87c2f8ef9836065f2b902"}
Jul 23 18:02:24.258120 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.258071    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cm7th" event={"ID":"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935","Type":"ContainerStarted","Data":"5bbb9d5d6de30d59ebaf889654f93fc8ac64de8f2506256fae8280a977061219"}
Jul 23 18:02:24.260920 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.260895    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tb7x4" event={"ID":"74f57d07-1d4c-4e29-b373-899b525352d6","Type":"ContainerStarted","Data":"40f55ddcfb0c84cf12cf42828d6e83db5e828d1cfb05db2fb2fa0ede0db74c1d"}
Jul 23 18:02:24.263610 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:24.263555    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-41.ec2.internal" podStartSLOduration=2.263537263 podStartE2EDuration="2.263537263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:24.262584614 +0000 UTC m=+4.625428482" watchObservedRunningTime="2026-07-23 18:02:24.263537263 +0000 UTC m=+4.626381117"
Jul 23 18:02:25.275527 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:25.275059    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal" event={"ID":"a4ebf2cd5ac2a098d3f1139aeb6ec6b6","Type":"ContainerStarted","Data":"cab0c5e5a286c77904883f9d6a46574d09a722dee43db5494d39b279a5333982"}
Jul 23 18:02:25.293922 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:25.293864    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-41.ec2.internal" podStartSLOduration=3.293844415 podStartE2EDuration="3.293844415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:25.293438185 +0000 UTC m=+5.656282040" watchObservedRunningTime="2026-07-23 18:02:25.293844415 +0000 UTC m=+5.656688269"
Jul 23 18:02:25.765820 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:25.764887    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:25.765820 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:25.764958    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:25.765820 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:25.765114    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:25.765820 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:25.765174    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret podName:dcf14205-3f73-4b29-ad41-afb60d083309 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:29.765155257 +0000 UTC m=+10.127999101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret") pod "global-pull-secret-syncer-sn5fv" (UID: "dcf14205-3f73-4b29-ad41-afb60d083309") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:25.765820 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:25.765625    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:25.765820 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:25.765687    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs podName:d29fc578-05c8-4db0-afe8-feb466c314a2 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:29.765669467 +0000 UTC m=+10.128513300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs") pod "network-metrics-daemon-5ff94" (UID: "d29fc578-05c8-4db0-afe8-feb466c314a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:25.865688 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:25.865651    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbxr\" (UniqueName: \"kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr\") pod \"network-check-target-fj4n8\" (UID: \"d37b367f-0f47-417e-87f2-254b46903ee1\") " pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:25.865881 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:25.865868    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:25.865950 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:25.865890    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:25.865950 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:25.865903    2574 projected.go:196] Error preparing data for projected volume kube-api-access-8rbxr for pod openshift-network-diagnostics/network-check-target-fj4n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:25.866058 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:25.865968    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr podName:d37b367f-0f47-417e-87f2-254b46903ee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:29.865949334 +0000 UTC m=+10.228793166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rbxr" (UniqueName: "kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr") pod "network-check-target-fj4n8" (UID: "d37b367f-0f47-417e-87f2-254b46903ee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:26.180063 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:26.179977    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:26.180226 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:26.180119    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:26.180226 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:26.179977    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:26.180226 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:26.180205    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:26.180509 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:26.180330    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:26.180509 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:26.180428    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:28.180445 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:28.179915    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:28.180445 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:28.179950    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:28.180445 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:28.180058    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:28.180445 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:28.180093    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:28.180445 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:28.180194    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:28.180445 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:28.180304    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:29.800902 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:29.800863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:29.801424 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:29.800934    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:29.801424 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:29.801045    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:29.801424 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:29.801045    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:29.801424 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:29.801106    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret podName:dcf14205-3f73-4b29-ad41-afb60d083309 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:37.801087289 +0000 UTC m=+18.163931116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret") pod "global-pull-secret-syncer-sn5fv" (UID: "dcf14205-3f73-4b29-ad41-afb60d083309") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:29.801424 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:29.801124    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs podName:d29fc578-05c8-4db0-afe8-feb466c314a2 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:37.801114549 +0000 UTC m=+18.163958383 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs") pod "network-metrics-daemon-5ff94" (UID: "d29fc578-05c8-4db0-afe8-feb466c314a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:29.901464 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:29.901424    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbxr\" (UniqueName: \"kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr\") pod \"network-check-target-fj4n8\" (UID: \"d37b367f-0f47-417e-87f2-254b46903ee1\") " pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:29.901656 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:29.901604    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:29.901656 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:29.901632    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:29.901656 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:29.901657    2574 projected.go:196] Error preparing data for projected volume kube-api-access-8rbxr for pod openshift-network-diagnostics/network-check-target-fj4n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:29.901814 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:29.901726    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr podName:d37b367f-0f47-417e-87f2-254b46903ee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:37.901704919 +0000 UTC m=+18.264548794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rbxr" (UniqueName: "kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr") pod "network-check-target-fj4n8" (UID: "d37b367f-0f47-417e-87f2-254b46903ee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:30.180408 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:30.179863    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:30.180408 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:30.179980    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:30.180408 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:30.180256    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:30.180408 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:30.180375    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:30.181446 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:30.181425    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:30.181563 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:30.181526    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:32.180663 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:32.180332    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:32.180663 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:32.180477    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:32.180663 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:32.180618    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:32.181321 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:32.180620    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:32.181321 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:32.180792    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:32.181321 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:32.180862    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:34.179906 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:34.179871    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:34.180328 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:34.179995    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:34.180328 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:34.179871    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:34.180328 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:34.180099    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:34.180328 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:34.179871    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:34.180328 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:34.180169    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:36.179714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:36.179674    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:36.180155 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:36.179675    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:36.180155 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:36.179810    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:36.180155 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:36.179809    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:36.180155 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:36.179917    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:36.180155 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:36.180002    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:37.302397 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:37.302355    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mw7kn" event={"ID":"77049378-df66-46f7-8e93-f0a08ea49b3e","Type":"ContainerStarted","Data":"f11f7f15bf2895080638b2ba0690f8284478ada4a4aca2b97a5bd86393a5ca2e"}
Jul 23 18:02:37.303911 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:37.303873    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl" event={"ID":"3a2f2c12-a5c6-4e62-8340-722b2db7df28","Type":"ContainerStarted","Data":"ccb8150c04eb0e3509aac13af7704662b57173233770457f4a18db96c8becd13"}
Jul 23 18:02:37.320535 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:37.320495    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mw7kn" podStartSLOduration=4.100057969 podStartE2EDuration="17.32048101s" totalImagesPullingTime="13.220423041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:37.319927647 +0000 UTC m=+17.682771527" watchObservedRunningTime="2026-07-23 18:02:37.32048101 +0000 UTC m=+17.683324860"
Jul 23 18:02:37.631162 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:37.631121    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:37.631856 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:37.631834    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:37.866241 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:37.866192    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:37.866397 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:37.866284    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:37.866397 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:37.866334    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:37.866397 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:37.866365    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:37.866397 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:37.866395    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs podName:d29fc578-05c8-4db0-afe8-feb466c314a2 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:53.866378579 +0000 UTC m=+34.229222409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs") pod "network-metrics-daemon-5ff94" (UID: "d29fc578-05c8-4db0-afe8-feb466c314a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:37.866543 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:37.866414    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret podName:dcf14205-3f73-4b29-ad41-afb60d083309 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:53.866405072 +0000 UTC m=+34.229248901 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret") pod "global-pull-secret-syncer-sn5fv" (UID: "dcf14205-3f73-4b29-ad41-afb60d083309") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:37.967344 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:37.967107    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbxr\" (UniqueName: \"kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr\") pod \"network-check-target-fj4n8\" (UID: \"d37b367f-0f47-417e-87f2-254b46903ee1\") " pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:37.967344 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:37.967307    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:37.967344 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:37.967328    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:37.967344 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:37.967337    2574 projected.go:196] Error preparing data for projected volume kube-api-access-8rbxr for pod openshift-network-diagnostics/network-check-target-fj4n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:37.967622 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:37.967387    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr podName:d37b367f-0f47-417e-87f2-254b46903ee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:53.967373028 +0000 UTC m=+34.330216855 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rbxr" (UniqueName: "kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr") pod "network-check-target-fj4n8" (UID: "d37b367f-0f47-417e-87f2-254b46903ee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:38.179337 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:38.179303    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:38.179337 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:38.179324    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:38.179545 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:38.179308    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:38.179545 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:38.179403    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:38.179545 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:38.179512    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:38.179706 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:38.179624    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:39.307409 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:39.307381    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 18:02:40.182543 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:40.182519    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:40.182543 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:40.182547    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:40.182769 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:40.182528    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:40.182769 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:40.182624    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:40.182769 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:40.182713    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:40.182910 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:40.182771    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:42.179312 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.179218    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:42.179955 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.179218    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:42.179955 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:42.179370    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:42.179955 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:42.179460    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:42.179955 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.179238    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:42.179955 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:42.179577    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:42.314002 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.313974    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nv8r5" event={"ID":"058016a0-d6ab-4363-bc0a-f804b1b5716f","Type":"ContainerStarted","Data":"58f60b8014b5d7dab1dd8a325a7c1b8e05c6b1f0a60568c372806689f76cf448"}
Jul 23 18:02:42.315377 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.315357    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5pfgf" event={"ID":"f758607d-d388-4071-b4a8-6ab868b3ab4a","Type":"ContainerStarted","Data":"eaa16a97b116b3d62c5b7fb02b9708773ebe62e7cab5d5472d4d26235312cdfc"}
Jul 23 18:02:42.316722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.316701    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6sx4r" event={"ID":"1069ec60-3215-429b-b2e0-517286fe5600","Type":"ContainerStarted","Data":"d0eb98cb1bd4950af1b4ec48b65b3b1dc885e68023a2e9807ab4f7b9665ff634"}
Jul 23 18:02:42.317994 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.317971    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cm7th" event={"ID":"3b45cd9a-3dc9-4efa-bc1a-d5a5fc1ad935","Type":"ContainerStarted","Data":"2bc481f3b7718622533542051a3228bf2944f7d539bc0dc84b3809dd3c5e45c4"}
Jul 23 18:02:42.319357 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.319337    2574 generic.go:356] "Generic (PLEG): container finished" podID="74f57d07-1d4c-4e29-b373-899b525352d6" containerID="fc2a974092b6acc2ce77e96dfdb6811c13c6dad20558e2e2b1e5cd37a8e3c26d" exitCode=0
Jul 23 18:02:42.319434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.319401    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tb7x4" event={"ID":"74f57d07-1d4c-4e29-b373-899b525352d6","Type":"ContainerDied","Data":"fc2a974092b6acc2ce77e96dfdb6811c13c6dad20558e2e2b1e5cd37a8e3c26d"}
Jul 23 18:02:42.320701 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.320680    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9" event={"ID":"edee6867-7351-4508-9888-a8898e804e21","Type":"ContainerStarted","Data":"e073bbf16a9a633559d8800328d4fdf996203266026bf9f9901e30cf52f014b7"}
Jul 23 18:02:42.330566 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.330530    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nv8r5" podStartSLOduration=9.111140231 podStartE2EDuration="22.33051883s" totalImagesPullingTime="13.219378599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:42.330115525 +0000 UTC m=+22.692959374" watchObservedRunningTime="2026-07-23 18:02:42.33051883 +0000 UTC m=+22.693362678"
Jul 23 18:02:42.345888 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.345853    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6sx4r" podStartSLOduration=9.130412247 podStartE2EDuration="22.345842666s" totalImagesPullingTime="13.215430419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:42.345598178 +0000 UTC m=+22.708442027" watchObservedRunningTime="2026-07-23 18:02:42.345842666 +0000 UTC m=+22.708686515"
Jul 23 18:02:42.362598 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.362562    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cm7th" podStartSLOduration=4.025400589 podStartE2EDuration="22.362550909s" totalImagesPullingTime="18.33715032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:42.362093166 +0000 UTC m=+22.724937017" watchObservedRunningTime="2026-07-23 18:02:42.362550909 +0000 UTC m=+22.725394757"
Jul 23 18:02:42.406484 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.406320    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5pfgf" podStartSLOduration=9.186741607 podStartE2EDuration="22.406305722s" totalImagesPullingTime="13.219564115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:42.405727774 +0000 UTC m=+22.768571624" watchObservedRunningTime="2026-07-23 18:02:42.406305722 +0000 UTC m=+22.769149568"
Jul 23 18:02:42.625201 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:42.625173    2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 18:02:43.085604 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.085444    2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T18:02:42.625194418Z","UUID":"d43eded1-b031-4d5a-86d3-52ef6b7d3ac0","Handler":null,"Name":"","Endpoint":""}
Jul 23 18:02:43.087086 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.087049    2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 18:02:43.087242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.087094    2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 18:02:43.326614 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.326578    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9" event={"ID":"edee6867-7351-4508-9888-a8898e804e21","Type":"ContainerStarted","Data":"aaa658619ce8171d9d1cb7b41ff892e59ff7f839aa98e8b5818da8303ae44a04"}
Jul 23 18:02:43.327288 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.326707    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9" event={"ID":"edee6867-7351-4508-9888-a8898e804e21","Type":"ContainerStarted","Data":"357847dd6be33949dec44c577d3b3d8924383e6454c41be752bba19976b270b1"}
Jul 23 18:02:43.327288 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.326759    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9" event={"ID":"edee6867-7351-4508-9888-a8898e804e21","Type":"ContainerStarted","Data":"e57044ab5c63e399756c130ea537911b93c2c79d628dd6db28e7e2d5f054ed58"}
Jul 23 18:02:43.327288 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.326806    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9" event={"ID":"edee6867-7351-4508-9888-a8898e804e21","Type":"ContainerStarted","Data":"15ae21fa103cf483341da8c2b72468e4832c90682da4b9bf77595f1b2b157a2e"}
Jul 23 18:02:43.327288 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.326857    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9" event={"ID":"edee6867-7351-4508-9888-a8898e804e21","Type":"ContainerStarted","Data":"bd95e8cd10d65c522fc18a7a8f8a18e541ac90a7c46ed582faa03ec72eee0315"}
Jul 23 18:02:43.328597 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.328566    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl" event={"ID":"3a2f2c12-a5c6-4e62-8340-722b2db7df28","Type":"ContainerStarted","Data":"90aabb07468aaa0f46fe35d95ca00c39847cc80d9125e7e4d5f837a77024fe4e"}
Jul 23 18:02:43.330061 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.330034    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cd8w6" event={"ID":"ece6ba8f-2935-454c-bfcb-2290b03d6753","Type":"ContainerStarted","Data":"10d8ed07b9484141b03e15696d2f047695575d52ea8e7bb2b9e8db1019aad259"}
Jul 23 18:02:43.346580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:43.346531    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cd8w6" podStartSLOduration=10.127244423 podStartE2EDuration="23.346514044s" totalImagesPullingTime="13.219269621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:43.345609982 +0000 UTC m=+23.708453831" watchObservedRunningTime="2026-07-23 18:02:43.346514044 +0000 UTC m=+23.709357895"
Jul 23 18:02:44.182783 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:44.182756    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:44.183025 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:44.182872    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:44.183025 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:44.182878    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:44.183025 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:44.182982    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:44.183025 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:44.183013    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:44.183269 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:44.183096    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:45.337730 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:45.337640    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl" event={"ID":"3a2f2c12-a5c6-4e62-8340-722b2db7df28","Type":"ContainerStarted","Data":"38651e7cc8dfebebdcea2ffb910f54c3cc322952608378c1c821592ed4d78d8d"}
Jul 23 18:02:45.358847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:45.358798    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pmxfl" podStartSLOduration=4.751708467 podStartE2EDuration="25.358778558s" totalImagesPullingTime="20.607070091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:45.358669107 +0000 UTC m=+25.721512957" watchObservedRunningTime="2026-07-23 18:02:45.358778558 +0000 UTC m=+25.721622445"
Jul 23 18:02:46.182480 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:46.182441    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:46.182690 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:46.182563    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:46.182763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:46.182749    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:46.182855 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:46.182752    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:46.182913 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:46.182895    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:46.182980 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:46.182959    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:47.343727 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:47.343695    2574 generic.go:356] "Generic (PLEG): container finished" podID="74f57d07-1d4c-4e29-b373-899b525352d6" containerID="d43efc03d2a46f7404a0f3edf6d786ac0410eddea8a010de7ac55f5a3e8b111a" exitCode=0
Jul 23 18:02:47.344437 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:47.343774    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tb7x4" event={"ID":"74f57d07-1d4c-4e29-b373-899b525352d6","Type":"ContainerDied","Data":"d43efc03d2a46f7404a0f3edf6d786ac0410eddea8a010de7ac55f5a3e8b111a"}
Jul 23 18:02:47.347129 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:47.347073    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9" event={"ID":"edee6867-7351-4508-9888-a8898e804e21","Type":"ContainerStarted","Data":"ca76a6ce14638d064b17759d775961e853e47956d912305b22ee472044b4f9a4"}
Jul 23 18:02:48.180070 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:48.179994    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:48.180195 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:48.179997    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:48.180195 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:48.180122    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:48.180299 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:48.180200    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:48.180299 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:48.180275    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:48.180361 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:48.180325    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:48.351301 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:48.351268    2574 generic.go:356] "Generic (PLEG): container finished" podID="74f57d07-1d4c-4e29-b373-899b525352d6" containerID="abf6e9fdb8630494264e57f632568013eb298290ca4e13d6a310b8fd1fdb5e66" exitCode=0
Jul 23 18:02:48.351830 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:48.351320    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tb7x4" event={"ID":"74f57d07-1d4c-4e29-b373-899b525352d6","Type":"ContainerDied","Data":"abf6e9fdb8630494264e57f632568013eb298290ca4e13d6a310b8fd1fdb5e66"}
Jul 23 18:02:49.356126 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.355961    2574 generic.go:356] "Generic (PLEG): container finished" podID="74f57d07-1d4c-4e29-b373-899b525352d6" containerID="76990af23a3a2b59e9c634d9ddbaf6d5c6f57cd2755365c6fca32264944ead39" exitCode=0
Jul 23 18:02:49.356540 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.356046    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tb7x4" event={"ID":"74f57d07-1d4c-4e29-b373-899b525352d6","Type":"ContainerDied","Data":"76990af23a3a2b59e9c634d9ddbaf6d5c6f57cd2755365c6fca32264944ead39"}
Jul 23 18:02:49.359926 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.359902    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9" event={"ID":"edee6867-7351-4508-9888-a8898e804e21","Type":"ContainerStarted","Data":"889e1c7c015cbc1b982ae62d62f1d96260d6ab614a9786796e2c9c66e98a88d6"}
Jul 23 18:02:49.360266 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.360247    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:49.360359 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.360312    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:49.360412 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.360361    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:49.375086 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.375068    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:49.375168 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.375158    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:02:49.409850 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.409814    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9" podStartSLOduration=10.535832858 podStartE2EDuration="29.409801539s" totalImagesPullingTime="18.873968681s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:49.408273569 +0000 UTC m=+29.771117438" watchObservedRunningTime="2026-07-23 18:02:49.409801539 +0000 UTC m=+29.772645388"
Jul 23 18:02:49.816539 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.816504    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:49.816708 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.816698    2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 18:02:49.818257 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:49.817948    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mw7kn"
Jul 23 18:02:50.180714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:50.180597    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:50.180714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:50.180669    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:50.180916 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:50.180748    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:50.180916 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:50.180764    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:50.180916 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:50.180811    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:50.180916 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:50.180891    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:50.603953 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:50.603919    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sn5fv"]
Jul 23 18:02:50.604413 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:50.604039    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:50.604413 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:50.604148    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:50.607596 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:50.607288    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fj4n8"]
Jul 23 18:02:50.607596 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:50.607389    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:50.607596 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:50.607496    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:50.607855 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:50.607817    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5ff94"]
Jul 23 18:02:50.607936 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:50.607910    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:50.608063 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:50.608018    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:52.179370 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:52.179338    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:52.179862 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:52.179338    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:52.179862 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:52.179469    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:52.179862 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:52.179338    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:52.179862 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:52.179531    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:52.179862 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:52.179617    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:53.889381 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:53.889352    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:53.889708 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:53.889397    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:53.889708 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:53.889509    2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:53.889708 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:53.889557    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret podName:dcf14205-3f73-4b29-ad41-afb60d083309 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:25.889544349 +0000 UTC m=+66.252388176 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret") pod "global-pull-secret-syncer-sn5fv" (UID: "dcf14205-3f73-4b29-ad41-afb60d083309") : object "kube-system"/"original-pull-secret" not registered
Jul 23 18:02:53.889708 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:53.889509    2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:53.889708 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:53.889630    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs podName:d29fc578-05c8-4db0-afe8-feb466c314a2 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:25.889616003 +0000 UTC m=+66.252459834 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs") pod "network-metrics-daemon-5ff94" (UID: "d29fc578-05c8-4db0-afe8-feb466c314a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 18:02:53.989725 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:53.989636    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbxr\" (UniqueName: \"kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr\") pod \"network-check-target-fj4n8\" (UID: \"d37b367f-0f47-417e-87f2-254b46903ee1\") " pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:53.989775 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:53.989754    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 18:02:53.989775 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:53.989772    2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 18:02:53.989848 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:53.989782    2574 projected.go:196] Error preparing data for projected volume kube-api-access-8rbxr for pod openshift-network-diagnostics/network-check-target-fj4n8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:53.989848 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:53.989826    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr podName:d37b367f-0f47-417e-87f2-254b46903ee1 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:25.989814365 +0000 UTC m=+66.352658192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8rbxr" (UniqueName: "kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr") pod "network-check-target-fj4n8" (UID: "d37b367f-0f47-417e-87f2-254b46903ee1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 18:02:54.179905 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.179880    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:54.180009 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.179903    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:54.180009 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:54.179999    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5ff94" podUID="d29fc578-05c8-4db0-afe8-feb466c314a2"
Jul 23 18:02:54.180106 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.180041    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:54.180137 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:54.180110    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fj4n8" podUID="d37b367f-0f47-417e-87f2-254b46903ee1"
Jul 23 18:02:54.180209 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:54.180192    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sn5fv" podUID="dcf14205-3f73-4b29-ad41-afb60d083309"
Jul 23 18:02:54.375873 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.375838    2574 generic.go:356] "Generic (PLEG): container finished" podID="74f57d07-1d4c-4e29-b373-899b525352d6" containerID="4d772e5f3a2dd3aa0162535f43a0a49bc38c085cc6a4a3a20fe136c02c959a36" exitCode=0
Jul 23 18:02:54.376020 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.375911    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tb7x4" event={"ID":"74f57d07-1d4c-4e29-b373-899b525352d6","Type":"ContainerDied","Data":"4d772e5f3a2dd3aa0162535f43a0a49bc38c085cc6a4a3a20fe136c02c959a36"}
Jul 23 18:02:54.513695 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.513670    2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-41.ec2.internal" event="NodeReady"
Jul 23 18:02:54.513805 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.513792    2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 18:02:54.560127 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.560100    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hvjbc"]
Jul 23 18:02:54.568898 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.568879    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m262c"]
Jul 23 18:02:54.569033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.569015    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.572089 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.572067    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vl72\""
Jul 23 18:02:54.572205 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.572078    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 18:02:54.572336 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.572315    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 18:02:54.581512 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.581491    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvjbc"]
Jul 23 18:02:54.581619 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.581524    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m262c"]
Jul 23 18:02:54.581619 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.581603    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m262c"
Jul 23 18:02:54.583848 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.583834    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 18:02:54.584126 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.584114    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 18:02:54.584172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.584119    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w9bh8\""
Jul 23 18:02:54.584172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.584118    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 18:02:54.693742 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.693656    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbf30af5-97fb-434d-87a6-efc654c519db-tmp-dir\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.693742 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.693739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.693933 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.693759    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8873245d-123f-4e44-bad1-94a7abe556c7-cert\") pod \"ingress-canary-m262c\" (UID: \"8873245d-123f-4e44-bad1-94a7abe556c7\") " pod="openshift-ingress-canary/ingress-canary-m262c"
Jul 23 18:02:54.693933 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.693778    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j6b8\" (UniqueName: \"kubernetes.io/projected/fbf30af5-97fb-434d-87a6-efc654c519db-kube-api-access-4j6b8\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.693933 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.693801    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6s9q\" (UniqueName: \"kubernetes.io/projected/8873245d-123f-4e44-bad1-94a7abe556c7-kube-api-access-t6s9q\") pod \"ingress-canary-m262c\" (UID: \"8873245d-123f-4e44-bad1-94a7abe556c7\") " pod="openshift-ingress-canary/ingress-canary-m262c"
Jul 23 18:02:54.693933 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.693827    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fbf30af5-97fb-434d-87a6-efc654c519db-config-volume\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.795013 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.794979    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbf30af5-97fb-434d-87a6-efc654c519db-tmp-dir\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.795144 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.795080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.795144 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.795099    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8873245d-123f-4e44-bad1-94a7abe556c7-cert\") pod \"ingress-canary-m262c\" (UID: \"8873245d-123f-4e44-bad1-94a7abe556c7\") " pod="openshift-ingress-canary/ingress-canary-m262c"
Jul 23 18:02:54.795144 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.795114    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j6b8\" (UniqueName: \"kubernetes.io/projected/fbf30af5-97fb-434d-87a6-efc654c519db-kube-api-access-4j6b8\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.795144 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.795137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6s9q\" (UniqueName: \"kubernetes.io/projected/8873245d-123f-4e44-bad1-94a7abe556c7-kube-api-access-t6s9q\") pod \"ingress-canary-m262c\" (UID: \"8873245d-123f-4e44-bad1-94a7abe556c7\") " pod="openshift-ingress-canary/ingress-canary-m262c"
Jul 23 18:02:54.795387 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.795163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fbf30af5-97fb-434d-87a6-efc654c519db-config-volume\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.795387 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:54.795289    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:02:54.795387 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:54.795373    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls podName:fbf30af5-97fb-434d-87a6-efc654c519db nodeName:}" failed. No retries permitted until 2026-07-23 18:02:55.295353871 +0000 UTC m=+35.658197698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls") pod "dns-default-hvjbc" (UID: "fbf30af5-97fb-434d-87a6-efc654c519db") : secret "dns-default-metrics-tls" not found
Jul 23 18:02:54.795497 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.795392    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fbf30af5-97fb-434d-87a6-efc654c519db-tmp-dir\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.795763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.795748    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fbf30af5-97fb-434d-87a6-efc654c519db-config-volume\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.799121 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.799102    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8873245d-123f-4e44-bad1-94a7abe556c7-cert\") pod \"ingress-canary-m262c\" (UID: \"8873245d-123f-4e44-bad1-94a7abe556c7\") " pod="openshift-ingress-canary/ingress-canary-m262c"
Jul 23 18:02:54.804870 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.804847    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j6b8\" (UniqueName: \"kubernetes.io/projected/fbf30af5-97fb-434d-87a6-efc654c519db-kube-api-access-4j6b8\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:54.804977 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.804962    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6s9q\" (UniqueName: \"kubernetes.io/projected/8873245d-123f-4e44-bad1-94a7abe556c7-kube-api-access-t6s9q\") pod \"ingress-canary-m262c\" (UID: \"8873245d-123f-4e44-bad1-94a7abe556c7\") " pod="openshift-ingress-canary/ingress-canary-m262c"
Jul 23 18:02:54.897937 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:54.897900    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m262c"
Jul 23 18:02:55.073291 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:55.073044    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m262c"]
Jul 23 18:02:55.077052 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:55.077027    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8873245d_123f_4e44_bad1_94a7abe556c7.slice/crio-59431f2036177b81caee245e1380f2a6cb5ed8ce01edec031da8ce1ec3652160 WatchSource:0}: Error finding container 59431f2036177b81caee245e1380f2a6cb5ed8ce01edec031da8ce1ec3652160: Status 404 returned error can't find the container with id 59431f2036177b81caee245e1380f2a6cb5ed8ce01edec031da8ce1ec3652160
Jul 23 18:02:55.298706 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:55.298619    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:55.298965 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:55.298756    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:02:55.298965 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:55.298828    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls podName:fbf30af5-97fb-434d-87a6-efc654c519db nodeName:}" failed. No retries permitted until 2026-07-23 18:02:56.298806948 +0000 UTC m=+36.661650782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls") pod "dns-default-hvjbc" (UID: "fbf30af5-97fb-434d-87a6-efc654c519db") : secret "dns-default-metrics-tls" not found
Jul 23 18:02:55.379512 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:55.379475    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m262c" event={"ID":"8873245d-123f-4e44-bad1-94a7abe556c7","Type":"ContainerStarted","Data":"59431f2036177b81caee245e1380f2a6cb5ed8ce01edec031da8ce1ec3652160"}
Jul 23 18:02:55.382310 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:55.382286    2574 generic.go:356] "Generic (PLEG): container finished" podID="74f57d07-1d4c-4e29-b373-899b525352d6" containerID="d5ecdc99aae5f15e0daf8824f79f5a3f312733a9f26239479527101a55bad6f7" exitCode=0
Jul 23 18:02:55.382310 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:55.382321    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tb7x4" event={"ID":"74f57d07-1d4c-4e29-b373-899b525352d6","Type":"ContainerDied","Data":"d5ecdc99aae5f15e0daf8824f79f5a3f312733a9f26239479527101a55bad6f7"}
Jul 23 18:02:55.490148 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:55.490118    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:55.578998 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:55.578970    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:55.643932 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:55.643897    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:56.179819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.179782    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:02:56.180266 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.179788    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:02:56.180266 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.179794    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:02:56.182988 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.182972    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 18:02:56.183102 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.182997    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 18:02:56.183102 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.183019    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 18:02:56.183997 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.183981    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdbpx\""
Jul 23 18:02:56.184084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.184044    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 18:02:56.184297 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.184282    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdqhz\""
Jul 23 18:02:56.273039 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.273013    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q"]
Jul 23 18:02:56.305263 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.305219    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:56.305415 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:56.305353    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:02:56.305415 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:56.305412    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls podName:fbf30af5-97fb-434d-87a6-efc654c519db nodeName:}" failed. No retries permitted until 2026-07-23 18:02:58.305398697 +0000 UTC m=+38.668242528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls") pod "dns-default-hvjbc" (UID: "fbf30af5-97fb-434d-87a6-efc654c519db") : secret "dns-default-metrics-tls" not found
Jul 23 18:02:56.318486 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.318462    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2znmx"]
Jul 23 18:02:56.318625 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.318580    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q"
Jul 23 18:02:56.321401 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.321381    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 23 18:02:56.321539 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.321411    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:02:56.321918 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.321899    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-gmsmh\""
Jul 23 18:02:56.333849 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.333829    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn"]
Jul 23 18:02:56.333946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.333835    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.337088 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.337066    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:02:56.337306 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.337293    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hrzpw\""
Jul 23 18:02:56.337582 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.337561    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 18:02:56.337669 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.337561    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 18:02:56.338059 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.338045    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 18:02:56.343258 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.343217    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 18:02:56.347275 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.347259    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q"]
Jul 23 18:02:56.347331 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.347292    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2znmx"]
Jul 23 18:02:56.347331 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.347301    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn"
Jul 23 18:02:56.347331 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.347313    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn"]
Jul 23 18:02:56.349635 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.349619    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-p98rv\""
Jul 23 18:02:56.389429 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.389397    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tb7x4" event={"ID":"74f57d07-1d4c-4e29-b373-899b525352d6","Type":"ContainerStarted","Data":"92fa63ac2434b323cf3a6d94b45740b1c36bec23b51cdcd31122fb63ec8ec29a"}
Jul 23 18:02:56.405763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.405737    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvxrw\" (UniqueName: \"kubernetes.io/projected/48355f6a-e1f3-4762-8345-abe22c731896-kube-api-access-pvxrw\") pod \"volume-data-source-validator-78cf4c6f6-lgl6q\" (UID: \"48355f6a-e1f3-4762-8345-abe22c731896\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q"
Jul 23 18:02:56.425197 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.425143    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tb7x4" podStartSLOduration=13.272419496 podStartE2EDuration="36.425111711s" totalImagesPullingTime="23.152692215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:56.424466967 +0000 UTC m=+36.787310844" watchObservedRunningTime="2026-07-23 18:02:56.425111711 +0000 UTC m=+36.787955560"
Jul 23 18:02:56.480532 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.480421    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5876c858bd-2m8gm"]
Jul 23 18:02:56.490780 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.490754    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.493524 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.493502    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 18:02:56.494386 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.494367    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 18:02:56.495018 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.494997    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 18:02:56.495135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.495091    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7nzjz\""
Jul 23 18:02:56.503772 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.503745    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5876c858bd-2m8gm"]
Jul 23 18:02:56.503894 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.503875    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 18:02:56.506045 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.506023    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf4ps\" (UniqueName: \"kubernetes.io/projected/48aa5870-cde6-4e62-bfe1-23850da12a63-kube-api-access-tf4ps\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.506139 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.506054    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48aa5870-cde6-4e62-bfe1-23850da12a63-trusted-ca\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.506203 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.506135    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48aa5870-cde6-4e62-bfe1-23850da12a63-config\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.506203 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.506177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48aa5870-cde6-4e62-bfe1-23850da12a63-serving-cert\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.506326 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.506296    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mx57\" (UniqueName: \"kubernetes.io/projected/224568db-d5af-427e-a3af-4bbbcce46a86-kube-api-access-2mx57\") pod \"network-check-source-7bc5b6bf85-wq2tn\" (UID: \"224568db-d5af-427e-a3af-4bbbcce46a86\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn"
Jul 23 18:02:56.506375 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.506334    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvxrw\" (UniqueName: \"kubernetes.io/projected/48355f6a-e1f3-4762-8345-abe22c731896-kube-api-access-pvxrw\") pod \"volume-data-source-validator-78cf4c6f6-lgl6q\" (UID: \"48355f6a-e1f3-4762-8345-abe22c731896\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q"
Jul 23 18:02:56.523206 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.523179    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvxrw\" (UniqueName: \"kubernetes.io/projected/48355f6a-e1f3-4762-8345-abe22c731896-kube-api-access-pvxrw\") pod \"volume-data-source-validator-78cf4c6f6-lgl6q\" (UID: \"48355f6a-e1f3-4762-8345-abe22c731896\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q"
Jul 23 18:02:56.576383 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.576349    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:56.578918 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.578897    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6689ddd698-sx5jk"]
Jul 23 18:02:56.606751 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.606708    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mx57\" (UniqueName: \"kubernetes.io/projected/224568db-d5af-427e-a3af-4bbbcce46a86-kube-api-access-2mx57\") pod \"network-check-source-7bc5b6bf85-wq2tn\" (UID: \"224568db-d5af-427e-a3af-4bbbcce46a86\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn"
Jul 23 18:02:56.606892 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.606791    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-trusted-ca\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.606892 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.606842    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf4ps\" (UniqueName: \"kubernetes.io/projected/48aa5870-cde6-4e62-bfe1-23850da12a63-kube-api-access-tf4ps\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.606892 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.606867    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-certificates\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.607052 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.606931    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48aa5870-cde6-4e62-bfe1-23850da12a63-trusted-ca\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.607052 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.606987    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-image-registry-private-configuration\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.607052 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.607017    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-installation-pull-secrets\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.607052 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.607043    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-bound-sa-token\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.607244 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.607074    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48aa5870-cde6-4e62-bfe1-23850da12a63-config\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.607244 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.607105    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48aa5870-cde6-4e62-bfe1-23850da12a63-serving-cert\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.607244 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.607128    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.607244 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.607150    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-ca-trust-extracted\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.607244 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.607177    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j88kd\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-kube-api-access-j88kd\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.607664 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.607630    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6689ddd698-sx5jk"]
Jul 23 18:02:56.607768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.607744    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.608107 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.608085    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/48aa5870-cde6-4e62-bfe1-23850da12a63-trusted-ca\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.608261 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.608120    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/48aa5870-cde6-4e62-bfe1-23850da12a63-config\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.610464 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.610441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48aa5870-cde6-4e62-bfe1-23850da12a63-serving-cert\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.612309 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.612287    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 18:02:56.612674 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.612660    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hwp7x\""
Jul 23 18:02:56.612743 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.612705    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 18:02:56.612801 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.612766    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 18:02:56.613072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.613050    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 18:02:56.613200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.613181    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 18:02:56.613540 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.613523    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 18:02:56.622518 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.622500    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mx57\" (UniqueName: \"kubernetes.io/projected/224568db-d5af-427e-a3af-4bbbcce46a86-kube-api-access-2mx57\") pod \"network-check-source-7bc5b6bf85-wq2tn\" (UID: \"224568db-d5af-427e-a3af-4bbbcce46a86\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn"
Jul 23 18:02:56.622891 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.622875    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf4ps\" (UniqueName: \"kubernetes.io/projected/48aa5870-cde6-4e62-bfe1-23850da12a63-kube-api-access-tf4ps\") pod \"console-operator-565b7b569d-2znmx\" (UID: \"48aa5870-cde6-4e62-bfe1-23850da12a63\") " pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.626893 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.626875    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q"
Jul 23 18:02:56.642689 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.642667    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:02:56.655857 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.655837    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn"
Jul 23 18:02:56.664945 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.664757    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.709712    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-certificates\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.709794    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-image-registry-private-configuration\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.709830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-installation-pull-secrets\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.709856    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-bound-sa-token\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.709885    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-stats-auth\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.709911    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.709950    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.709973    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-ca-trust-extracted\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.710003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j88kd\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-kube-api-access-j88kd\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.710026    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-default-certificate\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.710078    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqpd9\" (UniqueName: \"kubernetes.io/projected/fca00c58-fee4-4d2b-910c-979d9b13dd72-kube-api-access-cqpd9\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.710137    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-trusted-ca\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.710162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.710607    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-certificates\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.710705    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-ca-trust-extracted\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:56.710728    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:02:56.711087 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:56.710743    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876c858bd-2m8gm: secret "image-registry-tls" not found
Jul 23 18:02:56.712917 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:56.710793    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls podName:0a27d685-d5e9-465a-a5a2-63b4d6a8a25e nodeName:}" failed. No retries permitted until 2026-07-23 18:02:57.210774977 +0000 UTC m=+37.573618808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls") pod "image-registry-5876c858bd-2m8gm" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e") : secret "image-registry-tls" not found
Jul 23 18:02:56.712917 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.711796    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-trusted-ca\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.713739 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.713697    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-image-registry-private-configuration\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.715550 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.715510    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-installation-pull-secrets\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.727751 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.727726    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j88kd\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-kube-api-access-j88kd\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.728766 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.728742    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-bound-sa-token\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:56.741342 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.741184    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:56.808305 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.808215    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q"]
Jul 23 18:02:56.811410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.811003    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqpd9\" (UniqueName: \"kubernetes.io/projected/fca00c58-fee4-4d2b-910c-979d9b13dd72-kube-api-access-cqpd9\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.811410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.811070    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.811410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.811142    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-stats-auth\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.811410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.811172    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.811410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.811274    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-default-certificate\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.811410 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:56.811347    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:57.311324689 +0000 UTC m=+37.674168538 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : configmap references non-existent config key: service-ca.crt
Jul 23 18:02:56.811702 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:56.811562    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:02:56.811702 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:56.811631    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:57.311613521 +0000 UTC m=+37.674457369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : secret "router-metrics-certs-default" not found
Jul 23 18:02:56.814196 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.814167    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-stats-auth\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.814459 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.814440    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-default-certificate\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.815377 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.815351    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:56.821613 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.821589    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqpd9\" (UniqueName: \"kubernetes.io/projected/fca00c58-fee4-4d2b-910c-979d9b13dd72-kube-api-access-cqpd9\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:56.823563 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:56.823535    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48355f6a_e1f3_4762_8345_abe22c731896.slice/crio-1f22ffe99eaae04deca2f3c33745d8d0379fd85c9a670897790faf5cd191877b WatchSource:0}: Error finding container 1f22ffe99eaae04deca2f3c33745d8d0379fd85c9a670897790faf5cd191877b: Status 404 returned error can't find the container with id 1f22ffe99eaae04deca2f3c33745d8d0379fd85c9a670897790faf5cd191877b
Jul 23 18:02:56.830299 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.830278    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2znmx"]
Jul 23 18:02:56.833289 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:56.833262    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48aa5870_cde6_4e62_bfe1_23850da12a63.slice/crio-a7d00580a4fdfd4705a7a75b346e6a9a3c4a5a149bdbda0ef1457b3d81aa9c0a WatchSource:0}: Error finding container a7d00580a4fdfd4705a7a75b346e6a9a3c4a5a149bdbda0ef1457b3d81aa9c0a: Status 404 returned error can't find the container with id a7d00580a4fdfd4705a7a75b346e6a9a3c4a5a149bdbda0ef1457b3d81aa9c0a
Jul 23 18:02:56.850958 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:56.850933    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn"]
Jul 23 18:02:56.853326 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:02:56.853300    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod224568db_d5af_427e_a3af_4bbbcce46a86.slice/crio-143a71aa4016f63120c545d72e5ca6c3946d8a6e74430885d422996819f9f585 WatchSource:0}: Error finding container 143a71aa4016f63120c545d72e5ca6c3946d8a6e74430885d422996819f9f585: Status 404 returned error can't find the container with id 143a71aa4016f63120c545d72e5ca6c3946d8a6e74430885d422996819f9f585
Jul 23 18:02:57.214748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:57.214711    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:57.215301 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:57.214842    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:02:57.215301 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:57.214856    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876c858bd-2m8gm: secret "image-registry-tls" not found
Jul 23 18:02:57.215301 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:57.214917    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls podName:0a27d685-d5e9-465a-a5a2-63b4d6a8a25e nodeName:}" failed. No retries permitted until 2026-07-23 18:02:58.214902757 +0000 UTC m=+38.577746598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls") pod "image-registry-5876c858bd-2m8gm" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e") : secret "image-registry-tls" not found
Jul 23 18:02:57.315624 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:57.315585    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:57.315794 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:57.315680    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:57.315842 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:57.315796    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:58.315768491 +0000 UTC m=+38.678612334 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : configmap references non-existent config key: service-ca.crt
Jul 23 18:02:57.315842 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:57.315818    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:02:57.315915 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:57.315868    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:58.315853851 +0000 UTC m=+38.678697692 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : secret "router-metrics-certs-default" not found
Jul 23 18:02:57.393766 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:57.393727    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2znmx" event={"ID":"48aa5870-cde6-4e62-bfe1-23850da12a63","Type":"ContainerStarted","Data":"a7d00580a4fdfd4705a7a75b346e6a9a3c4a5a149bdbda0ef1457b3d81aa9c0a"}
Jul 23 18:02:57.395340 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:57.395283    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn" event={"ID":"224568db-d5af-427e-a3af-4bbbcce46a86","Type":"ContainerStarted","Data":"143a71aa4016f63120c545d72e5ca6c3946d8a6e74430885d422996819f9f585"}
Jul 23 18:02:57.398135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:57.398110    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q" event={"ID":"48355f6a-e1f3-4762-8345-abe22c731896","Type":"ContainerStarted","Data":"1f22ffe99eaae04deca2f3c33745d8d0379fd85c9a670897790faf5cd191877b"}
Jul 23 18:02:58.225479 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:58.225397    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:02:58.226010 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:58.225619    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:02:58.226010 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:58.225635    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876c858bd-2m8gm: secret "image-registry-tls" not found
Jul 23 18:02:58.226010 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:58.225691    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls podName:0a27d685-d5e9-465a-a5a2-63b4d6a8a25e nodeName:}" failed. No retries permitted until 2026-07-23 18:03:00.225671753 +0000 UTC m=+40.588515583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls") pod "image-registry-5876c858bd-2m8gm" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e") : secret "image-registry-tls" not found
Jul 23 18:02:58.326449 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:58.326189    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:58.326449 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:58.326282    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:02:58.326449 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:58.326315    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:02:58.326449 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:58.326360    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:00.326341402 +0000 UTC m=+40.689185252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : configmap references non-existent config key: service-ca.crt
Jul 23 18:02:58.326449 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:58.326409    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:02:58.326449 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:58.326446    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:00.326435518 +0000 UTC m=+40.689279352 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : secret "router-metrics-certs-default" not found
Jul 23 18:02:58.326889 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:58.326500    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:02:58.326889 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:02:58.326528    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls podName:fbf30af5-97fb-434d-87a6-efc654c519db nodeName:}" failed. No retries permitted until 2026-07-23 18:03:02.326518867 +0000 UTC m=+42.689362708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls") pod "dns-default-hvjbc" (UID: "fbf30af5-97fb-434d-87a6-efc654c519db") : secret "dns-default-metrics-tls" not found
Jul 23 18:02:59.846770 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:59.846715    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:02:59.904325 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:02:59.904292    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:00.245180 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:00.245140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:03:00.245346 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:00.245308    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:03:00.245346 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:00.245329    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876c858bd-2m8gm: secret "image-registry-tls" not found
Jul 23 18:03:00.245412 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:00.245387    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls podName:0a27d685-d5e9-465a-a5a2-63b4d6a8a25e nodeName:}" failed. No retries permitted until 2026-07-23 18:03:04.245369886 +0000 UTC m=+44.608213716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls") pod "image-registry-5876c858bd-2m8gm" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e") : secret "image-registry-tls" not found
Jul 23 18:03:00.346190 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:00.346157    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:00.346349 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:00.346250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:00.346349 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:00.346306    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:04.346288666 +0000 UTC m=+44.709132496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : configmap references non-existent config key: service-ca.crt
Jul 23 18:03:00.346429 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:00.346354    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:03:00.346429 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:00.346398    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:04.3463859 +0000 UTC m=+44.709229728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : secret "router-metrics-certs-default" not found
Jul 23 18:03:01.100419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.100384    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:01.207685 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.207652    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:01.410072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.410025    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q" event={"ID":"48355f6a-e1f3-4762-8345-abe22c731896","Type":"ContainerStarted","Data":"2c5025d6e016053304aff6925ed1ba48115152f10ece9a3c7fec96845be1d93d"}
Jul 23 18:03:01.411543 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.411518    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m262c" event={"ID":"8873245d-123f-4e44-bad1-94a7abe556c7","Type":"ContainerStarted","Data":"178d0d2c0ee49ec7537311cfa4f7258e41a78c20e990a248d957402ed38f76c6"}
Jul 23 18:03:01.413269 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.413252    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/0.log"
Jul 23 18:03:01.413347 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.413283    2574 generic.go:356] "Generic (PLEG): container finished" podID="48aa5870-cde6-4e62-bfe1-23850da12a63" containerID="b14ca1594bee4dfccb8e927782b434db999ab60213cd5a413d3f02a756c46f10" exitCode=255
Jul 23 18:03:01.413401 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.413359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2znmx" event={"ID":"48aa5870-cde6-4e62-bfe1-23850da12a63","Type":"ContainerDied","Data":"b14ca1594bee4dfccb8e927782b434db999ab60213cd5a413d3f02a756c46f10"}
Jul 23 18:03:01.413587 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.413570    2574 scope.go:117] "RemoveContainer" containerID="b14ca1594bee4dfccb8e927782b434db999ab60213cd5a413d3f02a756c46f10"
Jul 23 18:03:01.414945 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.414914    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn" event={"ID":"224568db-d5af-427e-a3af-4bbbcce46a86","Type":"ContainerStarted","Data":"a06598a51dbe176b8261cf87dc825d0d59ade6af02f5a8059b8e826662902971"}
Jul 23 18:03:01.455718 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.455671    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-lgl6q" podStartSLOduration=1.131147093 podStartE2EDuration="5.455650792s" totalImagesPullingTime="4.324503699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:01.435180517 +0000 UTC m=+41.798024367" watchObservedRunningTime="2026-07-23 18:03:01.455650792 +0000 UTC m=+41.818494637"
Jul 23 18:03:01.456156 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.456130    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m262c" podStartSLOduration=1.411191724 podStartE2EDuration="7.456119887s" totalImagesPullingTime="6.044928163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:01.455795911 +0000 UTC m=+41.818639742" watchObservedRunningTime="2026-07-23 18:03:01.456119887 +0000 UTC m=+41.818963737"
Jul 23 18:03:01.501074 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.501004    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-wq2tn" podStartSLOduration=1.20827478 podStartE2EDuration="5.500984647s" totalImagesPullingTime="4.292709867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:01.499445109 +0000 UTC m=+41.862288977" watchObservedRunningTime="2026-07-23 18:03:01.500984647 +0000 UTC m=+41.863828501"
Jul 23 18:03:01.600460 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.600429    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:01.679892 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.679863    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:01.777651 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.777560    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:01.836963 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:01.836920    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:02.195959 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.195923    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z6cm5"]
Jul 23 18:03:02.212044 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.212019    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z6cm5"]
Jul 23 18:03:02.212193 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.212150    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.216575 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.216554    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 18:03:02.217512 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.217490    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 18:03:02.217617 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.217527    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtwn7\""
Jul 23 18:03:02.217617 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.217532    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 18:03:02.217732 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.217708    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 18:03:02.238435 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.238403    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:02.262951 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.262920    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.262951 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.262954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.263131 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.262974    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-crio-socket\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.263131 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.262999    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-data-volume\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.263131 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.263064    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqztr\" (UniqueName: \"kubernetes.io/projected/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-api-access-hqztr\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.364170 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.364138    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.364170 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.364172    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.364419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.364195    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-crio-socket\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.364419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.364212    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-data-volume\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.364419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.364263    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqztr\" (UniqueName: \"kubernetes.io/projected/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-api-access-hqztr\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.364419 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.364326    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:02.364419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.364383    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-crio-socket\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.364419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.364337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:03:02.364419 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.364408    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls podName:dc1d277c-2d3d-4cf5-8d38-6c9299f96081 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:02.864384938 +0000 UTC m=+43.227228774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z6cm5" (UID: "dc1d277c-2d3d-4cf5-8d38-6c9299f96081") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:02.364745 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.364454    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:03:02.364745 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.364501    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls podName:fbf30af5-97fb-434d-87a6-efc654c519db nodeName:}" failed. No retries permitted until 2026-07-23 18:03:10.364486749 +0000 UTC m=+50.727330603 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls") pod "dns-default-hvjbc" (UID: "fbf30af5-97fb-434d-87a6-efc654c519db") : secret "dns-default-metrics-tls" not found
Jul 23 18:03:02.364745 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.364507    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:03:02.364894 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.364701    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-data-volume\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.364996 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.364801    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm podName:dc1d277c-2d3d-4cf5-8d38-6c9299f96081 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:02.864537375 +0000 UTC m=+43.227381202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z6cm5" (UID: "dc1d277c-2d3d-4cf5-8d38-6c9299f96081") : configmap "kube-rbac-proxy" not found
Jul 23 18:03:02.377015 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.376989    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqztr\" (UniqueName: \"kubernetes.io/projected/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-api-access-hqztr\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.388932 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.388909    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:02.418528 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.418506    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:03:02.418900 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.418885    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/0.log"
Jul 23 18:03:02.418963 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.418917    2574 generic.go:356] "Generic (PLEG): container finished" podID="48aa5870-cde6-4e62-bfe1-23850da12a63" containerID="3b20ed2cfdbefdf37be2cfdbd71c6f824f8fc5efe996f2fb9f91f3c05386971c" exitCode=255
Jul 23 18:03:02.419008 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.418993    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2znmx" event={"ID":"48aa5870-cde6-4e62-bfe1-23850da12a63","Type":"ContainerDied","Data":"3b20ed2cfdbefdf37be2cfdbd71c6f824f8fc5efe996f2fb9f91f3c05386971c"}
Jul 23 18:03:02.419083 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.419071    2574 scope.go:117] "RemoveContainer" containerID="b14ca1594bee4dfccb8e927782b434db999ab60213cd5a413d3f02a756c46f10"
Jul 23 18:03:02.419187 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.419172    2574 scope.go:117] "RemoveContainer" containerID="3b20ed2cfdbefdf37be2cfdbd71c6f824f8fc5efe996f2fb9f91f3c05386971c"
Jul 23 18:03:02.419448 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.419415    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2znmx_openshift-console-operator(48aa5870-cde6-4e62-bfe1-23850da12a63)\"" pod="openshift-console-operator/console-operator-565b7b569d-2znmx" podUID="48aa5870-cde6-4e62-bfe1-23850da12a63"
Jul 23 18:03:02.476200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.476135    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:02.555200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.555170    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:02.867897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.867863    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.867897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:02.867900    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:02.868087 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.867966    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:03:02.868087 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.867999    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:02.868087 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.868024    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm podName:dc1d277c-2d3d-4cf5-8d38-6c9299f96081 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:03.868010746 +0000 UTC m=+44.230854574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z6cm5" (UID: "dc1d277c-2d3d-4cf5-8d38-6c9299f96081") : configmap "kube-rbac-proxy" not found
Jul 23 18:03:02.868087 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:02.868046    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls podName:dc1d277c-2d3d-4cf5-8d38-6c9299f96081 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:03.868032234 +0000 UTC m=+44.230876062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z6cm5" (UID: "dc1d277c-2d3d-4cf5-8d38-6c9299f96081") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:03.113378 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:03.113339    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:03.172977 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:03.172901    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:03.422870 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:03.422844    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:03:03.423335 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:03.423154    2574 scope.go:117] "RemoveContainer" containerID="3b20ed2cfdbefdf37be2cfdbd71c6f824f8fc5efe996f2fb9f91f3c05386971c"
Jul 23 18:03:03.423405 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:03.423330    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2znmx_openshift-console-operator(48aa5870-cde6-4e62-bfe1-23850da12a63)\"" pod="openshift-console-operator/console-operator-565b7b569d-2znmx" podUID="48aa5870-cde6-4e62-bfe1-23850da12a63"
Jul 23 18:03:03.678564 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:03.678461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:03.787112 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:03.787081    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:03.876347 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:03.876318    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:03.876501 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:03.876356    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:03.876501 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:03.876442    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:03:03.876501 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:03.876463    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:03.876501 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:03.876489    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm podName:dc1d277c-2d3d-4cf5-8d38-6c9299f96081 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:05.876474707 +0000 UTC m=+46.239318537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z6cm5" (UID: "dc1d277c-2d3d-4cf5-8d38-6c9299f96081") : configmap "kube-rbac-proxy" not found
Jul 23 18:03:03.876648 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:03.876507    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls podName:dc1d277c-2d3d-4cf5-8d38-6c9299f96081 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:05.876495273 +0000 UTC m=+46.239339100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z6cm5" (UID: "dc1d277c-2d3d-4cf5-8d38-6c9299f96081") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:04.279910 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:04.279873    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:03:04.280072 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:04.279984    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:03:04.280072 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:04.279994    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876c858bd-2m8gm: secret "image-registry-tls" not found
Jul 23 18:03:04.280072 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:04.280040    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls podName:0a27d685-d5e9-465a-a5a2-63b4d6a8a25e nodeName:}" failed. No retries permitted until 2026-07-23 18:03:12.28002735 +0000 UTC m=+52.642871180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls") pod "image-registry-5876c858bd-2m8gm" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e") : secret "image-registry-tls" not found
Jul 23 18:03:04.381030 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:04.380998    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:04.381169 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:04.381043    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:04.381169 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:04.381137    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:03:04.381169 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:04.381155    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:12.381143124 +0000 UTC m=+52.743986951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : configmap references non-existent config key: service-ca.crt
Jul 23 18:03:04.381290 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:04.381183    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:12.381170448 +0000 UTC m=+52.744014276 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : secret "router-metrics-certs-default" not found
Jul 23 18:03:04.383946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:04.383929    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nv8r5_058016a0-d6ab-4363-bc0a-f804b1b5716f/dns-node-resolver/0.log"
Jul 23 18:03:04.921572 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:04.921521    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:04.982929 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:04.982905    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6sx4r_1069ec60-3215-429b-b2e0-517286fe5600/node-ca/0.log"
Jul 23 18:03:05.021381 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:05.021354    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:05.614979 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:05.614950    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:05.783581 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:05.783551    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m262c_8873245d-123f-4e44-bad1-94a7abe556c7/serve-healthcheck-canary/0.log"
Jul 23 18:03:05.894167 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:05.894100    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:05.894167 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:05.894130    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:05.894371 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:05.894211    2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 18:03:05.894371 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:05.894278    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:05.894371 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:05.894280    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm podName:dc1d277c-2d3d-4cf5-8d38-6c9299f96081 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:09.894267602 +0000 UTC m=+50.257111432 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z6cm5" (UID: "dc1d277c-2d3d-4cf5-8d38-6c9299f96081") : configmap "kube-rbac-proxy" not found
Jul 23 18:03:05.894371 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:05.894344    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls podName:dc1d277c-2d3d-4cf5-8d38-6c9299f96081 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:09.894326619 +0000 UTC m=+50.257170450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z6cm5" (UID: "dc1d277c-2d3d-4cf5-8d38-6c9299f96081") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:06.257215 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:06.257128    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:06.643467 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:06.643439    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:03:06.643599 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:06.643492    2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:03:06.643792 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:06.643780    2574 scope.go:117] "RemoveContainer" containerID="3b20ed2cfdbefdf37be2cfdbd71c6f824f8fc5efe996f2fb9f91f3c05386971c"
Jul 23 18:03:06.643927 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:06.643911    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2znmx_openshift-console-operator(48aa5870-cde6-4e62-bfe1-23850da12a63)\"" pod="openshift-console-operator/console-operator-565b7b569d-2znmx" podUID="48aa5870-cde6-4e62-bfe1-23850da12a63"
Jul 23 18:03:07.854216 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:07.854185    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:08.534279 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:08.534247    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:09.923492 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:09.923455    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:09.923492 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:09.923498    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:09.924026 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:09.923604    2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:09.924026 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:09.923686    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls podName:dc1d277c-2d3d-4cf5-8d38-6c9299f96081 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:17.923667239 +0000 UTC m=+58.286511074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z6cm5" (UID: "dc1d277c-2d3d-4cf5-8d38-6c9299f96081") : secret "insights-runtime-extractor-tls" not found
Jul 23 18:03:09.924290 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:09.924268    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:10.429052 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:10.429018    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:03:10.429197 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:10.429167    2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 18:03:10.429257 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:10.429242    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls podName:fbf30af5-97fb-434d-87a6-efc654c519db nodeName:}" failed. No retries permitted until 2026-07-23 18:03:26.4292079 +0000 UTC m=+66.792051728 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls") pod "dns-default-hvjbc" (UID: "fbf30af5-97fb-434d-87a6-efc654c519db") : secret "dns-default-metrics-tls" not found
Jul 23 18:03:10.465845 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:10.465810    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:10.566094 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:10.566067    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:11.250271 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:11.250211    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:11.343150 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:11.343121    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:12.246156 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:12.246124    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:12.343496 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:12.343456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls\") pod \"image-registry-5876c858bd-2m8gm\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") " pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:03:12.343875 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:12.343604    2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 18:03:12.343875 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:12.343621    2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5876c858bd-2m8gm: secret "image-registry-tls" not found
Jul 23 18:03:12.343875 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:12.343690    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls podName:0a27d685-d5e9-465a-a5a2-63b4d6a8a25e nodeName:}" failed. No retries permitted until 2026-07-23 18:03:28.343673337 +0000 UTC m=+68.706517164 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls") pod "image-registry-5876c858bd-2m8gm" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e") : secret "image-registry-tls" not found
Jul 23 18:03:12.390118 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:12.390080    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:12.443973 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:12.443943    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:12.444125 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:12.443992    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:12.444125 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:12.444094    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:28.444078218 +0000 UTC m=+68.806922044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : configmap references non-existent config key: service-ca.crt
Jul 23 18:03:12.444270 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:12.444141    2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 18:03:12.444270 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:12.444201    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs podName:fca00c58-fee4-4d2b-910c-979d9b13dd72 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:28.444188595 +0000 UTC m=+68.807032422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs") pod "router-default-6689ddd698-sx5jk" (UID: "fca00c58-fee4-4d2b-910c-979d9b13dd72") : secret "router-metrics-certs-default" not found
Jul 23 18:03:12.581655 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:12.581621    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:12.783813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:12.783777    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:12.994166 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:12.994087    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:13.180104 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:13.180060    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:13.894520 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:13.894489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:14.183387 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:14.183299    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:14.239028 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:14.238994    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:14.389073 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:14.389042    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:14.802869 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:14.802842    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:14.903615 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:14.903576    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:15.004277 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:15.004249    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:15.209167 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:15.209126    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:16.184669 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:16.184637    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:16.383498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:16.383464    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:16.581122 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:16.581087    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:16.691517 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:16.691483    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:16.986531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:16.986455    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:17.580582 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:17.580552    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:17.984325 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:17.984219    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:17.987312 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:17.987294    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:17.989464 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:17.989447    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dc1d277c-2d3d-4cf5-8d38-6c9299f96081-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z6cm5\" (UID: \"dc1d277c-2d3d-4cf5-8d38-6c9299f96081\") " pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:18.122024 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:18.121998    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z6cm5"
Jul 23 18:03:18.248128 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:18.246645    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z6cm5"]
Jul 23 18:03:18.250159 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:18.250136    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1d277c_2d3d_4cf5_8d38_6c9299f96081.slice/crio-3f22d35b474046cb709a2692bcd898c8ca2ac34137f06794ff22ba1bfabea6c6 WatchSource:0}: Error finding container 3f22d35b474046cb709a2692bcd898c8ca2ac34137f06794ff22ba1bfabea6c6: Status 404 returned error can't find the container with id 3f22d35b474046cb709a2692bcd898c8ca2ac34137f06794ff22ba1bfabea6c6
Jul 23 18:03:18.385360 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:18.385332    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:18.457587 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:18.457559    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z6cm5" event={"ID":"dc1d277c-2d3d-4cf5-8d38-6c9299f96081","Type":"ContainerStarted","Data":"3f22d35b474046cb709a2692bcd898c8ca2ac34137f06794ff22ba1bfabea6c6"}
Jul 23 18:03:18.782702 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:18.782668    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:18.981500 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:18.981467    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:19.586660 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:19.586555    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:20.184572 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:20.184536    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:20.387194 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:20.387160    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:20.817187 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:20.817146    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:20.995276 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:20.995208    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:21.190713 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:21.190622    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:21.377766 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:21.377737    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lz6x9"
Jul 23 18:03:22.179440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:22.179409    2574 scope.go:117] "RemoveContainer" containerID="3b20ed2cfdbefdf37be2cfdbd71c6f824f8fc5efe996f2fb9f91f3c05386971c"
Jul 23 18:03:24.477091 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:24.477002    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z6cm5" event={"ID":"dc1d277c-2d3d-4cf5-8d38-6c9299f96081","Type":"ContainerStarted","Data":"d4777875e14b3211013df3002b30fae14d43fa69b236947417e3f33d3b1c9f7e"}
Jul 23 18:03:24.479155 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:24.479125    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:03:24.479316 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:24.479199    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2znmx" event={"ID":"48aa5870-cde6-4e62-bfe1-23850da12a63","Type":"ContainerStarted","Data":"3c67fab7e5188eebc5d8b7038f1cf896b1cd18e93d2152deb0299cda46d55151"}
Jul 23 18:03:24.480162 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:24.480140    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:03:24.485213 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:24.485188    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-2znmx"
Jul 23 18:03:24.505410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:24.505352    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-2znmx" podStartSLOduration=24.192699586 podStartE2EDuration="28.505326652s" totalImagesPullingTime="4.312627066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:24.504183453 +0000 UTC m=+64.867027304" watchObservedRunningTime="2026-07-23 18:03:24.505326652 +0000 UTC m=+64.868170501"
Jul 23 18:03:24.523532 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:24.523500    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:24.634036 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:24.634005    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:25.021551 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.021515    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:25.205106 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.205074    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:25.288088 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.288007    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5876c858bd-2m8gm"]
Jul 23 18:03:25.288372 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:25.288335    2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5876c858bd-2m8gm" podUID="0a27d685-d5e9-465a-a5a2-63b4d6a8a25e"
Jul 23 18:03:25.293584 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.293529    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:25.327484 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.327457    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-646d7cc4cd-8p4xd"]
Jul 23 18:03:25.329582 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.329546    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.353959 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.353934    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-646d7cc4cd-8p4xd"]
Jul 23 18:03:25.386540 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.386509    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:25.449566 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.449537    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-ca-trust-extracted\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.449566 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.449568    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-bound-sa-token\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.449781 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.449606    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-registry-tls\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.449781 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.449629    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-installation-pull-secrets\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.449781 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.449666    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-image-registry-private-configuration\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.449781 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.449721    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-trusted-ca\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.449781 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.449743    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg66v\" (UniqueName: \"kubernetes.io/projected/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-kube-api-access-vg66v\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.450019 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.449858    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-registry-certificates\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.483014 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.482985    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:03:25.484292 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.484263    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:25.488759 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.488739    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:03:25.550486 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.550398    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-installation-pull-secrets\") pod \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") "
Jul 23 18:03:25.550486 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.550441    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-ca-trust-extracted\") pod \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") "
Jul 23 18:03:25.550486 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.550479    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-image-registry-private-configuration\") pod \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") "
Jul 23 18:03:25.550739 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.550517    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j88kd\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-kube-api-access-j88kd\") pod \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") "
Jul 23 18:03:25.550739 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.550549    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-bound-sa-token\") pod \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") "
Jul 23 18:03:25.550739 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.550583    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-certificates\") pod \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") "
Jul 23 18:03:25.550739 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.550625    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-trusted-ca\") pod \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\" (UID: \"0a27d685-d5e9-465a-a5a2-63b4d6a8a25e\") "
Jul 23 18:03:25.550918 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.550805    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-ca-trust-extracted\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.550918 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.550833    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-bound-sa-token\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.551039 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.551015    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-registry-tls\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.551096 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.551056    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-installation-pull-secrets\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.551140 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.551091    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-image-registry-private-configuration\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.551191 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.551153    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-trusted-ca\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.551269 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.551246    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:03:25.551580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.551520    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-ca-trust-extracted\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.551963 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.551936    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:03:25.552592 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.552252    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg66v\" (UniqueName: \"kubernetes.io/projected/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-kube-api-access-vg66v\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.552592 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.552362    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-trusted-ca\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.552592 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.552377    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-registry-certificates\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.552592 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.552447    2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-ca-trust-extracted\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:03:25.552592 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.552466    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-trusted-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:03:25.552896 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.552871    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:03:25.553669 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.553643    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-registry-certificates\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.554508 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.554462    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-image-registry-private-configuration\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.554790 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.554728    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-installation-pull-secrets\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.554884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.554814    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:03:25.555518 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.555479    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:03:25.555612 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.555570    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:03:25.555862 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.555833    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-kube-api-access-j88kd" (OuterVolumeSpecName: "kube-api-access-j88kd") pod "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e" (UID: "0a27d685-d5e9-465a-a5a2-63b4d6a8a25e"). InnerVolumeSpecName "kube-api-access-j88kd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:03:25.557260 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.557242    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-registry-tls\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.572675 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.572649    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-bound-sa-token\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.574074 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.574028    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg66v\" (UniqueName: \"kubernetes.io/projected/5fc44631-5885-4007-bf2c-c54aa4c7bbcb-kube-api-access-vg66v\") pod \"image-registry-646d7cc4cd-8p4xd\" (UID: \"5fc44631-5885-4007-bf2c-c54aa4c7bbcb\") " pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.592336 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.592275    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:25.644127 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.644101    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7nzjz\""
Jul 23 18:03:25.652033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.652004    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:25.653378 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.653356    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j88kd\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-kube-api-access-j88kd\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:03:25.653378 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.653378    2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-bound-sa-token\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:03:25.653378 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.653391    2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-certificates\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:03:25.653595 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.653407    2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-installation-pull-secrets\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:03:25.653595 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.653419    2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-image-registry-private-configuration\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:03:25.692046 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.692014    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:25.800689 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.800614    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-646d7cc4cd-8p4xd"]
Jul 23 18:03:25.804145 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:25.804120    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc44631_5885_4007_bf2c_c54aa4c7bbcb.slice/crio-cb1d868a6718564198ad474db81f59d14b4f1cefe5b8d6640828f1886534725c WatchSource:0}: Error finding container cb1d868a6718564198ad474db81f59d14b4f1cefe5b8d6640828f1886534725c: Status 404 returned error can't find the container with id cb1d868a6718564198ad474db81f59d14b4f1cefe5b8d6640828f1886534725c
Jul 23 18:03:25.955370 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.955337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:03:25.955551 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.955388    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:03:25.958536 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.958504    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 18:03:25.958658 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.958530    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 18:03:25.968311 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.968283    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcf14205-3f73-4b29-ad41-afb60d083309-original-pull-secret\") pod \"global-pull-secret-syncer-sn5fv\" (UID: \"dcf14205-3f73-4b29-ad41-afb60d083309\") " pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:03:25.968440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:25.968397    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d29fc578-05c8-4db0-afe8-feb466c314a2-metrics-certs\") pod \"network-metrics-daemon-5ff94\" (UID: \"d29fc578-05c8-4db0-afe8-feb466c314a2\") " pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:03:26.012477 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.012441    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:26.056779 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.056702    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbxr\" (UniqueName: \"kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr\") pod \"network-check-target-fj4n8\" (UID: \"d37b367f-0f47-417e-87f2-254b46903ee1\") " pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:03:26.059484 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.059454    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rbxr\" (UniqueName: \"kubernetes.io/projected/d37b367f-0f47-417e-87f2-254b46903ee1-kube-api-access-8rbxr\") pod \"network-check-target-fj4n8\" (UID: \"d37b367f-0f47-417e-87f2-254b46903ee1\") " pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:03:26.191625 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.191595    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdbpx\""
Jul 23 18:03:26.194830 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.194805    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sn5fv"
Jul 23 18:03:26.198918 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.198860    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:03:26.201396 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.201347    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdqhz\""
Jul 23 18:03:26.209821 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.209800    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5ff94"
Jul 23 18:03:26.215078 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.215054    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:26.428846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.428783    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:26.459710 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.459678    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:03:26.462203 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.462179    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf30af5-97fb-434d-87a6-efc654c519db-metrics-tls\") pod \"dns-default-hvjbc\" (UID: \"fbf30af5-97fb-434d-87a6-efc654c519db\") " pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:03:26.488619 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.488583    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd" event={"ID":"5fc44631-5885-4007-bf2c-c54aa4c7bbcb","Type":"ContainerStarted","Data":"b9780de27b62fac8c77602ae48acc9321ff871fdc4918544e580303b50a30339"}
Jul 23 18:03:26.489043 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.488647    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd" event={"ID":"5fc44631-5885-4007-bf2c-c54aa4c7bbcb","Type":"ContainerStarted","Data":"cb1d868a6718564198ad474db81f59d14b4f1cefe5b8d6640828f1886534725c"}
Jul 23 18:03:26.489043 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.488597    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5876c858bd-2m8gm"
Jul 23 18:03:26.489043 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.488698    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:26.511463 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.511401    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd" podStartSLOduration=1.511379672 podStartE2EDuration="1.511379672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:26.510089422 +0000 UTC m=+66.872933290" watchObservedRunningTime="2026-07-23 18:03:26.511379672 +0000 UTC m=+66.874223522"
Jul 23 18:03:26.522337 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.522303    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:26.544283 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.544256    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5876c858bd-2m8gm"]
Jul 23 18:03:26.547933 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.547906    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5876c858bd-2m8gm"]
Jul 23 18:03:26.580807 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.580770    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:26.661663 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.661634    2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e-registry-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:03:26.696084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.696015    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vl72\""
Jul 23 18:03:26.704179 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.704153    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:03:26.966701 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:26.966620    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:28.053165 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.053137    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvjbc"]
Jul 23 18:03:28.056475 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:28.056440    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf30af5_97fb_434d_87a6_efc654c519db.slice/crio-8e4fa2c2f2d855a07ef9e3271694f4c55d3eb637d1873a281742509061a48484 WatchSource:0}: Error finding container 8e4fa2c2f2d855a07ef9e3271694f4c55d3eb637d1873a281742509061a48484: Status 404 returned error can't find the container with id 8e4fa2c2f2d855a07ef9e3271694f4c55d3eb637d1873a281742509061a48484
Jul 23 18:03:28.071670 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.071643    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sn5fv"]
Jul 23 18:03:28.074750 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:28.074721    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf14205_3f73_4b29_ad41_afb60d083309.slice/crio-9e6c176380ec22595985bfa5797cd3a93c74bc31194a0a612cfac39f59984dda WatchSource:0}: Error finding container 9e6c176380ec22595985bfa5797cd3a93c74bc31194a0a612cfac39f59984dda: Status 404 returned error can't find the container with id 9e6c176380ec22595985bfa5797cd3a93c74bc31194a0a612cfac39f59984dda
Jul 23 18:03:28.089090 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.089071    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5ff94"]
Jul 23 18:03:28.091266 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:28.091219    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd29fc578_05c8_4db0_afe8_feb466c314a2.slice/crio-dc33e1fd124d617e9a27e4dac5cc6c65ff173a798a6ab7e731e82066d3032919 WatchSource:0}: Error finding container dc33e1fd124d617e9a27e4dac5cc6c65ff173a798a6ab7e731e82066d3032919: Status 404 returned error can't find the container with id dc33e1fd124d617e9a27e4dac5cc6c65ff173a798a6ab7e731e82066d3032919
Jul 23 18:03:28.182762 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.182697    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a27d685-d5e9-465a-a5a2-63b4d6a8a25e" path="/var/lib/kubelet/pods/0a27d685-d5e9-465a-a5a2-63b4d6a8a25e/volumes"
Jul 23 18:03:28.294469 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.294441    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fj4n8"]
Jul 23 18:03:28.297127 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:28.297104    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37b367f_0f47_417e_87f2_254b46903ee1.slice/crio-20ecf6d586164b456417a0d010ee1bf81cbb375889131a9d900732ef1b4ed100 WatchSource:0}: Error finding container 20ecf6d586164b456417a0d010ee1bf81cbb375889131a9d900732ef1b4ed100: Status 404 returned error can't find the container with id 20ecf6d586164b456417a0d010ee1bf81cbb375889131a9d900732ef1b4ed100
Jul 23 18:03:28.477527 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.477450    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:28.477527 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.477495    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:28.478152 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.478129    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fca00c58-fee4-4d2b-910c-979d9b13dd72-service-ca-bundle\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:28.479684 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.479667    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fca00c58-fee4-4d2b-910c-979d9b13dd72-metrics-certs\") pod \"router-default-6689ddd698-sx5jk\" (UID: \"fca00c58-fee4-4d2b-910c-979d9b13dd72\") " pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:28.496391 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.496363    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sn5fv" event={"ID":"dcf14205-3f73-4b29-ad41-afb60d083309","Type":"ContainerStarted","Data":"9e6c176380ec22595985bfa5797cd3a93c74bc31194a0a612cfac39f59984dda"}
Jul 23 18:03:28.497556 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.497532    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5ff94" event={"ID":"d29fc578-05c8-4db0-afe8-feb466c314a2","Type":"ContainerStarted","Data":"dc33e1fd124d617e9a27e4dac5cc6c65ff173a798a6ab7e731e82066d3032919"}
Jul 23 18:03:28.499451 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.499426    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z6cm5" event={"ID":"dc1d277c-2d3d-4cf5-8d38-6c9299f96081","Type":"ContainerStarted","Data":"8e0bcf0c5a69d759cab5123fd41c7a5204c940ea89fd5901d90efc89fa9f616f"}
Jul 23 18:03:28.501155 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.501135    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fj4n8" event={"ID":"d37b367f-0f47-417e-87f2-254b46903ee1","Type":"ContainerStarted","Data":"8d458c5963ed68144500466163a6820a256df1715b2e1860155084aaadf51fe4"}
Jul 23 18:03:28.501283 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.501167    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fj4n8" event={"ID":"d37b367f-0f47-417e-87f2-254b46903ee1","Type":"ContainerStarted","Data":"20ecf6d586164b456417a0d010ee1bf81cbb375889131a9d900732ef1b4ed100"}
Jul 23 18:03:28.501283 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.501209    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:03:28.502368 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.502269    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvjbc" event={"ID":"fbf30af5-97fb-434d-87a6-efc654c519db","Type":"ContainerStarted","Data":"8e4fa2c2f2d855a07ef9e3271694f4c55d3eb637d1873a281742509061a48484"}
Jul 23 18:03:28.521217 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.521171    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fj4n8" podStartSLOduration=68.521158822 podStartE2EDuration="1m8.521158822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:28.519799748 +0000 UTC m=+68.882643596" watchObservedRunningTime="2026-07-23 18:03:28.521158822 +0000 UTC m=+68.884002671"
Jul 23 18:03:28.726387 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.726268    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-hwp7x\""
Jul 23 18:03:28.734787 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.734518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:28.920814 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:28.920744    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6689ddd698-sx5jk"]
Jul 23 18:03:29.091091 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:29.091055    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca00c58_fee4_4d2b_910c_979d9b13dd72.slice/crio-98fb64a45891b3c668a6244e5302530e5fa65b118e9e50cc5b48fce4abc2e7df WatchSource:0}: Error finding container 98fb64a45891b3c668a6244e5302530e5fa65b118e9e50cc5b48fce4abc2e7df: Status 404 returned error can't find the container with id 98fb64a45891b3c668a6244e5302530e5fa65b118e9e50cc5b48fce4abc2e7df
Jul 23 18:03:29.383871 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.383775    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:29.509103 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.509057    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6689ddd698-sx5jk" event={"ID":"fca00c58-fee4-4d2b-910c-979d9b13dd72","Type":"ContainerStarted","Data":"d17e4a9664798cc210483ec7f1fa56098cf013363d1b55612fa017d51cdb09a5"}
Jul 23 18:03:29.509316 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.509154    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6689ddd698-sx5jk" event={"ID":"fca00c58-fee4-4d2b-910c-979d9b13dd72","Type":"ContainerStarted","Data":"98fb64a45891b3c668a6244e5302530e5fa65b118e9e50cc5b48fce4abc2e7df"}
Jul 23 18:03:29.512071 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.512041    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5ff94" event={"ID":"d29fc578-05c8-4db0-afe8-feb466c314a2","Type":"ContainerStarted","Data":"554242becdb727ba0a1fc3eefdf5adc26f92fcbb2ce735a9a40e67dd76ea1630"}
Jul 23 18:03:29.512211 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.512099    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5ff94" event={"ID":"d29fc578-05c8-4db0-afe8-feb466c314a2","Type":"ContainerStarted","Data":"2c920750be974de6899e20b2510e41a90eebe0a7baa425d76f5bb7c5f1ceea09"}
Jul 23 18:03:29.532294 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.532215    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6689ddd698-sx5jk" podStartSLOduration=33.532195615 podStartE2EDuration="33.532195615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:29.530051544 +0000 UTC m=+69.892895393" watchObservedRunningTime="2026-07-23 18:03:29.532195615 +0000 UTC m=+69.895039467"
Jul 23 18:03:29.547627 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.546870    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5ff94" podStartSLOduration=68.496886595 podStartE2EDuration="1m9.54684576s" totalImagesPullingTime="1.049959165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:29.54583132 +0000 UTC m=+69.908675171" watchObservedRunningTime="2026-07-23 18:03:29.54684576 +0000 UTC m=+69.909689611"
Jul 23 18:03:29.650768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.650673    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:29.735466 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.735431    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:29.738566 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.738368    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:29.749494 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:29.749464    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:30.520134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:30.520038    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvjbc" event={"ID":"fbf30af5-97fb-434d-87a6-efc654c519db","Type":"ContainerStarted","Data":"09649e543ff57165d8cb005308e2230c4c940267a0bc2729ed5d425aaf4789bc"}
Jul 23 18:03:30.520562 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:30.520290    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:30.520562 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:30.520326    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvjbc" event={"ID":"fbf30af5-97fb-434d-87a6-efc654c519db","Type":"ContainerStarted","Data":"10b3a501753f2c93423f5241c54498148c22c3b8fee8dcbb3d5ff2b01d7d9b3c"}
Jul 23 18:03:30.520562 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:30.520361    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:03:30.521849 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:30.521829    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6689ddd698-sx5jk"
Jul 23 18:03:30.540739 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:30.540683    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hvjbc" podStartSLOduration=34.457768047 podStartE2EDuration="36.540665941s" totalImagesPullingTime="2.082897894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:30.539995385 +0000 UTC m=+70.902839235" watchObservedRunningTime="2026-07-23 18:03:30.540665941 +0000 UTC m=+70.903509791"
Jul 23 18:03:34.538113 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:34.538077    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sn5fv" event={"ID":"dcf14205-3f73-4b29-ad41-afb60d083309","Type":"ContainerStarted","Data":"539af7517b415f860e34d32d68e0db6cb9fae0f8dc065bdf928b2dca96396a5e"}
Jul 23 18:03:34.540068 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:34.540043    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z6cm5" event={"ID":"dc1d277c-2d3d-4cf5-8d38-6c9299f96081","Type":"ContainerStarted","Data":"51d4dd6255768e54bc14801fac7aa6328e47e1fcfb3f44e020a9dcc6900ab908"}
Jul 23 18:03:34.556512 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:34.556470    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sn5fv" podStartSLOduration=67.781608632 podStartE2EDuration="1m13.556456917s" totalImagesPullingTime="5.774848285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:34.554769622 +0000 UTC m=+74.917613483" watchObservedRunningTime="2026-07-23 18:03:34.556456917 +0000 UTC m=+74.919300745"
Jul 23 18:03:34.573355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:34.573316    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z6cm5" podStartSLOduration=17.149665374 podStartE2EDuration="32.573302004s" totalImagesPullingTime="15.42363663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:03:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:34.57294613 +0000 UTC m=+74.935790010" watchObservedRunningTime="2026-07-23 18:03:34.573302004 +0000 UTC m=+74.936145853"
Jul 23 18:03:34.708442 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:34.708410    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:34.766152 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:34.766114    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:36.776529 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:36.776483    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:36.833859 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:36.833826    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:39.814843 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:39.814802    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:40.182525 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:40.182491    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:40.244585 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:40.244556    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:40.527117 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:40.527035    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hvjbc"
Jul 23 18:03:41.630798 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.630766    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77777bd9df-ctznh"]
Jul 23 18:03:41.633534 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.633518    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.636865 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.636842    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-djpzv\""
Jul 23 18:03:41.637738 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.637724    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 18:03:41.637914 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.637884    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 18:03:41.638027 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.637889    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 18:03:41.638027 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.637899    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 18:03:41.638027 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.637981    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 18:03:41.638255 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.638237    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 18:03:41.638327 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.638276    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 18:03:41.642875 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.642859    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 18:03:41.647181 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.647128    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77777bd9df-ctznh"]
Jul 23 18:03:41.654234 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.654182    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:41.777409 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.777296    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-oauth-serving-cert\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.777409 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.777333    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-config\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.777409 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.777364    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-oauth-config\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.777657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.777415    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdjng\" (UniqueName: \"kubernetes.io/projected/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-kube-api-access-cdjng\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.777657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.777460    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-service-ca\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.777657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.777543    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-trusted-ca-bundle\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.777657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.777604    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-serving-cert\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.778374 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.778353    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:41.878953 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.878909    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-service-ca\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.878953 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.878956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-trusted-ca-bundle\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.879172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.878983    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-serving-cert\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.879172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.879014    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-oauth-serving-cert\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.879172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.879030    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-config\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.879172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.879052    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-oauth-config\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.879172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.879066    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdjng\" (UniqueName: \"kubernetes.io/projected/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-kube-api-access-cdjng\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.879747 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.879719    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-oauth-serving-cert\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.879868 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.879752    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-service-ca\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.879938 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.879881    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-trusted-ca-bundle\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.879938 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.879890    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-config\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.881545 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.881492    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-serving-cert\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.881545 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.881507    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-oauth-config\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.889158 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.889133    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdjng\" (UniqueName: \"kubernetes.io/projected/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-kube-api-access-cdjng\") pod \"console-77777bd9df-ctznh\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") " pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:41.943052 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:41.943015    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:42.032021 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:42.031988    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:42.071089 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:42.071061    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77777bd9df-ctznh"]
Jul 23 18:03:42.073773 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:42.073744    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd214d2_65a8_4c6f_9e66_fe67ccfead30.slice/crio-a469b1c48fd59be2693e5fa14034aa280c0b418f2176003094c26f8be4f6a2d9 WatchSource:0}: Error finding container a469b1c48fd59be2693e5fa14034aa280c0b418f2176003094c26f8be4f6a2d9: Status 404 returned error can't find the container with id a469b1c48fd59be2693e5fa14034aa280c0b418f2176003094c26f8be4f6a2d9
Jul 23 18:03:42.135080 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:42.134995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:42.566273 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:42.566243    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77777bd9df-ctznh" event={"ID":"7bd214d2-65a8-4c6f-9e66-fe67ccfead30","Type":"ContainerStarted","Data":"a469b1c48fd59be2693e5fa14034aa280c0b418f2176003094c26f8be4f6a2d9"}
Jul 23 18:03:45.578884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:45.578845    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77777bd9df-ctznh" event={"ID":"7bd214d2-65a8-4c6f-9e66-fe67ccfead30","Type":"ContainerStarted","Data":"e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0"}
Jul 23 18:03:45.597808 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:45.597757    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77777bd9df-ctznh" podStartSLOduration=1.428047558 podStartE2EDuration="4.59774255s" totalImagesPullingTime="3.169694992s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:45.596004126 +0000 UTC m=+85.958847995" watchObservedRunningTime="2026-07-23 18:03:45.59774255 +0000 UTC m=+85.960586398"
Jul 23 18:03:45.645754 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:45.645728    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:45.656505 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:45.656472    2574 patch_prober.go:28] interesting pod/image-registry-646d7cc4cd-8p4xd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 18:03:45.656631 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:45.656527    2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd" podUID="5fc44631-5885-4007-bf2c-c54aa4c7bbcb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:03:45.708082 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:45.708049    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:46.031041 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:46.030933    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:46.131582 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:46.131552    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:46.924776 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:46.924743    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r"]
Jul 23 18:03:46.928019 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:46.928000    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r"
Jul 23 18:03:46.930279 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:46.930258    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 23 18:03:46.930345 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:46.930306    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-95nc5\""
Jul 23 18:03:46.935749 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:46.935730    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r"]
Jul 23 18:03:46.938507 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:46.938481    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:47.118301 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.118267    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/663d7e4e-240e-4bfd-8a3a-8327c8c7c0a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zj64r\" (UID: \"663d7e4e-240e-4bfd-8a3a-8327c8c7c0a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r"
Jul 23 18:03:47.195001 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.194915    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:47.218964 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.218938    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/663d7e4e-240e-4bfd-8a3a-8327c8c7c0a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zj64r\" (UID: \"663d7e4e-240e-4bfd-8a3a-8327c8c7c0a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r"
Jul 23 18:03:47.221373 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.221349    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/663d7e4e-240e-4bfd-8a3a-8327c8c7c0a8-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zj64r\" (UID: \"663d7e4e-240e-4bfd-8a3a-8327c8c7c0a8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r"
Jul 23 18:03:47.236297 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.236272    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r"
Jul 23 18:03:47.257889 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.257863    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:47.363377 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.363341    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r"]
Jul 23 18:03:47.366114 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:47.366084    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663d7e4e_240e_4bfd_8a3a_8327c8c7c0a8.slice/crio-d4609a4c2a9b9a928b64a6718e3b0d24398b3ab395adbf41d5b3bc083270bec7 WatchSource:0}: Error finding container d4609a4c2a9b9a928b64a6718e3b0d24398b3ab395adbf41d5b3bc083270bec7: Status 404 returned error can't find the container with id d4609a4c2a9b9a928b64a6718e3b0d24398b3ab395adbf41d5b3bc083270bec7
Jul 23 18:03:47.497099 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.497028    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-646d7cc4cd-8p4xd"
Jul 23 18:03:47.542007 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.541975    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:47.587268 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.587219    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r" event={"ID":"663d7e4e-240e-4bfd-8a3a-8327c8c7c0a8","Type":"ContainerStarted","Data":"d4609a4c2a9b9a928b64a6718e3b0d24398b3ab395adbf41d5b3bc083270bec7"}
Jul 23 18:03:47.639849 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.639816    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:47.741157 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:47.741119    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:48.592084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:48.592007    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r" event={"ID":"663d7e4e-240e-4bfd-8a3a-8327c8c7c0a8","Type":"ContainerStarted","Data":"15c93115d069bf674f54ba749cb4a7f88a0b911e1fe9303588d8324715f01956"}
Jul 23 18:03:48.592471 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:48.592244    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r"
Jul 23 18:03:48.597064 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:48.597040    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r"
Jul 23 18:03:48.611923 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:48.611880    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zj64r" podStartSLOduration=1.641258189 podStartE2EDuration="2.611868001s" totalImagesPullingTime="970.609812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:48.610919633 +0000 UTC m=+88.973763482" watchObservedRunningTime="2026-07-23 18:03:48.611868001 +0000 UTC m=+88.974711849"
Jul 23 18:03:48.951590 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:48.951516    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:49.001467 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.001433    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"]
Jul 23 18:03:49.004684 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.004669    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.007423 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.007403    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 18:03:49.007423 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.007417    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 18:03:49.008380 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.008359    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 18:03:49.008465 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.008442    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 18:03:49.008647 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.008633    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 18:03:49.008719 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.008654    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pt5ms\""
Jul 23 18:03:49.014099 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.014078    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"]
Jul 23 18:03:49.018043 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.018020    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:49.136047 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.136001    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.136047 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.136052    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.136282 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.136081    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdnfd\" (UniqueName: \"kubernetes.io/projected/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-kube-api-access-cdnfd\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.136282 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.136127    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.236575 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.236496    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.236575 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.236538    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.236575 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.236567    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdnfd\" (UniqueName: \"kubernetes.io/projected/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-kube-api-access-cdnfd\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.236838 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.236593    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.237321 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.237296    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.237657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.237621    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:49.239028 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.239009    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.239101 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.239015    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.245505 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.245487    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdnfd\" (UniqueName: \"kubernetes.io/projected/c40fe7c6-f5fe-4725-a367-f2d69a4d035e-kube-api-access-cdnfd\") pod \"prometheus-operator-5945b5cfd-7f4dt\" (UID: \"c40fe7c6-f5fe-4725-a367-f2d69a4d035e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.313995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.313965    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"
Jul 23 18:03:49.337647 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.337614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:49.442648 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.442536    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt"]
Jul 23 18:03:49.444777 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:49.444751    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc40fe7c6_f5fe_4725_a367_f2d69a4d035e.slice/crio-10fc328e21589b2032f0c3f733901e33d25eb084fc3c2b9fc6e3b7a76cae4ca4 WatchSource:0}: Error finding container 10fc328e21589b2032f0c3f733901e33d25eb084fc3c2b9fc6e3b7a76cae4ca4: Status 404 returned error can't find the container with id 10fc328e21589b2032f0c3f733901e33d25eb084fc3c2b9fc6e3b7a76cae4ca4
Jul 23 18:03:49.596560 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.596525    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt" event={"ID":"c40fe7c6-f5fe-4725-a367-f2d69a4d035e","Type":"ContainerStarted","Data":"10fc328e21589b2032f0c3f733901e33d25eb084fc3c2b9fc6e3b7a76cae4ca4"}
Jul 23 18:03:49.961402 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:49.961312    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:50.230333 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:50.230254    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:51.242319 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:51.242218    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:51.605214 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:51.605179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt" event={"ID":"c40fe7c6-f5fe-4725-a367-f2d69a4d035e","Type":"ContainerStarted","Data":"9d6fb17611f61cf1efcb2dfa4b14a878b88f5eb2d57aebd2d0213e2ba143ca24"}
Jul 23 18:03:51.605401 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:51.605275    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt" event={"ID":"c40fe7c6-f5fe-4725-a367-f2d69a4d035e","Type":"ContainerStarted","Data":"2d504820aef95b93ad85ede8c5bc920f14cd5bcdbeeddbe52a0e9277baebfba4"}
Jul 23 18:03:51.624560 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:51.624513    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7f4dt" podStartSLOduration=2.113468335 podStartE2EDuration="3.624497891s" totalImagesPullingTime="1.511029556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:51.623856252 +0000 UTC m=+91.986700128" watchObservedRunningTime="2026-07-23 18:03:51.624497891 +0000 UTC m=+91.987341740"
Jul 23 18:03:51.943799 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:51.943697    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:51.943799 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:51.943774    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:51.948323 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:51.948296    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:52.612587 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:52.612556    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:03:53.093656 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.093623    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:53.274102 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.274067    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:53.334318 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.334289    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"]
Jul 23 18:03:53.337556 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.337539    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.339477 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.339446    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:53.340027 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.340012    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 23 18:03:53.340087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.340075    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xg4ff\""
Jul 23 18:03:53.340416 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.340398    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 23 18:03:53.348512 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.348492    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"]
Jul 23 18:03:53.357540 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.357519    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-4sw88"]
Jul 23 18:03:53.360558 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.360539    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-btdrm"]
Jul 23 18:03:53.360694 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.360660    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.363135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.363115    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-mzgtb\""
Jul 23 18:03:53.363135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.363129    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 23 18:03:53.363776 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.363755    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.363874 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.363858    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 23 18:03:53.363922 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.363889    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 23 18:03:53.366479 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.366461    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 18:03:53.366581 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.366536    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 18:03:53.366769 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.366749    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 18:03:53.366860 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.366809    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fxzht\""
Jul 23 18:03:53.368925 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.368906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-wtmp\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.369013 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.368942    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-accelerators-collector-config\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.369013 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.368967    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.369013 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.368983    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caafa5e3-77ba-4e28-a76e-a31b311d0588-sys\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.369013 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369001    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/caafa5e3-77ba-4e28-a76e-a31b311d0588-root\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.369165 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369025    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caafa5e3-77ba-4e28-a76e-a31b311d0588-metrics-client-ca\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.369165 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369076    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-textfile\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.369165 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369125    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.369165 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369142    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-tls\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.369165 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.369371 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369186    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88czp\" (UniqueName: \"kubernetes.io/projected/caafa5e3-77ba-4e28-a76e-a31b311d0588-kube-api-access-88czp\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.369371 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369216    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnwps\" (UniqueName: \"kubernetes.io/projected/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-kube-api-access-lnwps\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.369371 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369260    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.369371 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369282    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.369371 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369301    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.369371 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369332    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.369592 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369385    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8tk2\" (UniqueName: \"kubernetes.io/projected/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-api-access-s8tk2\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.369592 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369401    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.369592 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.369426    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.373699 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.373680    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-4sw88"]
Jul 23 18:03:53.470621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470589    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-wtmp\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.470621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470625    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-accelerators-collector-config\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.470847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470644    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.470847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470660    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caafa5e3-77ba-4e28-a76e-a31b311d0588-sys\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.470847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470686    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/caafa5e3-77ba-4e28-a76e-a31b311d0588-root\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.470847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470713    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caafa5e3-77ba-4e28-a76e-a31b311d0588-metrics-client-ca\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.470847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470745    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-textfile\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.470847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470759    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/caafa5e3-77ba-4e28-a76e-a31b311d0588-sys\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.470847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470769    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/caafa5e3-77ba-4e28-a76e-a31b311d0588-root\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.470847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470759    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-wtmp\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.470847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470774    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.470847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470825    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-tls\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470861    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88czp\" (UniqueName: \"kubernetes.io/projected/caafa5e3-77ba-4e28-a76e-a31b311d0588-kube-api-access-88czp\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470929    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnwps\" (UniqueName: \"kubernetes.io/projected/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-kube-api-access-lnwps\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470955    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:53.470982    2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.470991    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471018    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:53.471053    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-tls podName:caafa5e3-77ba-4e28-a76e-a31b311d0588 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:53.971031248 +0000 UTC m=+94.333875087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-tls") pod "node-exporter-btdrm" (UID: "caafa5e3-77ba-4e28-a76e-a31b311d0588") : secret "node-exporter-tls" not found
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471081    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471089    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471129    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-textfile\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471134    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8tk2\" (UniqueName: \"kubernetes.io/projected/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-api-access-s8tk2\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:53.471162    2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471192    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.472051 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:53.471202    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-openshift-state-metrics-tls podName:ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b nodeName:}" failed. No retries permitted until 2026-07-23 18:03:53.971189118 +0000 UTC m=+94.334032947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-rnzkx" (UID: "ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b") : secret "openshift-state-metrics-tls" not found
Jul 23 18:03:53.472051 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471343    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-accelerators-collector-config\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.472051 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471463    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caafa5e3-77ba-4e28-a76e-a31b311d0588-metrics-client-ca\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.472051 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471508    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.472051 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:53.471591    2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 23 18:03:53.472051 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:53.471647    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-tls podName:c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af nodeName:}" failed. No retries permitted until 2026-07-23 18:03:53.971629321 +0000 UTC m=+94.334473159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-4sw88" (UID: "c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af") : secret "kube-state-metrics-tls" not found
Jul 23 18:03:53.472051 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471858    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.472051 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.471924    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.473457 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.473432    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.473676 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.473659    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.473780 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.473758    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.482390 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.482370    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8tk2\" (UniqueName: \"kubernetes.io/projected/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-api-access-s8tk2\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.482752 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.482733    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88czp\" (UniqueName: \"kubernetes.io/projected/caafa5e3-77ba-4e28-a76e-a31b311d0588-kube-api-access-88czp\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.482903 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.482886    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnwps\" (UniqueName: \"kubernetes.io/projected/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-kube-api-access-lnwps\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.591389 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.591348    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:53.691596 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.691498    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:53.792033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.792003    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:53.892954 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.892914    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:53.975846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.975761    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-tls\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.975846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.975818    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.975846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.975847    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.978248 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.978188    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-rnzkx\" (UID: \"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:53.978248 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.978193    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-4sw88\" (UID: \"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:53.978403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.978194    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/caafa5e3-77ba-4e28-a76e-a31b311d0588-node-exporter-tls\") pod \"node-exporter-btdrm\" (UID: \"caafa5e3-77ba-4e28-a76e-a31b311d0588\") " pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:53.993027 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:53.993000    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:54.246642 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.246566    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"
Jul 23 18:03:54.271336 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.271313    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88"
Jul 23 18:03:54.277187 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.277167    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-btdrm"
Jul 23 18:03:54.290668 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:54.290637    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaafa5e3_77ba_4e28_a76e_a31b311d0588.slice/crio-b1180f849980f71bd694778c88755b13b95ebd99a61dfa92aed30078dd4c2fa2 WatchSource:0}: Error finding container b1180f849980f71bd694778c88755b13b95ebd99a61dfa92aed30078dd4c2fa2: Status 404 returned error can't find the container with id b1180f849980f71bd694778c88755b13b95ebd99a61dfa92aed30078dd4c2fa2
Jul 23 18:03:54.324065 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.323983    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:54.404004 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.403823    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx"]
Jul 23 18:03:54.406618 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:54.406588    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6e3ea5_01c0_4d75_b36f_3dbd2bb8f93b.slice/crio-a6b2a7604e12a699df0ee57e1d6cb7d329e5fc097f12dd7eb09bc8fb1142e090 WatchSource:0}: Error finding container a6b2a7604e12a699df0ee57e1d6cb7d329e5fc097f12dd7eb09bc8fb1142e090: Status 404 returned error can't find the container with id a6b2a7604e12a699df0ee57e1d6cb7d329e5fc097f12dd7eb09bc8fb1142e090
Jul 23 18:03:54.410243 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.410193    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:54.429311 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.429285    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 18:03:54.435134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.435108    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.437821 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.437799    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 18:03:54.437821 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.437820    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nqbcs\""
Jul 23 18:03:54.437957 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.437832    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-4sw88"]
Jul 23 18:03:54.438116 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.438073    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 18:03:54.438381 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.438355    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 18:03:54.438381 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.438367    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 18:03:54.438700 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.438677    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 18:03:54.438791 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.438688    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 18:03:54.438858 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.438796    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 18:03:54.438945 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.438927    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 18:03:54.439428 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.439308    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 18:03:54.443927 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:54.443907    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95ca3b0_6791_4ec0_b5be_3e6dbfcb49af.slice/crio-e4234142a853bc590d39aad9667a590d6f0441513e58abd2c57ee60205357fd1 WatchSource:0}: Error finding container e4234142a853bc590d39aad9667a590d6f0441513e58abd2c57ee60205357fd1: Status 404 returned error can't find the container with id e4234142a853bc590d39aad9667a590d6f0441513e58abd2c57ee60205357fd1
Jul 23 18:03:54.451462 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.451440    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 18:03:54.479049 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479024    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479147 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479059    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7d8a46b-9a40-49b5-aa90-d8949931d166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479147 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479080    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7d8a46b-9a40-49b5-aa90-d8949931d166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479147 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479134    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479342 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479174    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7d8a46b-9a40-49b5-aa90-d8949931d166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479342 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479209    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-web-config\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479342 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479239    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479342 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479293    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479342 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479342 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479342    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7d8a46b-9a40-49b5-aa90-d8949931d166-config-out\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479359    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479404    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdglr\" (UniqueName: \"kubernetes.io/projected/a7d8a46b-9a40-49b5-aa90-d8949931d166-kube-api-access-qdglr\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.479580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.479439    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7d8a46b-9a40-49b5-aa90-d8949931d166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.580704 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.580660    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-web-config\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.580858 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.580708    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.580858 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.580752    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.580858 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.580788    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.580858 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.580821    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7d8a46b-9a40-49b5-aa90-d8949931d166-config-out\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.580858 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.580846    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.581097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.580878    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdglr\" (UniqueName: \"kubernetes.io/projected/a7d8a46b-9a40-49b5-aa90-d8949931d166-kube-api-access-qdglr\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.581097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.580903    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7d8a46b-9a40-49b5-aa90-d8949931d166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.581097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.580970    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.581097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.580994    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7d8a46b-9a40-49b5-aa90-d8949931d166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.581097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.581024    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7d8a46b-9a40-49b5-aa90-d8949931d166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.583384 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:54.581490    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a7d8a46b-9a40-49b5-aa90-d8949931d166-alertmanager-trusted-ca-bundle podName:a7d8a46b-9a40-49b5-aa90-d8949931d166 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:55.081463685 +0000 UTC m=+95.444307514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a7d8a46b-9a40-49b5-aa90-d8949931d166-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a7d8a46b-9a40-49b5-aa90-d8949931d166") : configmap references non-existent config key: ca-bundle.crt
Jul 23 18:03:54.583384 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:54.581725    2574 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 23 18:03:54.583384 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:03:54.581781    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-main-tls podName:a7d8a46b-9a40-49b5-aa90-d8949931d166 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:55.081765487 +0000 UTC m=+95.444609325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "a7d8a46b-9a40-49b5-aa90-d8949931d166") : secret "alertmanager-main-tls" not found
Jul 23 18:03:54.583384 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.582195    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.583384 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.582271    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7d8a46b-9a40-49b5-aa90-d8949931d166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.583384 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.582538    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7d8a46b-9a40-49b5-aa90-d8949931d166-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.584412 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.584266    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.584903 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.584673    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a7d8a46b-9a40-49b5-aa90-d8949931d166-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.584903 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.584795    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-config-volume\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.584903 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.584864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-web-config\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.585881 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.585580    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a7d8a46b-9a40-49b5-aa90-d8949931d166-config-out\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.586980 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.586941    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.588237 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.588165    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.588237 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.588181    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a7d8a46b-9a40-49b5-aa90-d8949931d166-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.589335 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.589312    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.590125 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.590105    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdglr\" (UniqueName: \"kubernetes.io/projected/a7d8a46b-9a40-49b5-aa90-d8949931d166-kube-api-access-qdglr\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:54.617972 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.617936    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btdrm" event={"ID":"caafa5e3-77ba-4e28-a76e-a31b311d0588","Type":"ContainerStarted","Data":"b1180f849980f71bd694778c88755b13b95ebd99a61dfa92aed30078dd4c2fa2"}
Jul 23 18:03:54.619768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.619738    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx" event={"ID":"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b","Type":"ContainerStarted","Data":"4255a28cffe24228f74702cb005cfb462176a087dcf380ff58849e0586c374f0"}
Jul 23 18:03:54.619872 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.619790    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx" event={"ID":"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b","Type":"ContainerStarted","Data":"61a091a9690ed154cef8365c03a85dba91ecdc3c397bf1ad5fc75262398cb9d7"}
Jul 23 18:03:54.619872 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.619816    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx" event={"ID":"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b","Type":"ContainerStarted","Data":"a6b2a7604e12a699df0ee57e1d6cb7d329e5fc097f12dd7eb09bc8fb1142e090"}
Jul 23 18:03:54.620786 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.620766    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88" event={"ID":"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af","Type":"ContainerStarted","Data":"e4234142a853bc590d39aad9667a590d6f0441513e58abd2c57ee60205357fd1"}
Jul 23 18:03:54.893410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:54.893351    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:55.085940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:55.085895    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7d8a46b-9a40-49b5-aa90-d8949931d166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:55.086144 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:55.085987    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:55.086851 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:55.086828    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a7d8a46b-9a40-49b5-aa90-d8949931d166-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:55.088596 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:55.088548    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a7d8a46b-9a40-49b5-aa90-d8949931d166-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a7d8a46b-9a40-49b5-aa90-d8949931d166\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:55.359951 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:55.359915    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 18:03:55.456041 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:55.455995    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:55.557238 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:55.557197    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:55.654571 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:55.654536    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 18:03:55.656866 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:55.656842    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d8a46b_9a40_49b5_aa90_d8949931d166.slice/crio-b388ebdb6e1020ce1d121b8375fd4abf65055475f521840e80fd988d4a2b9524 WatchSource:0}: Error finding container b388ebdb6e1020ce1d121b8375fd4abf65055475f521840e80fd988d4a2b9524: Status 404 returned error can't find the container with id b388ebdb6e1020ce1d121b8375fd4abf65055475f521840e80fd988d4a2b9524
Jul 23 18:03:56.296776 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:56.296727    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:56.414650 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:56.414604    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:56.589356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:56.589305    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:56.631594 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:56.631545    2574 generic.go:356] "Generic (PLEG): container finished" podID="caafa5e3-77ba-4e28-a76e-a31b311d0588" containerID="2f318a0ccfe8a959cadd7433b5ded68e7c5015541e951ceadd2b6952962c7f84" exitCode=0
Jul 23 18:03:56.631767 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:56.631587    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btdrm" event={"ID":"caafa5e3-77ba-4e28-a76e-a31b311d0588","Type":"ContainerDied","Data":"2f318a0ccfe8a959cadd7433b5ded68e7c5015541e951ceadd2b6952962c7f84"}
Jul 23 18:03:56.633211 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:56.633185    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7d8a46b-9a40-49b5-aa90-d8949931d166","Type":"ContainerStarted","Data":"b388ebdb6e1020ce1d121b8375fd4abf65055475f521840e80fd988d4a2b9524"}
Jul 23 18:03:56.665780 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:56.665741    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:57.446512 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.446485    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:57.541606 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.541573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:57.640710 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.640660    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btdrm" event={"ID":"caafa5e3-77ba-4e28-a76e-a31b311d0588","Type":"ContainerStarted","Data":"c97891eb7f88556574e61147ed33a23369c5144e653e7ff9214c7591e055cf9c"}
Jul 23 18:03:57.640882 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.640725    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-btdrm" event={"ID":"caafa5e3-77ba-4e28-a76e-a31b311d0588","Type":"ContainerStarted","Data":"f83269e55933736248e18f16669490e203730fa219aad8e2a66fe9cf76f5bf82"}
Jul 23 18:03:57.643015 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.642986    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx" event={"ID":"ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b","Type":"ContainerStarted","Data":"97104c2043c2083d7e65242cf8a916e02bf6c37a850e94c946b3a8eb79fff0df"}
Jul 23 18:03:57.645726 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.645703    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88" event={"ID":"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af","Type":"ContainerStarted","Data":"211ee29c8adec27e54468f9001f72e49e185fd3484a5707dae72f1b22118fc60"}
Jul 23 18:03:57.645864 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.645758    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88" event={"ID":"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af","Type":"ContainerStarted","Data":"f7f63ea80991639f4a25b78a3f16bc88eb7898a947f36188dbabd81ace4f2fad"}
Jul 23 18:03:57.645864 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.645786    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88" event={"ID":"c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af","Type":"ContainerStarted","Data":"533aa1d1c843408d354933741b660d3fbb81744d15c7e5410995123e9815ed91"}
Jul 23 18:03:57.665362 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.665279    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-btdrm" podStartSLOduration=3.313584333 podStartE2EDuration="4.665259735s" totalImagesPullingTime="1.221180222s" totalInitContainerRuntime="130.49518ms" isStatefulPod=true podCreationTimestamp="2026-07-23 18:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:57.664015572 +0000 UTC m=+98.026859452" watchObservedRunningTime="2026-07-23 18:03:57.665259735 +0000 UTC m=+98.028103565"
Jul 23 18:03:57.684788 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.684737    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-4sw88" podStartSLOduration=1.9632725930000001 podStartE2EDuration="4.684725664s" totalImagesPullingTime="2.721453071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:57.683449775 +0000 UTC m=+98.046293625" watchObservedRunningTime="2026-07-23 18:03:57.684725664 +0000 UTC m=+98.047569512"
Jul 23 18:03:57.690991 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.690895    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:57.703697 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.703639    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-rnzkx" podStartSLOduration=2.098548499 podStartE2EDuration="4.703615675s" totalImagesPullingTime="2.605067176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:57.702198152 +0000 UTC m=+98.065042002" watchObservedRunningTime="2026-07-23 18:03:57.703615675 +0000 UTC m=+98.066459524"
Jul 23 18:03:57.763823 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:57.763735    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:58.150753 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.150724    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:58.215781 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.215758    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:58.296859 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.296828    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:58.449495 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.449413    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f5577d595-n29mm"]
Jul 23 18:03:58.471432 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.471404    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5577d595-n29mm"]
Jul 23 18:03:58.471572 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.471525    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.516178 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.516149    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x942r\" (UniqueName: \"kubernetes.io/projected/8885780c-f239-471a-a0e4-20869cca806d-kube-api-access-x942r\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.516388 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.516208    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-oauth-serving-cert\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.516388 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.516283    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-console-config\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.516388 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.516310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-oauth-config\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.516388 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.516330    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-service-ca\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.516388 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.516354    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-trusted-ca-bundle\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.516388 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.516378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-serving-cert\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.617260 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.617209    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-console-config\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.617260 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.617263    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-oauth-config\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.617478 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.617280    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-service-ca\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.617478 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.617295    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-trusted-ca-bundle\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.617478 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.617318    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-serving-cert\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.617478 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.617403    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x942r\" (UniqueName: \"kubernetes.io/projected/8885780c-f239-471a-a0e4-20869cca806d-kube-api-access-x942r\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.617863 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.617830    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-oauth-serving-cert\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.618534 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.618461    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-console-config\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.622951 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.618645    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-trusted-ca-bundle\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.622951 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.618902    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-oauth-serving-cert\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.622951 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.619383    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-service-ca\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.622951 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.621378    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-serving-cert\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.624532 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.624513    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-oauth-config\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.629329 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.629309    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x942r\" (UniqueName: \"kubernetes.io/projected/8885780c-f239-471a-a0e4-20869cca806d-kube-api-access-x942r\") pod \"console-5f5577d595-n29mm\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") " pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.650657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.650631    2574 generic.go:356] "Generic (PLEG): container finished" podID="a7d8a46b-9a40-49b5-aa90-d8949931d166" containerID="e6b381722f80e3f072d8ea08b3eafb4f62a113a5d6b6f1f0bd48316f22d59128" exitCode=0
Jul 23 18:03:58.650765 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.650723    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7d8a46b-9a40-49b5-aa90-d8949931d166","Type":"ContainerDied","Data":"e6b381722f80e3f072d8ea08b3eafb4f62a113a5d6b6f1f0bd48316f22d59128"}
Jul 23 18:03:58.781445 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.781251    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:03:58.916751 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:58.916725    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f5577d595-n29mm"]
Jul 23 18:03:58.918734 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:03:58.918711    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8885780c_f239_471a_a0e4_20869cca806d.slice/crio-f4af7c0142b4c07204bbfb5868fe711240c4bbf70d164cd1d2de257740cbebc5 WatchSource:0}: Error finding container f4af7c0142b4c07204bbfb5868fe711240c4bbf70d164cd1d2de257740cbebc5: Status 404 returned error can't find the container with id f4af7c0142b4c07204bbfb5868fe711240c4bbf70d164cd1d2de257740cbebc5
Jul 23 18:03:59.515478 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:59.515444    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fj4n8"
Jul 23 18:03:59.570792 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:59.570763    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:03:59.657132 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:59.657098    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5577d595-n29mm" event={"ID":"8885780c-f239-471a-a0e4-20869cca806d","Type":"ContainerStarted","Data":"364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719"}
Jul 23 18:03:59.657346 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:59.657148    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5577d595-n29mm" event={"ID":"8885780c-f239-471a-a0e4-20869cca806d","Type":"ContainerStarted","Data":"f4af7c0142b4c07204bbfb5868fe711240c4bbf70d164cd1d2de257740cbebc5"}
Jul 23 18:03:59.685687 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:03:59.685635    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f5577d595-n29mm" podStartSLOduration=1.6856193510000002 podStartE2EDuration="1.685619351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:59.683604759 +0000 UTC m=+100.046448635" watchObservedRunningTime="2026-07-23 18:03:59.685619351 +0000 UTC m=+100.048463262"
Jul 23 18:04:00.176839 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:00.176805    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:00.275871 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:00.275837    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:00.376264 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:00.376184    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:01.670483 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:01.670453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7d8a46b-9a40-49b5-aa90-d8949931d166","Type":"ContainerStarted","Data":"22e5400489a900371e0b410450f68efa9b6b9541305986a17e22e9d7b8747529"}
Jul 23 18:04:01.670846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:01.670553    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7d8a46b-9a40-49b5-aa90-d8949931d166","Type":"ContainerStarted","Data":"8125cb4794c37ae4b8bc4ec8025506337b698a561c52c668a501ec8c8690a00d"}
Jul 23 18:04:01.670846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:01.670582    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7d8a46b-9a40-49b5-aa90-d8949931d166","Type":"ContainerStarted","Data":"2f51890b0da724e1d8a958ecb04cff410bc520b5251c0c46867efcafeaee67d0"}
Jul 23 18:04:01.670846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:01.670606    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7d8a46b-9a40-49b5-aa90-d8949931d166","Type":"ContainerStarted","Data":"81df5cd6dcc1729d89f50804dfeb2d22524ac50a8344bf33344ad9d206246e23"}
Jul 23 18:04:01.670846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:01.670630    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7d8a46b-9a40-49b5-aa90-d8949931d166","Type":"ContainerStarted","Data":"34b0c4ec2680f744c7bdad77de124940427a3e188f6db3b9b1cd84f7370d9e28"}
Jul 23 18:04:02.677608 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:02.677574    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a7d8a46b-9a40-49b5-aa90-d8949931d166","Type":"ContainerStarted","Data":"36fe2bc8da11945c82a82fa2252a1498aa3b5e60002e499e22e0f73c04548d4b"}
Jul 23 18:04:02.720602 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:02.720551    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.16193737 podStartE2EDuration="8.720534839s" totalImagesPullingTime="5.545716165s" totalInitContainerRuntime="12.881304ms" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:04:02.719555441 +0000 UTC m=+103.082399302" watchObservedRunningTime="2026-07-23 18:04:02.720534839 +0000 UTC m=+103.083378688"
Jul 23 18:04:05.583774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:05.583732    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:05.686684 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:05.686654    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:06.761746 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:06.761707    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:06.828369 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:06.828338    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:08.782618 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:08.782582    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:04:08.783080 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:08.782650    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:04:08.787787 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:08.787756    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:04:09.716798 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:09.716769    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:04:09.771285 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:09.771248    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77777bd9df-ctznh"]
Jul 23 18:04:09.896840 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:09.896802    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:10.462517 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:10.462465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:10.563286 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:10.563248    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:10.666724 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:10.666676    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:25.708084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:25.708051    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:25.767029 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:25.767000    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:04:34.802582 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:34.802544    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77777bd9df-ctznh" podUID="7bd214d2-65a8-4c6f-9e66-fe67ccfead30" containerName="console" containerID="cri-o://e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0" gracePeriod=15
Jul 23 18:04:35.045317 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.045290    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:04:35.135395 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.135368    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-trusted-ca-bundle\") pod \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") "
Jul 23 18:04:35.135547 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.135432    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-oauth-serving-cert\") pod \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") "
Jul 23 18:04:35.135547 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.135453    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-config\") pod \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") "
Jul 23 18:04:35.135547 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.135470    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdjng\" (UniqueName: \"kubernetes.io/projected/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-kube-api-access-cdjng\") pod \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") "
Jul 23 18:04:35.135547 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.135488    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-serving-cert\") pod \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") "
Jul 23 18:04:35.135547 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.135519    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-oauth-config\") pod \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") "
Jul 23 18:04:35.135790 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.135566    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-service-ca\") pod \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\" (UID: \"7bd214d2-65a8-4c6f-9e66-fe67ccfead30\") "
Jul 23 18:04:35.135863 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.135832    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7bd214d2-65a8-4c6f-9e66-fe67ccfead30" (UID: "7bd214d2-65a8-4c6f-9e66-fe67ccfead30"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:04:35.135929 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.135898    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7bd214d2-65a8-4c6f-9e66-fe67ccfead30" (UID: "7bd214d2-65a8-4c6f-9e66-fe67ccfead30"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:04:35.135929 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.135907    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-config" (OuterVolumeSpecName: "console-config") pod "7bd214d2-65a8-4c6f-9e66-fe67ccfead30" (UID: "7bd214d2-65a8-4c6f-9e66-fe67ccfead30"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:04:35.136163 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.136139    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-service-ca" (OuterVolumeSpecName: "service-ca") pod "7bd214d2-65a8-4c6f-9e66-fe67ccfead30" (UID: "7bd214d2-65a8-4c6f-9e66-fe67ccfead30"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:04:35.137897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.137862    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7bd214d2-65a8-4c6f-9e66-fe67ccfead30" (UID: "7bd214d2-65a8-4c6f-9e66-fe67ccfead30"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:04:35.137897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.137875    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-kube-api-access-cdjng" (OuterVolumeSpecName: "kube-api-access-cdjng") pod "7bd214d2-65a8-4c6f-9e66-fe67ccfead30" (UID: "7bd214d2-65a8-4c6f-9e66-fe67ccfead30"). InnerVolumeSpecName "kube-api-access-cdjng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:04:35.137897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.137881    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7bd214d2-65a8-4c6f-9e66-fe67ccfead30" (UID: "7bd214d2-65a8-4c6f-9e66-fe67ccfead30"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:04:35.236287 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.236257    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-trusted-ca-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.236287 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.236282    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-oauth-serving-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.236287 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.236293    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-config\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.236498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.236304    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdjng\" (UniqueName: \"kubernetes.io/projected/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-kube-api-access-cdjng\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.236498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.236314    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-serving-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.236498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.236323    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-console-oauth-config\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.236498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.236338    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7bd214d2-65a8-4c6f-9e66-fe67ccfead30-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:04:35.804487 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.804451    2574 generic.go:356] "Generic (PLEG): container finished" podID="7bd214d2-65a8-4c6f-9e66-fe67ccfead30" containerID="e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0" exitCode=0
Jul 23 18:04:35.804886 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.804498    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77777bd9df-ctznh"
Jul 23 18:04:35.804886 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.804507    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77777bd9df-ctznh" event={"ID":"7bd214d2-65a8-4c6f-9e66-fe67ccfead30","Type":"ContainerDied","Data":"e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0"}
Jul 23 18:04:35.804886 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.804549    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77777bd9df-ctznh" event={"ID":"7bd214d2-65a8-4c6f-9e66-fe67ccfead30","Type":"ContainerDied","Data":"a469b1c48fd59be2693e5fa14034aa280c0b418f2176003094c26f8be4f6a2d9"}
Jul 23 18:04:35.804886 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.804567    2574 scope.go:117] "RemoveContainer" containerID="e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0"
Jul 23 18:04:35.813310 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.813289    2574 scope.go:117] "RemoveContainer" containerID="e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0"
Jul 23 18:04:35.813558 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:04:35.813536    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0\": container with ID starting with e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0 not found: ID does not exist" containerID="e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0"
Jul 23 18:04:35.813606 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.813567    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0"} err="failed to get container status \"e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0\": rpc error: code = NotFound desc = could not find container \"e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0\": container with ID starting with e4eee8f7d6bfcb2eb4e1a22e13a9332e3a156d2c6a993130a33f7d3761d827d0 not found: ID does not exist"
Jul 23 18:04:35.828448 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.828418    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77777bd9df-ctznh"]
Jul 23 18:04:35.832958 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:35.832937    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77777bd9df-ctznh"]
Jul 23 18:04:36.184418 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:36.184384    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bd214d2-65a8-4c6f-9e66-fe67ccfead30" path="/var/lib/kubelet/pods/7bd214d2-65a8-4c6f-9e66-fe67ccfead30/volumes"
Jul 23 18:04:50.609390 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:04:50.609352    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:12.594821 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:12.594723    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:12.809696 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:12.809643    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:17.681394 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.681352    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-548c59bcb4-sv75r"]
Jul 23 18:05:17.681870 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.681757    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bd214d2-65a8-4c6f-9e66-fe67ccfead30" containerName="console"
Jul 23 18:05:17.681870 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.681772    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd214d2-65a8-4c6f-9e66-fe67ccfead30" containerName="console"
Jul 23 18:05:17.681870 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.681834    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bd214d2-65a8-4c6f-9e66-fe67ccfead30" containerName="console"
Jul 23 18:05:17.684891 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.684867    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.687851 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.687831    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 23 18:05:17.688392 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.688374    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 23 18:05:17.688969 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.688946    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-92lkc\""
Jul 23 18:05:17.690666 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.690076    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 23 18:05:17.690666 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.690275    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 23 18:05:17.690666 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.690527    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 23 18:05:17.704069 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.704042    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-548c59bcb4-sv75r"]
Jul 23 18:05:17.705369 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.705345    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 23 18:05:17.776042 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.776008    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj5ff\" (UniqueName: \"kubernetes.io/projected/6973a297-ac7e-4fa8-8153-5fc330e52649-kube-api-access-hj5ff\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.776212 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.776065    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-federate-client-tls\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.776212 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.776126    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.776212 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.776162    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6973a297-ac7e-4fa8-8153-5fc330e52649-serving-certs-ca-bundle\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.776212 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.776188    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-telemeter-client-tls\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.776212 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.776206    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6973a297-ac7e-4fa8-8153-5fc330e52649-metrics-client-ca\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.776457 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.776290    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6973a297-ac7e-4fa8-8153-5fc330e52649-telemeter-trusted-ca-bundle\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.776457 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.776316    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-secret-telemeter-client\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.876943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.876903    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.877135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.876949    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6973a297-ac7e-4fa8-8153-5fc330e52649-serving-certs-ca-bundle\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.877135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.876979    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-telemeter-client-tls\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.877135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.877002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6973a297-ac7e-4fa8-8153-5fc330e52649-metrics-client-ca\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.877135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.877055    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6973a297-ac7e-4fa8-8153-5fc330e52649-telemeter-trusted-ca-bundle\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.877135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.877113    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-secret-telemeter-client\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.877434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.877177    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj5ff\" (UniqueName: \"kubernetes.io/projected/6973a297-ac7e-4fa8-8153-5fc330e52649-kube-api-access-hj5ff\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.877434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.877259    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-federate-client-tls\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.877887 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.877864    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6973a297-ac7e-4fa8-8153-5fc330e52649-serving-certs-ca-bundle\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.878046 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.877903    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6973a297-ac7e-4fa8-8153-5fc330e52649-metrics-client-ca\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.878046 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.878031    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6973a297-ac7e-4fa8-8153-5fc330e52649-telemeter-trusted-ca-bundle\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.879748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.879724    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-federate-client-tls\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.879829 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.879805    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-secret-telemeter-client\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.879884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.879868    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.879924 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.879907    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6973a297-ac7e-4fa8-8153-5fc330e52649-telemeter-client-tls\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.891965 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.891942    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj5ff\" (UniqueName: \"kubernetes.io/projected/6973a297-ac7e-4fa8-8153-5fc330e52649-kube-api-access-hj5ff\") pod \"telemeter-client-548c59bcb4-sv75r\" (UID: \"6973a297-ac7e-4fa8-8153-5fc330e52649\") " pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:17.995753 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:17.995685    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r"
Jul 23 18:05:18.133689 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:18.133664    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-548c59bcb4-sv75r"]
Jul 23 18:05:18.137205 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:05:18.137178    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6973a297_ac7e_4fa8_8153_5fc330e52649.slice/crio-eef0c066e5be64ba45e871d4d0bc100ae66b0108c63715eefad0041a053f4afa WatchSource:0}: Error finding container eef0c066e5be64ba45e871d4d0bc100ae66b0108c63715eefad0041a053f4afa: Status 404 returned error can't find the container with id eef0c066e5be64ba45e871d4d0bc100ae66b0108c63715eefad0041a053f4afa
Jul 23 18:05:18.975515 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:18.975479    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r" event={"ID":"6973a297-ac7e-4fa8-8153-5fc330e52649","Type":"ContainerStarted","Data":"eef0c066e5be64ba45e871d4d0bc100ae66b0108c63715eefad0041a053f4afa"}
Jul 23 18:05:19.981402 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:19.981370    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r" event={"ID":"6973a297-ac7e-4fa8-8153-5fc330e52649","Type":"ContainerStarted","Data":"eea2a680dc6b036b0a5165f7ebc6ae75a94690f78fa2289d550df098abd6e007"}
Jul 23 18:05:19.981746 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:19.981433    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r" event={"ID":"6973a297-ac7e-4fa8-8153-5fc330e52649","Type":"ContainerStarted","Data":"f64088c136b8e098476638f7934ca6be10c2c93f8bada85497cd7421cf75fe88"}
Jul 23 18:05:19.981746 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:19.981453    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r" event={"ID":"6973a297-ac7e-4fa8-8153-5fc330e52649","Type":"ContainerStarted","Data":"6e0e3e1c865a1cd73eb935b9b72acf603a7dc744dc4fd7f30fde41ce1704022d"}
Jul 23 18:05:20.011428 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:20.011376    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-548c59bcb4-sv75r" podStartSLOduration=1.387053883 podStartE2EDuration="3.011328499s" totalImagesPullingTime="1.624274616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:05:20.010986701 +0000 UTC m=+180.373830575" watchObservedRunningTime="2026-07-23 18:05:20.011328499 +0000 UTC m=+180.374172349"
Jul 23 18:05:20.956201 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:20.956156    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-558ddc5d6f-87gln"]
Jul 23 18:05:20.961609 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:20.961580    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:20.971551 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:20.971520    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558ddc5d6f-87gln"]
Jul 23 18:05:21.040274 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.040239    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:21.107417 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.107378    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-serving-cert\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.107712 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.107679    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-oauth-serving-cert\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.107872 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.107812    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-service-ca\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.108017 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.107994    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-config\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.108340 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.108315    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-oauth-config\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.108450 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.108354    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj4s5\" (UniqueName: \"kubernetes.io/projected/d7ac137a-18d9-4a11-8db1-ad0742ba118a-kube-api-access-gj4s5\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.108524 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.108461    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-trusted-ca-bundle\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.153632 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.153598    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:21.207415 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.207325    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:21.209464 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.209445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-trusted-ca-bundle\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.209535 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.209483    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-serving-cert\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.209535 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.209501    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-oauth-serving-cert\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.209636 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.209621    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-service-ca\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.209691 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.209673    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-config\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.209746 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.209731    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-oauth-config\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.209798 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.209764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj4s5\" (UniqueName: \"kubernetes.io/projected/d7ac137a-18d9-4a11-8db1-ad0742ba118a-kube-api-access-gj4s5\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.210396 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.210368    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-service-ca\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.210509 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.210411    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-oauth-serving-cert\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.210509 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.210433    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-config\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.210509 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.210469    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-trusted-ca-bundle\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.212141 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.212117    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-serving-cert\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.212249 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.212178    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-oauth-config\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.218498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.218477    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj4s5\" (UniqueName: \"kubernetes.io/projected/d7ac137a-18d9-4a11-8db1-ad0742ba118a-kube-api-access-gj4s5\") pod \"console-558ddc5d6f-87gln\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") " pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.272905 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.272878    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:21.409932 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.409900    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-558ddc5d6f-87gln"]
Jul 23 18:05:21.413163 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:05:21.413135    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7ac137a_18d9_4a11_8db1_ad0742ba118a.slice/crio-bfcca185910a484a5668cc70f3693a6749060befbc15ff89720966ef75ff7083 WatchSource:0}: Error finding container bfcca185910a484a5668cc70f3693a6749060befbc15ff89720966ef75ff7083: Status 404 returned error can't find the container with id bfcca185910a484a5668cc70f3693a6749060befbc15ff89720966ef75ff7083
Jul 23 18:05:21.744384 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.744279    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:21.992951 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.992914    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558ddc5d6f-87gln" event={"ID":"d7ac137a-18d9-4a11-8db1-ad0742ba118a","Type":"ContainerStarted","Data":"a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5"}
Jul 23 18:05:21.993145 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:21.992968    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558ddc5d6f-87gln" event={"ID":"d7ac137a-18d9-4a11-8db1-ad0742ba118a","Type":"ContainerStarted","Data":"bfcca185910a484a5668cc70f3693a6749060befbc15ff89720966ef75ff7083"}
Jul 23 18:05:22.011278 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:22.011171    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-558ddc5d6f-87gln" podStartSLOduration=2.011155188 podStartE2EDuration="2.011155188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:05:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:05:22.010979595 +0000 UTC m=+182.373823457" watchObservedRunningTime="2026-07-23 18:05:22.011155188 +0000 UTC m=+182.373999036"
Jul 23 18:05:26.211591 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:26.211558    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:27.908927 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:27.908892    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:27.979738 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:27.979706    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:31.273026 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:31.272979    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:31.273592 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:31.273054    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:31.277752 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:31.277733    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:32.035937 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.035903    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:05:32.096476 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.096443    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5577d595-n29mm"]
Jul 23 18:05:32.184807 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.184775    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78f87b69b-xcwb8"]
Jul 23 18:05:32.192262 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.192237    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.204606 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.204576    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f87b69b-xcwb8"]
Jul 23 18:05:32.204929 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.204906    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-oauth-serving-cert\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.204988 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.204956    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-service-ca\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.204988 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.204975    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-config\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.205090 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.205004    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-trusted-ca-bundle\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.205090 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.205019    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbf6g\" (UniqueName: \"kubernetes.io/projected/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-kube-api-access-kbf6g\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.205186 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.205089    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-serving-cert\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.205186 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.205128    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-oauth-config\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.306549 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.306461    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-oauth-serving-cert\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.306549 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.306523    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-service-ca\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.306549 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.306541    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-config\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.307117 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.306558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-trusted-ca-bundle\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.307117 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.306574    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbf6g\" (UniqueName: \"kubernetes.io/projected/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-kube-api-access-kbf6g\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.307117 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.306591    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-serving-cert\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.307117 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.306616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-oauth-config\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.307427 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.307398    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-oauth-serving-cert\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.307483 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.307441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-config\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.307483 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.307441    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-service-ca\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.307694 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.307669    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-trusted-ca-bundle\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.309097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.309073    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-oauth-config\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.309173 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.309159    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-serving-cert\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.317016 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.316990    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbf6g\" (UniqueName: \"kubernetes.io/projected/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-kube-api-access-kbf6g\") pod \"console-78f87b69b-xcwb8\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") " pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.504413 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.504378    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:32.631526 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:32.631499    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f87b69b-xcwb8"]
Jul 23 18:05:32.636364 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:05:32.636339    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca0cd08_fff3_4c6a_a884_a4df8a9dd66b.slice/crio-f09f6ab65e0a3225d6bdc942aca928d714e11c26540e90f184f6f92ba4ba5a0b WatchSource:0}: Error finding container f09f6ab65e0a3225d6bdc942aca928d714e11c26540e90f184f6f92ba4ba5a0b: Status 404 returned error can't find the container with id f09f6ab65e0a3225d6bdc942aca928d714e11c26540e90f184f6f92ba4ba5a0b
Jul 23 18:05:33.037888 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:33.037792    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f87b69b-xcwb8" event={"ID":"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b","Type":"ContainerStarted","Data":"630f976a6521f53114bd80a54db3555517cd3c4876b3e0f9b71d8a65137a1e59"}
Jul 23 18:05:33.037888 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:33.037845    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f87b69b-xcwb8" event={"ID":"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b","Type":"ContainerStarted","Data":"f09f6ab65e0a3225d6bdc942aca928d714e11c26540e90f184f6f92ba4ba5a0b"}
Jul 23 18:05:33.062445 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:33.062396    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78f87b69b-xcwb8" podStartSLOduration=1.062380538 podStartE2EDuration="1.062380538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:05:33.061171998 +0000 UTC m=+193.424015846" watchObservedRunningTime="2026-07-23 18:05:33.062380538 +0000 UTC m=+193.425224386"
Jul 23 18:05:39.775877 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:39.775830    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:39.834282 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:39.834249    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:42.505302 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:42.505263    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:42.505670 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:42.505331    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:42.510189 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:42.510168    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:43.078443 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:43.078408    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:05:43.124054 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:43.124022    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558ddc5d6f-87gln"]
Jul 23 18:05:43.227508 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:43.227478    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:43.330095 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:43.330010    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:43.385589 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:43.385559    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:45.753210 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:45.753175    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:55.486553 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:55.486504    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:55.572774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:55.572739    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:55.634123 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:55.634092    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:05:57.120383 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.120348    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f5577d595-n29mm" podUID="8885780c-f239-471a-a0e4-20869cca806d" containerName="console" containerID="cri-o://364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719" gracePeriod=15
Jul 23 18:05:57.371915 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.371858    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:05:57.522094 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522065    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-oauth-serving-cert\") pod \"8885780c-f239-471a-a0e4-20869cca806d\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") "
Jul 23 18:05:57.522305 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522120    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-oauth-config\") pod \"8885780c-f239-471a-a0e4-20869cca806d\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") "
Jul 23 18:05:57.522305 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522163    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-trusted-ca-bundle\") pod \"8885780c-f239-471a-a0e4-20869cca806d\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") "
Jul 23 18:05:57.522305 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522245    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-serving-cert\") pod \"8885780c-f239-471a-a0e4-20869cca806d\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") "
Jul 23 18:05:57.522477 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522347    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-service-ca\") pod \"8885780c-f239-471a-a0e4-20869cca806d\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") "
Jul 23 18:05:57.522477 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522402    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-console-config\") pod \"8885780c-f239-471a-a0e4-20869cca806d\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") "
Jul 23 18:05:57.522477 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522407    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8885780c-f239-471a-a0e4-20869cca806d" (UID: "8885780c-f239-471a-a0e4-20869cca806d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:05:57.522477 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522461    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x942r\" (UniqueName: \"kubernetes.io/projected/8885780c-f239-471a-a0e4-20869cca806d-kube-api-access-x942r\") pod \"8885780c-f239-471a-a0e4-20869cca806d\" (UID: \"8885780c-f239-471a-a0e4-20869cca806d\") "
Jul 23 18:05:57.522689 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522561    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8885780c-f239-471a-a0e4-20869cca806d" (UID: "8885780c-f239-471a-a0e4-20869cca806d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:05:57.522689 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522662    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-service-ca" (OuterVolumeSpecName: "service-ca") pod "8885780c-f239-471a-a0e4-20869cca806d" (UID: "8885780c-f239-471a-a0e4-20869cca806d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:05:57.523217 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.523161    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:05:57.523369 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.523242    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-oauth-serving-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:05:57.523369 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.523283    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-trusted-ca-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:05:57.523369 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.522738    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-console-config" (OuterVolumeSpecName: "console-config") pod "8885780c-f239-471a-a0e4-20869cca806d" (UID: "8885780c-f239-471a-a0e4-20869cca806d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:05:57.529439 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.529408    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8885780c-f239-471a-a0e4-20869cca806d" (UID: "8885780c-f239-471a-a0e4-20869cca806d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:05:57.529659 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.529630    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8885780c-f239-471a-a0e4-20869cca806d" (UID: "8885780c-f239-471a-a0e4-20869cca806d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:05:57.529659 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.529642    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8885780c-f239-471a-a0e4-20869cca806d-kube-api-access-x942r" (OuterVolumeSpecName: "kube-api-access-x942r") pod "8885780c-f239-471a-a0e4-20869cca806d" (UID: "8885780c-f239-471a-a0e4-20869cca806d"). InnerVolumeSpecName "kube-api-access-x942r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:05:57.624633 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.624554    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-oauth-config\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:05:57.624633 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.624581    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8885780c-f239-471a-a0e4-20869cca806d-console-serving-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:05:57.624633 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.624591    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8885780c-f239-471a-a0e4-20869cca806d-console-config\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:05:57.624633 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:57.624600    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x942r\" (UniqueName: \"kubernetes.io/projected/8885780c-f239-471a-a0e4-20869cca806d-kube-api-access-x942r\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:05:58.134189 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:58.134147    2574 generic.go:356] "Generic (PLEG): container finished" podID="8885780c-f239-471a-a0e4-20869cca806d" containerID="364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719" exitCode=0
Jul 23 18:05:58.134629 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:58.134200    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f5577d595-n29mm"
Jul 23 18:05:58.134629 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:58.134283    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5577d595-n29mm" event={"ID":"8885780c-f239-471a-a0e4-20869cca806d","Type":"ContainerDied","Data":"364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719"}
Jul 23 18:05:58.134629 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:58.134379    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f5577d595-n29mm" event={"ID":"8885780c-f239-471a-a0e4-20869cca806d","Type":"ContainerDied","Data":"f4af7c0142b4c07204bbfb5868fe711240c4bbf70d164cd1d2de257740cbebc5"}
Jul 23 18:05:58.134629 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:58.134412    2574 scope.go:117] "RemoveContainer" containerID="364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719"
Jul 23 18:05:58.143772 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:58.143752    2574 scope.go:117] "RemoveContainer" containerID="364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719"
Jul 23 18:05:58.144041 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:05:58.144015    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719\": container with ID starting with 364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719 not found: ID does not exist" containerID="364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719"
Jul 23 18:05:58.144142 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:58.144045    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719"} err="failed to get container status \"364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719\": rpc error: code = NotFound desc = could not find container \"364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719\": container with ID starting with 364dc25d832aaa90a2e9d6044d619a6461b5830000ba378d81b86e114e829719 not found: ID does not exist"
Jul 23 18:05:58.156511 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:58.156483    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f5577d595-n29mm"]
Jul 23 18:05:58.160847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:58.160825    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f5577d595-n29mm"]
Jul 23 18:05:58.184380 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:05:58.184358    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8885780c-f239-471a-a0e4-20869cca806d" path="/var/lib/kubelet/pods/8885780c-f239-471a-a0e4-20869cca806d/volumes"
Jul 23 18:06:08.147946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.147903    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-558ddc5d6f-87gln" podUID="d7ac137a-18d9-4a11-8db1-ad0742ba118a" containerName="console" containerID="cri-o://a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5" gracePeriod=15
Jul 23 18:06:08.387202 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.387181    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:06:08.510740 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.510641    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-service-ca\") pod \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") "
Jul 23 18:06:08.510740 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.510705    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-serving-cert\") pod \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") "
Jul 23 18:06:08.510740 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.510737    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj4s5\" (UniqueName: \"kubernetes.io/projected/d7ac137a-18d9-4a11-8db1-ad0742ba118a-kube-api-access-gj4s5\") pod \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") "
Jul 23 18:06:08.511006 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.510771    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-trusted-ca-bundle\") pod \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") "
Jul 23 18:06:08.511006 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.510829    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-oauth-config\") pod \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") "
Jul 23 18:06:08.511006 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.510920    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-config\") pod \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") "
Jul 23 18:06:08.511006 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.510983    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-oauth-serving-cert\") pod \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\" (UID: \"d7ac137a-18d9-4a11-8db1-ad0742ba118a\") "
Jul 23 18:06:08.511316 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.511088    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7ac137a-18d9-4a11-8db1-ad0742ba118a" (UID: "d7ac137a-18d9-4a11-8db1-ad0742ba118a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:06:08.511380 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.511313    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-config" (OuterVolumeSpecName: "console-config") pod "d7ac137a-18d9-4a11-8db1-ad0742ba118a" (UID: "d7ac137a-18d9-4a11-8db1-ad0742ba118a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:06:08.511380 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.511320    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7ac137a-18d9-4a11-8db1-ad0742ba118a" (UID: "d7ac137a-18d9-4a11-8db1-ad0742ba118a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:06:08.511380 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.511326    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:06:08.511535 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.511521    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7ac137a-18d9-4a11-8db1-ad0742ba118a" (UID: "d7ac137a-18d9-4a11-8db1-ad0742ba118a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:06:08.512898 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.512873    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7ac137a-18d9-4a11-8db1-ad0742ba118a-kube-api-access-gj4s5" (OuterVolumeSpecName: "kube-api-access-gj4s5") pod "d7ac137a-18d9-4a11-8db1-ad0742ba118a" (UID: "d7ac137a-18d9-4a11-8db1-ad0742ba118a"). InnerVolumeSpecName "kube-api-access-gj4s5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:06:08.512994 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.512896    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7ac137a-18d9-4a11-8db1-ad0742ba118a" (UID: "d7ac137a-18d9-4a11-8db1-ad0742ba118a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:06:08.512994 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.512912    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7ac137a-18d9-4a11-8db1-ad0742ba118a" (UID: "d7ac137a-18d9-4a11-8db1-ad0742ba118a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:06:08.612033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.611997    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-serving-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:06:08.612033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.612029    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj4s5\" (UniqueName: \"kubernetes.io/projected/d7ac137a-18d9-4a11-8db1-ad0742ba118a-kube-api-access-gj4s5\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:06:08.612033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.612039    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-trusted-ca-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:06:08.612033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.612048    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-oauth-config\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:06:08.612287 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.612056    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-console-config\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:06:08.612287 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:08.612064    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7ac137a-18d9-4a11-8db1-ad0742ba118a-oauth-serving-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:06:09.178326 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:09.178296    2574 generic.go:356] "Generic (PLEG): container finished" podID="d7ac137a-18d9-4a11-8db1-ad0742ba118a" containerID="a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5" exitCode=0
Jul 23 18:06:09.178754 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:09.178340    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-558ddc5d6f-87gln"
Jul 23 18:06:09.178754 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:09.178364    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558ddc5d6f-87gln" event={"ID":"d7ac137a-18d9-4a11-8db1-ad0742ba118a","Type":"ContainerDied","Data":"a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5"}
Jul 23 18:06:09.178754 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:09.178400    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-558ddc5d6f-87gln" event={"ID":"d7ac137a-18d9-4a11-8db1-ad0742ba118a","Type":"ContainerDied","Data":"bfcca185910a484a5668cc70f3693a6749060befbc15ff89720966ef75ff7083"}
Jul 23 18:06:09.178754 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:09.178421    2574 scope.go:117] "RemoveContainer" containerID="a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5"
Jul 23 18:06:09.186723 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:09.186706    2574 scope.go:117] "RemoveContainer" containerID="a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5"
Jul 23 18:06:09.186946 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:06:09.186929    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5\": container with ID starting with a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5 not found: ID does not exist" containerID="a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5"
Jul 23 18:06:09.186995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:09.186957    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5"} err="failed to get container status \"a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5\": rpc error: code = NotFound desc = could not find container \"a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5\": container with ID starting with a44a9778e9bf317fcbfd71458c66e129b1079c7860fe7c773674fb7620cc49f5 not found: ID does not exist"
Jul 23 18:06:09.205854 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:09.205827    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-558ddc5d6f-87gln"]
Jul 23 18:06:09.208023 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:09.208003    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-558ddc5d6f-87gln"]
Jul 23 18:06:10.184363 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:10.184331    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7ac137a-18d9-4a11-8db1-ad0742ba118a" path="/var/lib/kubelet/pods/d7ac137a-18d9-4a11-8db1-ad0742ba118a/volumes"
Jul 23 18:06:53.409888 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:06:53.409803    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:02.378336 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.378302    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:02.479594 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.479558    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:02.977164 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.977131    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"]
Jul 23 18:07:02.977452 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.977440    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7ac137a-18d9-4a11-8db1-ad0742ba118a" containerName="console"
Jul 23 18:07:02.977496 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.977454    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7ac137a-18d9-4a11-8db1-ad0742ba118a" containerName="console"
Jul 23 18:07:02.977496 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.977475    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8885780c-f239-471a-a0e4-20869cca806d" containerName="console"
Jul 23 18:07:02.977496 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.977481    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8885780c-f239-471a-a0e4-20869cca806d" containerName="console"
Jul 23 18:07:02.977641 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.977532    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8885780c-f239-471a-a0e4-20869cca806d" containerName="console"
Jul 23 18:07:02.977641 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.977541    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7ac137a-18d9-4a11-8db1-ad0742ba118a" containerName="console"
Jul 23 18:07:02.980449 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.980432    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:02.983009 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.982984    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 18:07:02.983134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.983022    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5pjtg\""
Jul 23 18:07:02.983134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.983062    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 18:07:02.990377 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:02.990357    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"]
Jul 23 18:07:03.058088 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.058054    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:03.058088 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.058094    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:03.058356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.058196    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47d9j\" (UniqueName: \"kubernetes.io/projected/2403609a-b939-436c-b1e7-32250558486a-kube-api-access-47d9j\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:03.161842 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.161803    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:03.162017 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.161890    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47d9j\" (UniqueName: \"kubernetes.io/projected/2403609a-b939-436c-b1e7-32250558486a-kube-api-access-47d9j\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:03.162017 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.162002    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:03.162189 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.162171    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:03.162297 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.162283    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:03.172632 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.172611    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47d9j\" (UniqueName: \"kubernetes.io/projected/2403609a-b939-436c-b1e7-32250558486a-kube-api-access-47d9j\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:03.289348 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.289262    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:03.419283 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:03.419247    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"]
Jul 23 18:07:03.421653 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:07:03.421626    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2403609a_b939_436c_b1e7_32250558486a.slice/crio-a3f0a83b7351f5475e2693337b57dadaa33eeeb34a0d90db28bc57d1fe90f1d1 WatchSource:0}: Error finding container a3f0a83b7351f5475e2693337b57dadaa33eeeb34a0d90db28bc57d1fe90f1d1: Status 404 returned error can't find the container with id a3f0a83b7351f5475e2693337b57dadaa33eeeb34a0d90db28bc57d1fe90f1d1
Jul 23 18:07:04.387525 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:04.387488    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn" event={"ID":"2403609a-b939-436c-b1e7-32250558486a","Type":"ContainerStarted","Data":"a3f0a83b7351f5475e2693337b57dadaa33eeeb34a0d90db28bc57d1fe90f1d1"}
Jul 23 18:07:10.416040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:10.416004    2574 generic.go:356] "Generic (PLEG): container finished" podID="2403609a-b939-436c-b1e7-32250558486a" containerID="ea646444fe6b8746bc40ce846fd52338cb08d5327751b24cc726ef0a93406a69" exitCode=0
Jul 23 18:07:10.416463 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:10.416063    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn" event={"ID":"2403609a-b939-436c-b1e7-32250558486a","Type":"ContainerDied","Data":"ea646444fe6b8746bc40ce846fd52338cb08d5327751b24cc726ef0a93406a69"}
Jul 23 18:07:13.432139 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:13.432107    2574 generic.go:356] "Generic (PLEG): container finished" podID="2403609a-b939-436c-b1e7-32250558486a" containerID="dfabea009440f53a290d14a185977bc57c04927a1e3c28fccf56be4e878c5160" exitCode=0
Jul 23 18:07:13.432546 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:13.432169    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn" event={"ID":"2403609a-b939-436c-b1e7-32250558486a","Type":"ContainerDied","Data":"dfabea009440f53a290d14a185977bc57c04927a1e3c28fccf56be4e878c5160"}
Jul 23 18:07:20.026952 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:20.026924    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:07:20.027652 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:20.027625    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:07:20.044468 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:20.044439    2574 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 18:07:20.463974 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:20.463941    2574 generic.go:356] "Generic (PLEG): container finished" podID="2403609a-b939-436c-b1e7-32250558486a" containerID="612caa6c4710af0c4b3c6745c7e1fbb584047ef4ac765387778d403bdc1391dd" exitCode=0
Jul 23 18:07:20.464209 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:20.464030    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn" event={"ID":"2403609a-b939-436c-b1e7-32250558486a","Type":"ContainerDied","Data":"612caa6c4710af0c4b3c6745c7e1fbb584047ef4ac765387778d403bdc1391dd"}
Jul 23 18:07:21.594270 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:21.594243    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:21.630502 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:21.630464    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-util\") pod \"2403609a-b939-436c-b1e7-32250558486a\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") "
Jul 23 18:07:21.630685 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:21.630534    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47d9j\" (UniqueName: \"kubernetes.io/projected/2403609a-b939-436c-b1e7-32250558486a-kube-api-access-47d9j\") pod \"2403609a-b939-436c-b1e7-32250558486a\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") "
Jul 23 18:07:21.630685 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:21.630566    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-bundle\") pod \"2403609a-b939-436c-b1e7-32250558486a\" (UID: \"2403609a-b939-436c-b1e7-32250558486a\") "
Jul 23 18:07:21.631308 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:21.631283    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-bundle" (OuterVolumeSpecName: "bundle") pod "2403609a-b939-436c-b1e7-32250558486a" (UID: "2403609a-b939-436c-b1e7-32250558486a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:07:21.632830 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:21.632801    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2403609a-b939-436c-b1e7-32250558486a-kube-api-access-47d9j" (OuterVolumeSpecName: "kube-api-access-47d9j") pod "2403609a-b939-436c-b1e7-32250558486a" (UID: "2403609a-b939-436c-b1e7-32250558486a"). InnerVolumeSpecName "kube-api-access-47d9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:07:21.635621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:21.635600    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-util" (OuterVolumeSpecName: "util") pod "2403609a-b939-436c-b1e7-32250558486a" (UID: "2403609a-b939-436c-b1e7-32250558486a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:07:21.731548 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:21.731461    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-util\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:07:21.731548 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:21.731494    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47d9j\" (UniqueName: \"kubernetes.io/projected/2403609a-b939-436c-b1e7-32250558486a-kube-api-access-47d9j\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:07:21.731548 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:21.731526    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2403609a-b939-436c-b1e7-32250558486a-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:07:22.474024 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:22.473951    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn"
Jul 23 18:07:22.474159 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:22.473955    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qmlzn" event={"ID":"2403609a-b939-436c-b1e7-32250558486a","Type":"ContainerDied","Data":"a3f0a83b7351f5475e2693337b57dadaa33eeeb34a0d90db28bc57d1fe90f1d1"}
Jul 23 18:07:22.474159 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:22.474059    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3f0a83b7351f5475e2693337b57dadaa33eeeb34a0d90db28bc57d1fe90f1d1"
Jul 23 18:07:23.768579 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:23.768549    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:25.504307 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.504274    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:25.752539 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.752501    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"]
Jul 23 18:07:25.752919 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.752903    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2403609a-b939-436c-b1e7-32250558486a" containerName="pull"
Jul 23 18:07:25.753012 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.752922    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2403609a-b939-436c-b1e7-32250558486a" containerName="pull"
Jul 23 18:07:25.753012 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.752946    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2403609a-b939-436c-b1e7-32250558486a" containerName="extract"
Jul 23 18:07:25.753012 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.752954    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2403609a-b939-436c-b1e7-32250558486a" containerName="extract"
Jul 23 18:07:25.753012 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.752977    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2403609a-b939-436c-b1e7-32250558486a" containerName="util"
Jul 23 18:07:25.753012 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.752985    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2403609a-b939-436c-b1e7-32250558486a" containerName="util"
Jul 23 18:07:25.753264 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.753079    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2403609a-b939-436c-b1e7-32250558486a" containerName="extract"
Jul 23 18:07:25.797190 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.797088    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"]
Jul 23 18:07:25.797349 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.797238    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"
Jul 23 18:07:25.800072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.800043    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 23 18:07:25.800211 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.800045    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:07:25.800211 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.800111    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-s8678\""
Jul 23 18:07:25.871403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.871367    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8d4b8ea-a742-4ad7-81aa-53a0e666eca5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zs92z\" (UID: \"a8d4b8ea-a742-4ad7-81aa-53a0e666eca5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"
Jul 23 18:07:25.871613 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.871413    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r98sh\" (UniqueName: \"kubernetes.io/projected/a8d4b8ea-a742-4ad7-81aa-53a0e666eca5-kube-api-access-r98sh\") pod \"cert-manager-operator-controller-manager-55c444bf86-zs92z\" (UID: \"a8d4b8ea-a742-4ad7-81aa-53a0e666eca5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"
Jul 23 18:07:25.972314 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.972282    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8d4b8ea-a742-4ad7-81aa-53a0e666eca5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zs92z\" (UID: \"a8d4b8ea-a742-4ad7-81aa-53a0e666eca5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"
Jul 23 18:07:25.972464 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.972336    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r98sh\" (UniqueName: \"kubernetes.io/projected/a8d4b8ea-a742-4ad7-81aa-53a0e666eca5-kube-api-access-r98sh\") pod \"cert-manager-operator-controller-manager-55c444bf86-zs92z\" (UID: \"a8d4b8ea-a742-4ad7-81aa-53a0e666eca5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"
Jul 23 18:07:25.972728 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.972705    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a8d4b8ea-a742-4ad7-81aa-53a0e666eca5-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zs92z\" (UID: \"a8d4b8ea-a742-4ad7-81aa-53a0e666eca5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"
Jul 23 18:07:25.983318 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:25.983288    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r98sh\" (UniqueName: \"kubernetes.io/projected/a8d4b8ea-a742-4ad7-81aa-53a0e666eca5-kube-api-access-r98sh\") pod \"cert-manager-operator-controller-manager-55c444bf86-zs92z\" (UID: \"a8d4b8ea-a742-4ad7-81aa-53a0e666eca5\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"
Jul 23 18:07:26.106729 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:26.106694    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"
Jul 23 18:07:26.261611 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:26.261585    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z"]
Jul 23 18:07:26.264373 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:07:26.264341    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d4b8ea_a742_4ad7_81aa_53a0e666eca5.slice/crio-cc286a6aafe41aa2f8ce418fb59542b37b7e73bfe9776d4a8d4dd6af579d045b WatchSource:0}: Error finding container cc286a6aafe41aa2f8ce418fb59542b37b7e73bfe9776d4a8d4dd6af579d045b: Status 404 returned error can't find the container with id cc286a6aafe41aa2f8ce418fb59542b37b7e73bfe9776d4a8d4dd6af579d045b
Jul 23 18:07:26.267044 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:26.267026    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:07:26.494445 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:26.494358    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z" event={"ID":"a8d4b8ea-a742-4ad7-81aa-53a0e666eca5","Type":"ContainerStarted","Data":"cc286a6aafe41aa2f8ce418fb59542b37b7e73bfe9776d4a8d4dd6af579d045b"}
Jul 23 18:07:27.383430 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:27.383392    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:27.610219 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:27.610176    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:28.506136 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:28.506100    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z" event={"ID":"a8d4b8ea-a742-4ad7-81aa-53a0e666eca5","Type":"ContainerStarted","Data":"64a10e274c8860a64164dc4c04ac94d5d9e3a21be1256b9d6248f063ac1410ae"}
Jul 23 18:07:28.528459 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:28.528411    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zs92z" podStartSLOduration=1.4313675209999999 podStartE2EDuration="3.528393867s" totalImagesPullingTime="2.097026346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:28.526625316 +0000 UTC m=+308.889469167" watchObservedRunningTime="2026-07-23 18:07:28.528393867 +0000 UTC m=+308.891237716"
Jul 23 18:07:28.971565 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:28.971527    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:29.070728 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.070693    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:29.281192 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.281094    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:29.387655 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.387614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:29.793469 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.793428    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"]
Jul 23 18:07:29.815494 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.815456    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"]
Jul 23 18:07:29.815676 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.815601    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:29.818514 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.818485    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 18:07:29.818638 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.818523    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5pjtg\""
Jul 23 18:07:29.819255 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.819196    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 18:07:29.903117 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.903072    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsfh8\" (UniqueName: \"kubernetes.io/projected/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-kube-api-access-wsfh8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:29.903324 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.903142    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:29.903324 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:29.903194    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:30.004330 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.004293    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:30.004498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.004357    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsfh8\" (UniqueName: \"kubernetes.io/projected/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-kube-api-access-wsfh8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:30.004498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.004417    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:30.004783 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.004760    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:30.004819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.004773    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:30.018827 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.018789    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsfh8\" (UniqueName: \"kubernetes.io/projected/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-kube-api-access-wsfh8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:30.125591 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.125551    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:30.264836 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.264801    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"]
Jul 23 18:07:30.267677 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:07:30.267649    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod283c214f_c1b8_4e58_a0a9_7472a0ebec4b.slice/crio-a4f048d9a5effea67e48859aaf77457757f9d7fd5c371b62ca4c4f9d3aa24e41 WatchSource:0}: Error finding container a4f048d9a5effea67e48859aaf77457757f9d7fd5c371b62ca4c4f9d3aa24e41: Status 404 returned error can't find the container with id a4f048d9a5effea67e48859aaf77457757f9d7fd5c371b62ca4c4f9d3aa24e41
Jul 23 18:07:30.516580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.516491    2574 generic.go:356] "Generic (PLEG): container finished" podID="283c214f-c1b8-4e58-a0a9-7472a0ebec4b" containerID="04eadad647e33df311addd1cabfba89dd86ac0146b1efb0c9d7e06b75a97e34e" exitCode=0
Jul 23 18:07:30.516580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.516562    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl" event={"ID":"283c214f-c1b8-4e58-a0a9-7472a0ebec4b","Type":"ContainerDied","Data":"04eadad647e33df311addd1cabfba89dd86ac0146b1efb0c9d7e06b75a97e34e"}
Jul 23 18:07:30.516847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:30.516612    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl" event={"ID":"283c214f-c1b8-4e58-a0a9-7472a0ebec4b","Type":"ContainerStarted","Data":"a4f048d9a5effea67e48859aaf77457757f9d7fd5c371b62ca4c4f9d3aa24e41"}
Jul 23 18:07:31.702780 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:31.702746    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:32.126846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.126813    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"]
Jul 23 18:07:32.133058 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.133026    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"
Jul 23 18:07:32.135990 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.135898    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 18:07:32.135990 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.135921    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-djlsk\""
Jul 23 18:07:32.136853 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.136837    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 18:07:32.142338 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.142266    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"]
Jul 23 18:07:32.225090 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.225050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mbm\" (UniqueName: \"kubernetes.io/projected/224f806a-505e-49e3-b858-c0863f1f62d3-kube-api-access-65mbm\") pod \"cert-manager-cainjector-559cdd8c87-zmsdw\" (UID: \"224f806a-505e-49e3-b858-c0863f1f62d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"
Jul 23 18:07:32.225308 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.225240    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/224f806a-505e-49e3-b858-c0863f1f62d3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zmsdw\" (UID: \"224f806a-505e-49e3-b858-c0863f1f62d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"
Jul 23 18:07:32.251864 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.251820    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:32.326117 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.326080    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/224f806a-505e-49e3-b858-c0863f1f62d3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zmsdw\" (UID: \"224f806a-505e-49e3-b858-c0863f1f62d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"
Jul 23 18:07:32.326305 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.326163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mbm\" (UniqueName: \"kubernetes.io/projected/224f806a-505e-49e3-b858-c0863f1f62d3-kube-api-access-65mbm\") pod \"cert-manager-cainjector-559cdd8c87-zmsdw\" (UID: \"224f806a-505e-49e3-b858-c0863f1f62d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"
Jul 23 18:07:32.336724 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.336685    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/224f806a-505e-49e3-b858-c0863f1f62d3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zmsdw\" (UID: \"224f806a-505e-49e3-b858-c0863f1f62d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"
Jul 23 18:07:32.336876 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.336802    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mbm\" (UniqueName: \"kubernetes.io/projected/224f806a-505e-49e3-b858-c0863f1f62d3-kube-api-access-65mbm\") pod \"cert-manager-cainjector-559cdd8c87-zmsdw\" (UID: \"224f806a-505e-49e3-b858-c0863f1f62d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"
Jul 23 18:07:32.456701 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.456584    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"
Jul 23 18:07:32.680744 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:32.680720    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw"]
Jul 23 18:07:32.682810 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:07:32.682779    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod224f806a_505e_49e3_b858_c0863f1f62d3.slice/crio-fb57cc6d95178979cc9d0d6298f5ca265b47e53c2293c5cc1d43c5c437605726 WatchSource:0}: Error finding container fb57cc6d95178979cc9d0d6298f5ca265b47e53c2293c5cc1d43c5c437605726: Status 404 returned error can't find the container with id fb57cc6d95178979cc9d0d6298f5ca265b47e53c2293c5cc1d43c5c437605726
Jul 23 18:07:33.529588 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:33.529556    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw" event={"ID":"224f806a-505e-49e3-b858-c0863f1f62d3","Type":"ContainerStarted","Data":"fb57cc6d95178979cc9d0d6298f5ca265b47e53c2293c5cc1d43c5c437605726"}
Jul 23 18:07:33.531125 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:33.531103    2574 generic.go:356] "Generic (PLEG): container finished" podID="283c214f-c1b8-4e58-a0a9-7472a0ebec4b" containerID="7bf6e65ee0538d7e08c1308e594dde0e58505213b3caed768a44b3741d3911c2" exitCode=0
Jul 23 18:07:33.531273 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:33.531140    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl" event={"ID":"283c214f-c1b8-4e58-a0a9-7472a0ebec4b","Type":"ContainerDied","Data":"7bf6e65ee0538d7e08c1308e594dde0e58505213b3caed768a44b3741d3911c2"}
Jul 23 18:07:34.171721 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:34.171687    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:34.513459 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:34.513340    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:34.540327 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:34.540292    2574 generic.go:356] "Generic (PLEG): container finished" podID="283c214f-c1b8-4e58-a0a9-7472a0ebec4b" containerID="3a8ede9b3f87277add199148285736c8ae2bbae1819fd6e679f2664c08d1b322" exitCode=0
Jul 23 18:07:34.540688 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:34.540345    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl" event={"ID":"283c214f-c1b8-4e58-a0a9-7472a0ebec4b","Type":"ContainerDied","Data":"3a8ede9b3f87277add199148285736c8ae2bbae1819fd6e679f2664c08d1b322"}
Jul 23 18:07:36.552685 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.552656    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl" event={"ID":"283c214f-c1b8-4e58-a0a9-7472a0ebec4b","Type":"ContainerDied","Data":"a4f048d9a5effea67e48859aaf77457757f9d7fd5c371b62ca4c4f9d3aa24e41"}
Jul 23 18:07:36.552979 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.552710    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4f048d9a5effea67e48859aaf77457757f9d7fd5c371b62ca4c4f9d3aa24e41"
Jul 23 18:07:36.565843 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.565821    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:36.663734 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.663704    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-bundle\") pod \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") "
Jul 23 18:07:36.663883 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.663745    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-util\") pod \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") "
Jul 23 18:07:36.663883 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.663779    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsfh8\" (UniqueName: \"kubernetes.io/projected/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-kube-api-access-wsfh8\") pod \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\" (UID: \"283c214f-c1b8-4e58-a0a9-7472a0ebec4b\") "
Jul 23 18:07:36.664087 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.664063    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-bundle" (OuterVolumeSpecName: "bundle") pod "283c214f-c1b8-4e58-a0a9-7472a0ebec4b" (UID: "283c214f-c1b8-4e58-a0a9-7472a0ebec4b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:07:36.665954 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.665922    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-kube-api-access-wsfh8" (OuterVolumeSpecName: "kube-api-access-wsfh8") pod "283c214f-c1b8-4e58-a0a9-7472a0ebec4b" (UID: "283c214f-c1b8-4e58-a0a9-7472a0ebec4b"). InnerVolumeSpecName "kube-api-access-wsfh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:07:36.668076 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.668054    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-util" (OuterVolumeSpecName: "util") pod "283c214f-c1b8-4e58-a0a9-7472a0ebec4b" (UID: "283c214f-c1b8-4e58-a0a9-7472a0ebec4b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:07:36.764758 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.764721    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:07:36.764758 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.764750    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-util\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:07:36.764758 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:36.764759    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsfh8\" (UniqueName: \"kubernetes.io/projected/283c214f-c1b8-4e58-a0a9-7472a0ebec4b-kube-api-access-wsfh8\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:07:37.404487 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:37.404442    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:37.559219 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:37.559182    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk26bl"
Jul 23 18:07:37.559645 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:37.559175    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw" event={"ID":"224f806a-505e-49e3-b858-c0863f1f62d3","Type":"ContainerStarted","Data":"6bf08a77d7d0e00d7bcd0ea8feaddf969ab38aac280a2cce3d4f87e15e38310e"}
Jul 23 18:07:37.574149 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:37.574107    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zmsdw" podStartSLOduration=1.677215106 podStartE2EDuration="5.574090586s" totalImagesPullingTime="3.89687548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:37.573896934 +0000 UTC m=+317.936740783" watchObservedRunningTime="2026-07-23 18:07:37.574090586 +0000 UTC m=+317.936934434"
Jul 23 18:07:39.306183 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:39.306147    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:42.009372 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:42.009333    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:42.108683 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:42.108651    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:43.874100 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.874064    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"]
Jul 23 18:07:43.874503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.874375    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="283c214f-c1b8-4e58-a0a9-7472a0ebec4b" containerName="util"
Jul 23 18:07:43.874503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.874386    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="283c214f-c1b8-4e58-a0a9-7472a0ebec4b" containerName="util"
Jul 23 18:07:43.874503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.874404    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="283c214f-c1b8-4e58-a0a9-7472a0ebec4b" containerName="extract"
Jul 23 18:07:43.874503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.874409    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="283c214f-c1b8-4e58-a0a9-7472a0ebec4b" containerName="extract"
Jul 23 18:07:43.874503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.874418    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="283c214f-c1b8-4e58-a0a9-7472a0ebec4b" containerName="pull"
Jul 23 18:07:43.874503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.874424    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="283c214f-c1b8-4e58-a0a9-7472a0ebec4b" containerName="pull"
Jul 23 18:07:43.874503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.874484    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="283c214f-c1b8-4e58-a0a9-7472a0ebec4b" containerName="extract"
Jul 23 18:07:43.877322 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.877306    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"
Jul 23 18:07:43.879755 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.879735    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 18:07:43.880571 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.880553    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 18:07:43.880678 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.880559    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jdxpw\""
Jul 23 18:07:43.887569 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:43.887544    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"]
Jul 23 18:07:44.029760 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:44.029726    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ba8dfbb-87f4-409b-92b6-bab37660b880-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x2dkl\" (UID: \"0ba8dfbb-87f4-409b-92b6-bab37660b880\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"
Jul 23 18:07:44.029925 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:44.029800    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwk6x\" (UniqueName: \"kubernetes.io/projected/0ba8dfbb-87f4-409b-92b6-bab37660b880-kube-api-access-fwk6x\") pod \"openshift-lws-operator-fd8ccff4c-x2dkl\" (UID: \"0ba8dfbb-87f4-409b-92b6-bab37660b880\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"
Jul 23 18:07:44.131132 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:44.131048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwk6x\" (UniqueName: \"kubernetes.io/projected/0ba8dfbb-87f4-409b-92b6-bab37660b880-kube-api-access-fwk6x\") pod \"openshift-lws-operator-fd8ccff4c-x2dkl\" (UID: \"0ba8dfbb-87f4-409b-92b6-bab37660b880\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"
Jul 23 18:07:44.131132 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:44.131111    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ba8dfbb-87f4-409b-92b6-bab37660b880-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x2dkl\" (UID: \"0ba8dfbb-87f4-409b-92b6-bab37660b880\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"
Jul 23 18:07:44.131500 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:44.131482    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0ba8dfbb-87f4-409b-92b6-bab37660b880-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x2dkl\" (UID: \"0ba8dfbb-87f4-409b-92b6-bab37660b880\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"
Jul 23 18:07:44.139450 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:44.139427    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwk6x\" (UniqueName: \"kubernetes.io/projected/0ba8dfbb-87f4-409b-92b6-bab37660b880-kube-api-access-fwk6x\") pod \"openshift-lws-operator-fd8ccff4c-x2dkl\" (UID: \"0ba8dfbb-87f4-409b-92b6-bab37660b880\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"
Jul 23 18:07:44.185839 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:44.185814    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"
Jul 23 18:07:44.316219 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:44.316194    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl"]
Jul 23 18:07:44.318299 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:07:44.318273    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ba8dfbb_87f4_409b_92b6_bab37660b880.slice/crio-63a51d2adfbac34509a6f0395f7f04e33ccbc363b4f68fc1079f589d8ac121ea WatchSource:0}: Error finding container 63a51d2adfbac34509a6f0395f7f04e33ccbc363b4f68fc1079f589d8ac121ea: Status 404 returned error can't find the container with id 63a51d2adfbac34509a6f0395f7f04e33ccbc363b4f68fc1079f589d8ac121ea
Jul 23 18:07:44.592811 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:44.592780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl" event={"ID":"0ba8dfbb-87f4-409b-92b6-bab37660b880","Type":"ContainerStarted","Data":"63a51d2adfbac34509a6f0395f7f04e33ccbc363b4f68fc1079f589d8ac121ea"}
Jul 23 18:07:54.639130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:54.639089    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl" event={"ID":"0ba8dfbb-87f4-409b-92b6-bab37660b880","Type":"ContainerStarted","Data":"ddd1a27455d3ecf0834ee7a4796908180db848405b76bc76535624bfe89ea91b"}
Jul 23 18:07:54.657813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:54.657760    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x2dkl" podStartSLOduration=1.673274826 podStartE2EDuration="11.657744084s" totalImagesPullingTime="9.984469258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:54.657513697 +0000 UTC m=+335.020357582" watchObservedRunningTime="2026-07-23 18:07:54.657744084 +0000 UTC m=+335.020587933"
Jul 23 18:07:55.420671 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:55.420634    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:55.531582 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:55.531546    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:57.145610 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.145578    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"]
Jul 23 18:07:57.149174 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.149158    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.152072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.152044    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5pjtg\""
Jul 23 18:07:57.152873 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.152855    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 18:07:57.152991 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.152855    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 18:07:57.162815 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.162790    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"]
Jul 23 18:07:57.242510 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.242471    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.242510 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.242516    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.242713 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.242621    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhxsp\" (UniqueName: \"kubernetes.io/projected/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-kube-api-access-nhxsp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.343767 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.343730    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhxsp\" (UniqueName: \"kubernetes.io/projected/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-kube-api-access-nhxsp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.343959 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.343822    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.343959 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.343870    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.344308 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.344286    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.344362 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.344306    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.353603 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.353577    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhxsp\" (UniqueName: \"kubernetes.io/projected/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-kube-api-access-nhxsp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.457860 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.457765    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:07:57.613964 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.613937    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"]
Jul 23 18:07:57.615714 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:07:57.615688    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae1b0a7_492e_4c93_a43d_b1efdfebff87.slice/crio-ac79f79a543025e408eb2148ea0976bec6896bd307fd34a51213d173dffe1975 WatchSource:0}: Error finding container ac79f79a543025e408eb2148ea0976bec6896bd307fd34a51213d173dffe1975: Status 404 returned error can't find the container with id ac79f79a543025e408eb2148ea0976bec6896bd307fd34a51213d173dffe1975
Jul 23 18:07:57.634947 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.634920    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:07:57.653894 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:57.653868    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5" event={"ID":"8ae1b0a7-492e-4c93-a43d-b1efdfebff87","Type":"ContainerStarted","Data":"ac79f79a543025e408eb2148ea0976bec6896bd307fd34a51213d173dffe1975"}
Jul 23 18:07:58.664746 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:58.664665    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ae1b0a7-492e-4c93-a43d-b1efdfebff87" containerID="d43332feceae08b1b8a22a831e907f73dbb88679a75dca70e17318641eaa84ee" exitCode=0
Jul 23 18:07:58.665111 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:58.664751    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5" event={"ID":"8ae1b0a7-492e-4c93-a43d-b1efdfebff87","Type":"ContainerDied","Data":"d43332feceae08b1b8a22a831e907f73dbb88679a75dca70e17318641eaa84ee"}
Jul 23 18:07:59.670798 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:59.670768    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ae1b0a7-492e-4c93-a43d-b1efdfebff87" containerID="43ee28dfa6ae447047b27bf23514eff51a1314edd8a84ed18b286d6298d2f9ea" exitCode=0
Jul 23 18:07:59.671150 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:07:59.670805    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5" event={"ID":"8ae1b0a7-492e-4c93-a43d-b1efdfebff87","Type":"ContainerDied","Data":"43ee28dfa6ae447047b27bf23514eff51a1314edd8a84ed18b286d6298d2f9ea"}
Jul 23 18:08:00.677235 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:00.677194    2574 generic.go:356] "Generic (PLEG): container finished" podID="8ae1b0a7-492e-4c93-a43d-b1efdfebff87" containerID="baf8f7c8f5eec15086a88bb98b9cc8c4a9c4ffdbd9326fda589938b4d3d00ee5" exitCode=0
Jul 23 18:08:00.677623 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:00.677248    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5" event={"ID":"8ae1b0a7-492e-4c93-a43d-b1efdfebff87","Type":"ContainerDied","Data":"baf8f7c8f5eec15086a88bb98b9cc8c4a9c4ffdbd9326fda589938b4d3d00ee5"}
Jul 23 18:08:01.808403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:01.808379    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:08:01.886247 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:01.886199    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-bundle\") pod \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") "
Jul 23 18:08:01.886424 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:01.886265    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhxsp\" (UniqueName: \"kubernetes.io/projected/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-kube-api-access-nhxsp\") pod \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") "
Jul 23 18:08:01.886424 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:01.886299    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-util\") pod \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\" (UID: \"8ae1b0a7-492e-4c93-a43d-b1efdfebff87\") "
Jul 23 18:08:01.886951 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:01.886923    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-bundle" (OuterVolumeSpecName: "bundle") pod "8ae1b0a7-492e-4c93-a43d-b1efdfebff87" (UID: "8ae1b0a7-492e-4c93-a43d-b1efdfebff87"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:08:01.888307 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:01.888283    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-kube-api-access-nhxsp" (OuterVolumeSpecName: "kube-api-access-nhxsp") pod "8ae1b0a7-492e-4c93-a43d-b1efdfebff87" (UID: "8ae1b0a7-492e-4c93-a43d-b1efdfebff87"). InnerVolumeSpecName "kube-api-access-nhxsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:08:01.891927 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:01.891906    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-util" (OuterVolumeSpecName: "util") pod "8ae1b0a7-492e-4c93-a43d-b1efdfebff87" (UID: "8ae1b0a7-492e-4c93-a43d-b1efdfebff87"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:08:01.987555 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:01.987468    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-util\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:08:01.987555 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:01.987499    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:08:01.987555 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:01.987508    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhxsp\" (UniqueName: \"kubernetes.io/projected/8ae1b0a7-492e-4c93-a43d-b1efdfebff87-kube-api-access-nhxsp\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:08:02.688778 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:02.688745    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5"
Jul 23 18:08:02.688945 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:02.688744    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afkjzb5" event={"ID":"8ae1b0a7-492e-4c93-a43d-b1efdfebff87","Type":"ContainerDied","Data":"ac79f79a543025e408eb2148ea0976bec6896bd307fd34a51213d173dffe1975"}
Jul 23 18:08:02.688945 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:02.688899    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ac79f79a543025e408eb2148ea0976bec6896bd307fd34a51213d173dffe1975"
Jul 23 18:08:09.910408 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:09.910369    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:09.980074 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:09.980040    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:13.007829 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:13.007752    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:13.103268 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:13.103208    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:13.615162 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:13.615120    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:13.901750 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:13.901654    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:14.000846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.000811    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:14.032391 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.032355    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"]
Jul 23 18:08:14.032763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.032667    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae1b0a7-492e-4c93-a43d-b1efdfebff87" containerName="util"
Jul 23 18:08:14.032763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.032678    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae1b0a7-492e-4c93-a43d-b1efdfebff87" containerName="util"
Jul 23 18:08:14.032763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.032687    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae1b0a7-492e-4c93-a43d-b1efdfebff87" containerName="pull"
Jul 23 18:08:14.032763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.032692    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae1b0a7-492e-4c93-a43d-b1efdfebff87" containerName="pull"
Jul 23 18:08:14.032763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.032713    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae1b0a7-492e-4c93-a43d-b1efdfebff87" containerName="extract"
Jul 23 18:08:14.032763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.032720    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae1b0a7-492e-4c93-a43d-b1efdfebff87" containerName="extract"
Jul 23 18:08:14.032945 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.032773    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae1b0a7-492e-4c93-a43d-b1efdfebff87" containerName="extract"
Jul 23 18:08:14.034659 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.034643    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.037730 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.037691    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kfsfm\""
Jul 23 18:08:14.037876 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.037849    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 18:08:14.037876 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.037859    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 18:08:14.038008 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.037923    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 18:08:14.038270 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.038254    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 18:08:14.052730 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.052701    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"]
Jul 23 18:08:14.094123 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.094091    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a70bf0f-d407-407d-aef9-c6a8e87cae46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.094317 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.094131    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a70bf0f-d407-407d-aef9-c6a8e87cae46-manifests\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.094317 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.094261    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a70bf0f-d407-407d-aef9-c6a8e87cae46-tmp\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.094317 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.094307    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a70bf0f-d407-407d-aef9-c6a8e87cae46-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.094445 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.094333    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l7zg\" (UniqueName: \"kubernetes.io/projected/5a70bf0f-d407-407d-aef9-c6a8e87cae46-kube-api-access-4l7zg\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.194932 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.194857    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a70bf0f-d407-407d-aef9-c6a8e87cae46-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.194932 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.194891    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l7zg\" (UniqueName: \"kubernetes.io/projected/5a70bf0f-d407-407d-aef9-c6a8e87cae46-kube-api-access-4l7zg\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.194932 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.194927    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a70bf0f-d407-407d-aef9-c6a8e87cae46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.195157 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.195113    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a70bf0f-d407-407d-aef9-c6a8e87cae46-manifests\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.195235 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.195208    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a70bf0f-d407-407d-aef9-c6a8e87cae46-tmp\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.195513 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.195491    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5a70bf0f-d407-407d-aef9-c6a8e87cae46-manifests\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.197319 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.197286    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a70bf0f-d407-407d-aef9-c6a8e87cae46-tmp\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.197434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.197365    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5a70bf0f-d407-407d-aef9-c6a8e87cae46-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.197434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.197374    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a70bf0f-d407-407d-aef9-c6a8e87cae46-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.201617 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.201590    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:14.204281 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.204257    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l7zg\" (UniqueName: \"kubernetes.io/projected/5a70bf0f-d407-407d-aef9-c6a8e87cae46-kube-api-access-4l7zg\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-hw578\" (UID: \"5a70bf0f-d407-407d-aef9-c6a8e87cae46\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.299385 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.299354    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:14.345490 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.345454    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:14.401551 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.401520    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:14.485639 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.485595    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"]
Jul 23 18:08:14.488040 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:08:14.488013    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a70bf0f_d407_407d_aef9_c6a8e87cae46.slice/crio-135cb7f1acb3898a924617f04852d72d4259836bbe763ee7c04d1c8da1b851a9 WatchSource:0}: Error finding container 135cb7f1acb3898a924617f04852d72d4259836bbe763ee7c04d1c8da1b851a9: Status 404 returned error can't find the container with id 135cb7f1acb3898a924617f04852d72d4259836bbe763ee7c04d1c8da1b851a9
Jul 23 18:08:14.488583 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.488538    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:14.559988 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.559950    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:14.653000 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.652970    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:14.744634 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:14.744545    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578" event={"ID":"5a70bf0f-d407-407d-aef9-c6a8e87cae46","Type":"ContainerStarted","Data":"135cb7f1acb3898a924617f04852d72d4259836bbe763ee7c04d1c8da1b851a9"}
Jul 23 18:08:17.762264 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:17.762217    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578" event={"ID":"5a70bf0f-d407-407d-aef9-c6a8e87cae46","Type":"ContainerStarted","Data":"6ba4e7072687aac1d5fb570905c448841b2ec5036f82b477ca94b89aac2a9e96"}
Jul 23 18:08:18.768070 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:18.768037    2574 generic.go:356] "Generic (PLEG): container finished" podID="5a70bf0f-d407-407d-aef9-c6a8e87cae46" containerID="6ba4e7072687aac1d5fb570905c448841b2ec5036f82b477ca94b89aac2a9e96" exitCode=0
Jul 23 18:08:18.768462 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:18.768076    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578" event={"ID":"5a70bf0f-d407-407d-aef9-c6a8e87cae46","Type":"ContainerDied","Data":"6ba4e7072687aac1d5fb570905c448841b2ec5036f82b477ca94b89aac2a9e96"}
Jul 23 18:08:19.775415 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:19.775379    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578" event={"ID":"5a70bf0f-d407-407d-aef9-c6a8e87cae46","Type":"ContainerStarted","Data":"cc91654ecc3ffb7447a10760b9cb6e0f7ff6c452eed48433fabc6deb0189c554"}
Jul 23 18:08:19.775816 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:19.775470    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:19.811240 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:19.811151    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578" podStartSLOduration=1.349597277 podStartE2EDuration="5.811124854s" totalImagesPullingTime="3.425667871s" totalInitContainerRuntime="1.035859706s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:19.808139655 +0000 UTC m=+360.170983504" watchObservedRunningTime="2026-07-23 18:08:19.811124854 +0000 UTC m=+360.173968706"
Jul 23 18:08:30.783537 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:30.783504    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-hw578"
Jul 23 18:08:33.629378 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:33.629331    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:33.746731 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:33.746697    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:37.411205 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.411166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:37.496493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.496451    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"]
Jul 23 18:08:37.502193 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.502168    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.505962 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.505936    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 18:08:37.506152 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.506130    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n4vrt\""
Jul 23 18:08:37.506991 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.506976    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 18:08:37.512675 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.512654    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"]
Jul 23 18:08:37.559104 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.559068    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:37.605791 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.605751    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gqnqb"]
Jul 23 18:08:37.607029 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.607001    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138be5b4-c9da-4a03-bc52-f4f97ff6f78d-tls-certs\") pod \"kube-auth-proxy-84ccbf468f-5g6m2\" (UID: \"138be5b4-c9da-4a03-bc52-f4f97ff6f78d\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.607029 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.607028    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/138be5b4-c9da-4a03-bc52-f4f97ff6f78d-tmp\") pod \"kube-auth-proxy-84ccbf468f-5g6m2\" (UID: \"138be5b4-c9da-4a03-bc52-f4f97ff6f78d\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.607187 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.607092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7887v\" (UniqueName: \"kubernetes.io/projected/138be5b4-c9da-4a03-bc52-f4f97ff6f78d-kube-api-access-7887v\") pod \"kube-auth-proxy-84ccbf468f-5g6m2\" (UID: \"138be5b4-c9da-4a03-bc52-f4f97ff6f78d\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.608129 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.608112    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:37.610907 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.610889    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 18:08:37.611209 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.611194    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7mb6j\""
Jul 23 18:08:37.621897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.621874    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gqnqb"]
Jul 23 18:08:37.633915 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.633888    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:37.708535 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.708448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7887v\" (UniqueName: \"kubernetes.io/projected/138be5b4-c9da-4a03-bc52-f4f97ff6f78d-kube-api-access-7887v\") pod \"kube-auth-proxy-84ccbf468f-5g6m2\" (UID: \"138be5b4-c9da-4a03-bc52-f4f97ff6f78d\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.708697 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.708542    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdgfg\" (UniqueName: \"kubernetes.io/projected/74967bc8-0d98-4f92-814b-a338a0991e8a-kube-api-access-zdgfg\") pod \"odh-model-controller-7998c67dc4-gqnqb\" (UID: \"74967bc8-0d98-4f92-814b-a338a0991e8a\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:37.708697 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.708590    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138be5b4-c9da-4a03-bc52-f4f97ff6f78d-tls-certs\") pod \"kube-auth-proxy-84ccbf468f-5g6m2\" (UID: \"138be5b4-c9da-4a03-bc52-f4f97ff6f78d\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.708697 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.708605    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/138be5b4-c9da-4a03-bc52-f4f97ff6f78d-tmp\") pod \"kube-auth-proxy-84ccbf468f-5g6m2\" (UID: \"138be5b4-c9da-4a03-bc52-f4f97ff6f78d\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.708862 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.708694    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74967bc8-0d98-4f92-814b-a338a0991e8a-cert\") pod \"odh-model-controller-7998c67dc4-gqnqb\" (UID: \"74967bc8-0d98-4f92-814b-a338a0991e8a\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:37.711067 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.711044    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/138be5b4-c9da-4a03-bc52-f4f97ff6f78d-tmp\") pod \"kube-auth-proxy-84ccbf468f-5g6m2\" (UID: \"138be5b4-c9da-4a03-bc52-f4f97ff6f78d\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.711404 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.711384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/138be5b4-c9da-4a03-bc52-f4f97ff6f78d-tls-certs\") pod \"kube-auth-proxy-84ccbf468f-5g6m2\" (UID: \"138be5b4-c9da-4a03-bc52-f4f97ff6f78d\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.724686 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.724661    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7887v\" (UniqueName: \"kubernetes.io/projected/138be5b4-c9da-4a03-bc52-f4f97ff6f78d-kube-api-access-7887v\") pod \"kube-auth-proxy-84ccbf468f-5g6m2\" (UID: \"138be5b4-c9da-4a03-bc52-f4f97ff6f78d\") " pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.746124 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.746095    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:37.809705 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.809665    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdgfg\" (UniqueName: \"kubernetes.io/projected/74967bc8-0d98-4f92-814b-a338a0991e8a-kube-api-access-zdgfg\") pod \"odh-model-controller-7998c67dc4-gqnqb\" (UID: \"74967bc8-0d98-4f92-814b-a338a0991e8a\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:37.809869 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.809732    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74967bc8-0d98-4f92-814b-a338a0991e8a-cert\") pod \"odh-model-controller-7998c67dc4-gqnqb\" (UID: \"74967bc8-0d98-4f92-814b-a338a0991e8a\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:37.809869 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:08:37.809865    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 18:08:37.809943 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:08:37.809920    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74967bc8-0d98-4f92-814b-a338a0991e8a-cert podName:74967bc8-0d98-4f92-814b-a338a0991e8a nodeName:}" failed. No retries permitted until 2026-07-23 18:08:38.30990229 +0000 UTC m=+378.672746117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74967bc8-0d98-4f92-814b-a338a0991e8a-cert") pod "odh-model-controller-7998c67dc4-gqnqb" (UID: "74967bc8-0d98-4f92-814b-a338a0991e8a") : secret "odh-model-controller-webhook-cert" not found
Jul 23 18:08:37.813489 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.813471    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"
Jul 23 18:08:37.822567 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.822543    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdgfg\" (UniqueName: \"kubernetes.io/projected/74967bc8-0d98-4f92-814b-a338a0991e8a-kube-api-access-zdgfg\") pod \"odh-model-controller-7998c67dc4-gqnqb\" (UID: \"74967bc8-0d98-4f92-814b-a338a0991e8a\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:37.850345 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.850306    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:37.943508 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.943475    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:37.963641 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:37.963612    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2"]
Jul 23 18:08:37.966189 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:08:37.966162    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138be5b4_c9da_4a03_bc52_f4f97ff6f78d.slice/crio-1b8a9145ad77ecb9ab068130502b6a6d8f9e9a4269f635881983ffbad4adc25a WatchSource:0}: Error finding container 1b8a9145ad77ecb9ab068130502b6a6d8f9e9a4269f635881983ffbad4adc25a: Status 404 returned error can't find the container with id 1b8a9145ad77ecb9ab068130502b6a6d8f9e9a4269f635881983ffbad4adc25a
Jul 23 18:08:38.315393 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.315300    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74967bc8-0d98-4f92-814b-a338a0991e8a-cert\") pod \"odh-model-controller-7998c67dc4-gqnqb\" (UID: \"74967bc8-0d98-4f92-814b-a338a0991e8a\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:38.315544 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:08:38.315454    2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 18:08:38.315544 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:08:38.315527    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74967bc8-0d98-4f92-814b-a338a0991e8a-cert podName:74967bc8-0d98-4f92-814b-a338a0991e8a nodeName:}" failed. No retries permitted until 2026-07-23 18:08:39.315505452 +0000 UTC m=+379.678349279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/74967bc8-0d98-4f92-814b-a338a0991e8a-cert") pod "odh-model-controller-7998c67dc4-gqnqb" (UID: "74967bc8-0d98-4f92-814b-a338a0991e8a") : secret "odh-model-controller-webhook-cert" not found
Jul 23 18:08:38.622677 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.622639    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jh9nw"]
Jul 23 18:08:38.625560 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.625533    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:38.628581 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.628557    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 23 18:08:38.641796 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.641765    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jh9nw"]
Jul 23 18:08:38.647688 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.647629    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:38.718135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.718097    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe76d075-337f-4a9b-8a05-fc041f546f0f-tls-certs\") pod \"model-serving-api-54d89bd5fc-jh9nw\" (UID: \"fe76d075-337f-4a9b-8a05-fc041f546f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:38.718348 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.718198    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7ths\" (UniqueName: \"kubernetes.io/projected/fe76d075-337f-4a9b-8a05-fc041f546f0f-kube-api-access-r7ths\") pod \"model-serving-api-54d89bd5fc-jh9nw\" (UID: \"fe76d075-337f-4a9b-8a05-fc041f546f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:38.736377 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.736339    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:38.820006 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.819748    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe76d075-337f-4a9b-8a05-fc041f546f0f-tls-certs\") pod \"model-serving-api-54d89bd5fc-jh9nw\" (UID: \"fe76d075-337f-4a9b-8a05-fc041f546f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:38.820186 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:08:38.819901    2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 23 18:08:38.820186 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.820115    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7ths\" (UniqueName: \"kubernetes.io/projected/fe76d075-337f-4a9b-8a05-fc041f546f0f-kube-api-access-r7ths\") pod \"model-serving-api-54d89bd5fc-jh9nw\" (UID: \"fe76d075-337f-4a9b-8a05-fc041f546f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:38.820336 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:08:38.820235    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe76d075-337f-4a9b-8a05-fc041f546f0f-tls-certs podName:fe76d075-337f-4a9b-8a05-fc041f546f0f nodeName:}" failed. No retries permitted until 2026-07-23 18:08:39.320162201 +0000 UTC m=+379.683006028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fe76d075-337f-4a9b-8a05-fc041f546f0f-tls-certs") pod "model-serving-api-54d89bd5fc-jh9nw" (UID: "fe76d075-337f-4a9b-8a05-fc041f546f0f") : secret "model-serving-api-tls" not found
Jul 23 18:08:38.837017 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.836981    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7ths\" (UniqueName: \"kubernetes.io/projected/fe76d075-337f-4a9b-8a05-fc041f546f0f-kube-api-access-r7ths\") pod \"model-serving-api-54d89bd5fc-jh9nw\" (UID: \"fe76d075-337f-4a9b-8a05-fc041f546f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:38.865537 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.865497    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2" event={"ID":"138be5b4-c9da-4a03-bc52-f4f97ff6f78d","Type":"ContainerStarted","Data":"1b8a9145ad77ecb9ab068130502b6a6d8f9e9a4269f635881983ffbad4adc25a"}
Jul 23 18:08:38.940775 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.940677    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:38.952995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.952956    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"]
Jul 23 18:08:38.956001 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.955978    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:38.962646 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.962621    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 18:08:38.963889 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.963628    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-blnlh\""
Jul 23 18:08:38.963889 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.963673    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 18:08:38.963889 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.963864    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 18:08:38.964135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.963865    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 18:08:38.974034 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:38.974007    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"]
Jul 23 18:08:39.059388 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.059352    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:39.122874 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.122843    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-cacerts\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.123049 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.122891    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.123049 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.122946    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-token\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.123049 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.122982    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws22d\" (UniqueName: \"kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-kube-api-access-ws22d\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.123049 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.123020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.123175 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.123075    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3bb165c-4d75-43ef-91cc-c9b64749fe13-local-certs\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.123175 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.123092    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.224422 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.224337    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3bb165c-4d75-43ef-91cc-c9b64749fe13-local-certs\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.224422 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.224376    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.224605 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.224434    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-cacerts\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.224605 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.224467    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.224605 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.224502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-token\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.224605 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.224528    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws22d\" (UniqueName: \"kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-kube-api-access-ws22d\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.224605 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.224558    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.225132 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.225100    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.226738 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.226720    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3bb165c-4d75-43ef-91cc-c9b64749fe13-local-certs\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.226839 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.226760    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-cacerts\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.227164 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.227146    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.227274 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.227214    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.235081 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.235061    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws22d\" (UniqueName: \"kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-kube-api-access-ws22d\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.235374 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.235355    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-token\") pod \"istiod-openshift-gateway-7574459656-vdwkv\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.270154 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.270114    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:39.325957 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.325922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe76d075-337f-4a9b-8a05-fc041f546f0f-tls-certs\") pod \"model-serving-api-54d89bd5fc-jh9nw\" (UID: \"fe76d075-337f-4a9b-8a05-fc041f546f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:39.326111 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.325988    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74967bc8-0d98-4f92-814b-a338a0991e8a-cert\") pod \"odh-model-controller-7998c67dc4-gqnqb\" (UID: \"74967bc8-0d98-4f92-814b-a338a0991e8a\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:39.329793 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.329377    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe76d075-337f-4a9b-8a05-fc041f546f0f-tls-certs\") pod \"model-serving-api-54d89bd5fc-jh9nw\" (UID: \"fe76d075-337f-4a9b-8a05-fc041f546f0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:39.329995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.329845    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74967bc8-0d98-4f92-814b-a338a0991e8a-cert\") pod \"odh-model-controller-7998c67dc4-gqnqb\" (UID: \"74967bc8-0d98-4f92-814b-a338a0991e8a\") " pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:39.419183 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.418986    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:39.462026 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.461947    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"]
Jul 23 18:08:39.468884 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:08:39.468812    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bb165c_4d75_43ef_91cc_c9b64749fe13.slice/crio-216181abd6a75f723ed8f1bd2f153467e26e8582d205494bec206581291afa85 WatchSource:0}: Error finding container 216181abd6a75f723ed8f1bd2f153467e26e8582d205494bec206581291afa85: Status 404 returned error can't find the container with id 216181abd6a75f723ed8f1bd2f153467e26e8582d205494bec206581291afa85
Jul 23 18:08:39.535979 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.535728    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:39.613949 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.613903    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gqnqb"]
Jul 23 18:08:39.618186 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:08:39.618152    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74967bc8_0d98_4f92_814b_a338a0991e8a.slice/crio-61a9505da18eb3e4349980aefd498e97ebe0abf547aa9972604e569edecfc52b WatchSource:0}: Error finding container 61a9505da18eb3e4349980aefd498e97ebe0abf547aa9972604e569edecfc52b: Status 404 returned error can't find the container with id 61a9505da18eb3e4349980aefd498e97ebe0abf547aa9972604e569edecfc52b
Jul 23 18:08:39.716430 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.716400    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jh9nw"]
Jul 23 18:08:39.718325 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:08:39.718284    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe76d075_337f_4a9b_8a05_fc041f546f0f.slice/crio-92113868bd8a7af80a9885532b3a06257c65f939af634407c2f6c69b23a52596 WatchSource:0}: Error finding container 92113868bd8a7af80a9885532b3a06257c65f939af634407c2f6c69b23a52596: Status 404 returned error can't find the container with id 92113868bd8a7af80a9885532b3a06257c65f939af634407c2f6c69b23a52596
Jul 23 18:08:39.872289 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.872253    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv" event={"ID":"a3bb165c-4d75-43ef-91cc-c9b64749fe13","Type":"ContainerStarted","Data":"216181abd6a75f723ed8f1bd2f153467e26e8582d205494bec206581291afa85"}
Jul 23 18:08:39.873495 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.873463    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb" event={"ID":"74967bc8-0d98-4f92-814b-a338a0991e8a","Type":"ContainerStarted","Data":"61a9505da18eb3e4349980aefd498e97ebe0abf547aa9972604e569edecfc52b"}
Jul 23 18:08:39.874629 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:39.874608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw" event={"ID":"fe76d075-337f-4a9b-8a05-fc041f546f0f","Type":"ContainerStarted","Data":"92113868bd8a7af80a9885532b3a06257c65f939af634407c2f6c69b23a52596"}
Jul 23 18:08:40.260608 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:40.260363    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:44.352962 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.352913    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:08:44.353342 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.352982    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:08:44.912561 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.912527    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv" event={"ID":"a3bb165c-4d75-43ef-91cc-c9b64749fe13","Type":"ContainerStarted","Data":"ba9330f5e42521673202457184191dbf506c7881723aecf7cd2c69197d9c5477"}
Jul 23 18:08:44.912756 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.912604    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:44.914065 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.914042    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2" event={"ID":"138be5b4-c9da-4a03-bc52-f4f97ff6f78d","Type":"ContainerStarted","Data":"d2ed311d2f3443bd88e1808e90df7c990d3eb33984a3738584091fb05f7702d8"}
Jul 23 18:08:44.915608 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.915581    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb" event={"ID":"74967bc8-0d98-4f92-814b-a338a0991e8a","Type":"ContainerStarted","Data":"6c11570ae12ea6e2b4fece5847bc3fd11ed47fdad2b103531505a05e30c2cec0"}
Jul 23 18:08:44.915734 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.915631    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:44.917001 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.916981    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw" event={"ID":"fe76d075-337f-4a9b-8a05-fc041f546f0f","Type":"ContainerStarted","Data":"2b02a2b4b333e24c61ec8dc0493b9b0b07fb08167073611bc3b6db86e29423c4"}
Jul 23 18:08:44.917146 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.917132    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:44.943516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.943457    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv" podStartSLOduration=2.063114167 podStartE2EDuration="6.943441106s" totalImagesPullingTime="4.880326939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:44.941744724 +0000 UTC m=+385.304588576" watchObservedRunningTime="2026-07-23 18:08:44.943441106 +0000 UTC m=+385.306284955"
Jul 23 18:08:44.981682 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:44.981629    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw" podStartSLOduration=2.3448945820000002 podStartE2EDuration="6.981611902s" totalImagesPullingTime="4.63671732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:44.979517612 +0000 UTC m=+385.342361470" watchObservedRunningTime="2026-07-23 18:08:44.981611902 +0000 UTC m=+385.344455750"
Jul 23 18:08:45.032130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:45.032068    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb" podStartSLOduration=3.287902556 podStartE2EDuration="8.032051581s" totalImagesPullingTime="4.744149025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:45.031592353 +0000 UTC m=+385.394436201" watchObservedRunningTime="2026-07-23 18:08:45.032051581 +0000 UTC m=+385.394895429"
Jul 23 18:08:45.068520 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:45.068461    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:45.077779 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:45.077728    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-84ccbf468f-5g6m2" podStartSLOduration=1.698418717 podStartE2EDuration="8.077711189s" totalImagesPullingTime="6.379292472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:45.070092749 +0000 UTC m=+385.432936612" watchObservedRunningTime="2026-07-23 18:08:45.077711189 +0000 UTC m=+385.440555038"
Jul 23 18:08:45.165653 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:45.165536    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:45.924108 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:45.924074    2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-vdwkv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 18:08:45.924555 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:45.924146    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv" podUID="a3bb165c-4d75-43ef-91cc-c9b64749fe13" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 18:08:46.403832 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:46.403795    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:46.747380 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:46.747287    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:47.203057 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:47.203023    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:48.923046 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:48.923007    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:52.283093 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.283057    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:52.395518 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.395457    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:52.490486 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.490456    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"]
Jul 23 18:08:52.497387 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.497361    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"]
Jul 23 18:08:52.497518 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.497477    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:08:52.499899 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.499877    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:08:52.507556 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.507525    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 23 18:08:52.507658 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.507602    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-qb5nz\""
Jul 23 18:08:52.508847 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.508695    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 18:08:52.509182 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.509160    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-75cwl\""
Jul 23 18:08:52.512171 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.512143    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:52.514569 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.514542    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"]
Jul 23 18:08:52.523132 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.523104    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"]
Jul 23 18:08:52.541033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.540954    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqjg9\" (UniqueName: \"kubernetes.io/projected/58dad97b-037b-4fb6-ade8-ad2f5ff6afff-kube-api-access-wqjg9\") pod \"kserve-controller-manager-d6f4b65b8-nkgtn\" (UID: \"58dad97b-037b-4fb6-ade8-ad2f5ff6afff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:08:52.541194 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.541041    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5a2c65-053f-4eea-a9d6-c837c04ba5d3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s7cl4\" (UID: \"fc5a2c65-053f-4eea-a9d6-c837c04ba5d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:08:52.541194 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.541061    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58dad97b-037b-4fb6-ade8-ad2f5ff6afff-cert\") pod \"kserve-controller-manager-d6f4b65b8-nkgtn\" (UID: \"58dad97b-037b-4fb6-ade8-ad2f5ff6afff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:08:52.541194 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.541107    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd7x2\" (UniqueName: \"kubernetes.io/projected/fc5a2c65-053f-4eea-a9d6-c837c04ba5d3-kube-api-access-nd7x2\") pod \"llmisvc-controller-manager-777c6bd7d5-s7cl4\" (UID: \"fc5a2c65-053f-4eea-a9d6-c837c04ba5d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:08:52.641622 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.641562    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5a2c65-053f-4eea-a9d6-c837c04ba5d3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s7cl4\" (UID: \"fc5a2c65-053f-4eea-a9d6-c837c04ba5d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:08:52.641622 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.641616    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58dad97b-037b-4fb6-ade8-ad2f5ff6afff-cert\") pod \"kserve-controller-manager-d6f4b65b8-nkgtn\" (UID: \"58dad97b-037b-4fb6-ade8-ad2f5ff6afff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:08:52.641891 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:08:52.641751    2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 23 18:08:52.641891 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:08:52.641813    2574 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 23 18:08:52.641891 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:08:52.641837    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58dad97b-037b-4fb6-ade8-ad2f5ff6afff-cert podName:58dad97b-037b-4fb6-ade8-ad2f5ff6afff nodeName:}" failed. No retries permitted until 2026-07-23 18:08:53.14181467 +0000 UTC m=+393.504658497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/58dad97b-037b-4fb6-ade8-ad2f5ff6afff-cert") pod "kserve-controller-manager-d6f4b65b8-nkgtn" (UID: "58dad97b-037b-4fb6-ade8-ad2f5ff6afff") : secret "kserve-webhook-server-cert" not found
Jul 23 18:08:52.641891 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.641858    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd7x2\" (UniqueName: \"kubernetes.io/projected/fc5a2c65-053f-4eea-a9d6-c837c04ba5d3-kube-api-access-nd7x2\") pod \"llmisvc-controller-manager-777c6bd7d5-s7cl4\" (UID: \"fc5a2c65-053f-4eea-a9d6-c837c04ba5d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:08:52.642092 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:08:52.641916    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc5a2c65-053f-4eea-a9d6-c837c04ba5d3-cert podName:fc5a2c65-053f-4eea-a9d6-c837c04ba5d3 nodeName:}" failed. No retries permitted until 2026-07-23 18:08:53.141893654 +0000 UTC m=+393.504737483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fc5a2c65-053f-4eea-a9d6-c837c04ba5d3-cert") pod "llmisvc-controller-manager-777c6bd7d5-s7cl4" (UID: "fc5a2c65-053f-4eea-a9d6-c837c04ba5d3") : secret "llmisvc-webhook-server-cert" not found
Jul 23 18:08:52.642092 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.642006    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqjg9\" (UniqueName: \"kubernetes.io/projected/58dad97b-037b-4fb6-ade8-ad2f5ff6afff-kube-api-access-wqjg9\") pod \"kserve-controller-manager-d6f4b65b8-nkgtn\" (UID: \"58dad97b-037b-4fb6-ade8-ad2f5ff6afff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:08:52.668290 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.668251    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd7x2\" (UniqueName: \"kubernetes.io/projected/fc5a2c65-053f-4eea-a9d6-c837c04ba5d3-kube-api-access-nd7x2\") pod \"llmisvc-controller-manager-777c6bd7d5-s7cl4\" (UID: \"fc5a2c65-053f-4eea-a9d6-c837c04ba5d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:08:52.668660 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.668635    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqjg9\" (UniqueName: \"kubernetes.io/projected/58dad97b-037b-4fb6-ade8-ad2f5ff6afff-kube-api-access-wqjg9\") pod \"kserve-controller-manager-d6f4b65b8-nkgtn\" (UID: \"58dad97b-037b-4fb6-ade8-ad2f5ff6afff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:08:52.760606 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.760567    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:52.841706 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.841673    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"]
Jul 23 18:08:52.841878 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.841862    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv" podUID="a3bb165c-4d75-43ef-91cc-c9b64749fe13" containerName="discovery" containerID="cri-o://ba9330f5e42521673202457184191dbf506c7881723aecf7cd2c69197d9c5477" gracePeriod=30
Jul 23 18:08:52.876296 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.876259    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:52.959309 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.959278    2574 generic.go:356] "Generic (PLEG): container finished" podID="a3bb165c-4d75-43ef-91cc-c9b64749fe13" containerID="ba9330f5e42521673202457184191dbf506c7881723aecf7cd2c69197d9c5477" exitCode=0
Jul 23 18:08:52.959434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:52.959347    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv" event={"ID":"a3bb165c-4d75-43ef-91cc-c9b64749fe13","Type":"ContainerDied","Data":"ba9330f5e42521673202457184191dbf506c7881723aecf7cd2c69197d9c5477"}
Jul 23 18:08:53.088411 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.088387    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:53.146828 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.146745    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-kubeconfig\") pod \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") "
Jul 23 18:08:53.146968 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.146824    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-dns-cert\") pod \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") "
Jul 23 18:08:53.146968 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.146889    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws22d\" (UniqueName: \"kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-kube-api-access-ws22d\") pod \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") "
Jul 23 18:08:53.147071 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.147012    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-token\") pod \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") "
Jul 23 18:08:53.147071 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.147054    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-ca-configmap\") pod \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") "
Jul 23 18:08:53.147160 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.147081    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3bb165c-4d75-43ef-91cc-c9b64749fe13-local-certs\") pod \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") "
Jul 23 18:08:53.147160 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.147108    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-cacerts\") pod \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\" (UID: \"a3bb165c-4d75-43ef-91cc-c9b64749fe13\") "
Jul 23 18:08:53.147877 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.147631    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a3bb165c-4d75-43ef-91cc-c9b64749fe13" (UID: "a3bb165c-4d75-43ef-91cc-c9b64749fe13"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:08:53.147877 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.147839    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5a2c65-053f-4eea-a9d6-c837c04ba5d3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s7cl4\" (UID: \"fc5a2c65-053f-4eea-a9d6-c837c04ba5d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:08:53.148714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.148194    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58dad97b-037b-4fb6-ade8-ad2f5ff6afff-cert\") pod \"kserve-controller-manager-d6f4b65b8-nkgtn\" (UID: \"58dad97b-037b-4fb6-ade8-ad2f5ff6afff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:08:53.148714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.148359    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-ca-configmap\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:08:53.149668 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.149639    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a3bb165c-4d75-43ef-91cc-c9b64749fe13" (UID: "a3bb165c-4d75-43ef-91cc-c9b64749fe13"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:08:53.149772 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.149664    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a3bb165c-4d75-43ef-91cc-c9b64749fe13" (UID: "a3bb165c-4d75-43ef-91cc-c9b64749fe13"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:08:53.149962 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.149932    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-kube-api-access-ws22d" (OuterVolumeSpecName: "kube-api-access-ws22d") pod "a3bb165c-4d75-43ef-91cc-c9b64749fe13" (UID: "a3bb165c-4d75-43ef-91cc-c9b64749fe13"). InnerVolumeSpecName "kube-api-access-ws22d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:08:53.150466 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.150446    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3bb165c-4d75-43ef-91cc-c9b64749fe13" (UID: "a3bb165c-4d75-43ef-91cc-c9b64749fe13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:08:53.150678 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.150662    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3bb165c-4d75-43ef-91cc-c9b64749fe13-local-certs" (OuterVolumeSpecName: "local-certs") pod "a3bb165c-4d75-43ef-91cc-c9b64749fe13" (UID: "a3bb165c-4d75-43ef-91cc-c9b64749fe13"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:08:53.151038 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.151014    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5a2c65-053f-4eea-a9d6-c837c04ba5d3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-s7cl4\" (UID: \"fc5a2c65-053f-4eea-a9d6-c837c04ba5d3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:08:53.151418 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.151388    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-cacerts" (OuterVolumeSpecName: "cacerts") pod "a3bb165c-4d75-43ef-91cc-c9b64749fe13" (UID: "a3bb165c-4d75-43ef-91cc-c9b64749fe13"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:08:53.151615 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.151594    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58dad97b-037b-4fb6-ade8-ad2f5ff6afff-cert\") pod \"kserve-controller-manager-d6f4b65b8-nkgtn\" (UID: \"58dad97b-037b-4fb6-ade8-ad2f5ff6afff\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:08:53.249633 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.249596    2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3bb165c-4d75-43ef-91cc-c9b64749fe13-local-certs\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:08:53.249800 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.249695    2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-cacerts\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:08:53.249800 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.249705    2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-kubeconfig\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:08:53.249800 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.249713    2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-csr-dns-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:08:53.249800 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.249722    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws22d\" (UniqueName: \"kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-kube-api-access-ws22d\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:08:53.249800 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.249730    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3bb165c-4d75-43ef-91cc-c9b64749fe13-istio-token\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:08:53.409914 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.409826    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:08:53.424092 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.424063    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:08:53.580927 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.580902    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"]
Jul 23 18:08:53.582558 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:08:53.582529    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58dad97b_037b_4fb6_ade8_ad2f5ff6afff.slice/crio-d693834e2cd4031a271cceb9779668595894a3dc31d55077dd453c345e4aef7f WatchSource:0}: Error finding container d693834e2cd4031a271cceb9779668595894a3dc31d55077dd453c345e4aef7f: Status 404 returned error can't find the container with id d693834e2cd4031a271cceb9779668595894a3dc31d55077dd453c345e4aef7f
Jul 23 18:08:53.608071 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.608045    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"]
Jul 23 18:08:53.609404 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:08:53.609368    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfc5a2c65_053f_4eea_a9d6_c837c04ba5d3.slice/crio-94d866a0c0dd040651478d0816fe31255b7ef28442c4aecee699d8031aa22ab9 WatchSource:0}: Error finding container 94d866a0c0dd040651478d0816fe31255b7ef28442c4aecee699d8031aa22ab9: Status 404 returned error can't find the container with id 94d866a0c0dd040651478d0816fe31255b7ef28442c4aecee699d8031aa22ab9
Jul 23 18:08:53.795425 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.795392    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:53.935753 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.935666    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:53.965721 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.965692    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"
Jul 23 18:08:53.965910 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.965693    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv" event={"ID":"a3bb165c-4d75-43ef-91cc-c9b64749fe13","Type":"ContainerDied","Data":"216181abd6a75f723ed8f1bd2f153467e26e8582d205494bec206581291afa85"}
Jul 23 18:08:53.965910 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.965840    2574 scope.go:117] "RemoveContainer" containerID="ba9330f5e42521673202457184191dbf506c7881723aecf7cd2c69197d9c5477"
Jul 23 18:08:53.967368 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.967086    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn" event={"ID":"58dad97b-037b-4fb6-ade8-ad2f5ff6afff","Type":"ContainerStarted","Data":"d693834e2cd4031a271cceb9779668595894a3dc31d55077dd453c345e4aef7f"}
Jul 23 18:08:53.968570 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:53.968548    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4" event={"ID":"fc5a2c65-053f-4eea-a9d6-c837c04ba5d3","Type":"ContainerStarted","Data":"94d866a0c0dd040651478d0816fe31255b7ef28442c4aecee699d8031aa22ab9"}
Jul 23 18:08:54.077874 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:54.077837    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"]
Jul 23 18:08:54.082944 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:54.082911    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:08:54.084168 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:54.084144    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-vdwkv"]
Jul 23 18:08:54.185657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:54.185628    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3bb165c-4d75-43ef-91cc-c9b64749fe13" path="/var/lib/kubelet/pods/a3bb165c-4d75-43ef-91cc-c9b64749fe13/volumes"
Jul 23 18:08:55.924771 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:55.924733    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-gqnqb"
Jul 23 18:08:55.927360 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:55.927331    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jh9nw"
Jul 23 18:08:56.987919 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:56.987819    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4" event={"ID":"fc5a2c65-053f-4eea-a9d6-c837c04ba5d3","Type":"ContainerStarted","Data":"506ee540fc0a563e3fd32bed7a328f97ca965c1b50294564ea5d42f86f9f186c"}
Jul 23 18:08:56.987919 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:56.987893    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:08:56.989323 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:56.989297    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn" event={"ID":"58dad97b-037b-4fb6-ade8-ad2f5ff6afff","Type":"ContainerStarted","Data":"77d3f2034941a244f190695b13c120214ef67ad542318950b189d7fb00a501fd"}
Jul 23 18:08:56.989435 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:56.989351    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:08:57.074291 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:57.074219    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4" podStartSLOduration=1.9796835210000001 podStartE2EDuration="5.074201356s" totalImagesPullingTime="3.094517835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:57.028964126 +0000 UTC m=+397.391807995" watchObservedRunningTime="2026-07-23 18:08:57.074201356 +0000 UTC m=+397.437045204"
Jul 23 18:08:57.074909 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:08:57.074884    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn" podStartSLOduration=1.9572583959999998 podStartE2EDuration="5.074876229s" totalImagesPullingTime="3.117617833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:57.073144903 +0000 UTC m=+397.435988782" watchObservedRunningTime="2026-07-23 18:08:57.074876229 +0000 UTC m=+397.437720077"
Jul 23 18:09:27.996262 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:27.996214    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-s7cl4"
Jul 23 18:09:27.999399 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:27.999375    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nkgtn"
Jul 23 18:09:35.107214 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.107169    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:09:35.183078 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.183045    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:09:35.345324 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.345282    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:09:35.444860 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.444765    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:09:35.538527 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.538487    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5vhh"]
Jul 23 18:09:35.539675 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.539648    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3bb165c-4d75-43ef-91cc-c9b64749fe13" containerName="discovery"
Jul 23 18:09:35.539821 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.539804    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3bb165c-4d75-43ef-91cc-c9b64749fe13" containerName="discovery"
Jul 23 18:09:35.540077 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.540062    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3bb165c-4d75-43ef-91cc-c9b64749fe13" containerName="discovery"
Jul 23 18:09:35.555512 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.555481    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5vhh"]
Jul 23 18:09:35.555674 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.555594    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r5vhh"
Jul 23 18:09:35.558646 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.558616    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 18:09:35.559764 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.559733    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ncpzs\""
Jul 23 18:09:35.560552 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.560531    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 18:09:35.590450 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.590417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:09:35.644772 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.644741    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbktf\" (UniqueName: \"kubernetes.io/projected/23e625da-7fcd-4e76-b7d8-aaa342aa9787-kube-api-access-mbktf\") pod \"kuadrant-operator-catalog-r5vhh\" (UID: \"23e625da-7fcd-4e76-b7d8-aaa342aa9787\") " pod="kuadrant-system/kuadrant-operator-catalog-r5vhh"
Jul 23 18:09:35.745925 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.745832    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbktf\" (UniqueName: \"kubernetes.io/projected/23e625da-7fcd-4e76-b7d8-aaa342aa9787-kube-api-access-mbktf\") pod \"kuadrant-operator-catalog-r5vhh\" (UID: \"23e625da-7fcd-4e76-b7d8-aaa342aa9787\") " pod="kuadrant-system/kuadrant-operator-catalog-r5vhh"
Jul 23 18:09:35.755444 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.755418    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbktf\" (UniqueName: \"kubernetes.io/projected/23e625da-7fcd-4e76-b7d8-aaa342aa9787-kube-api-access-mbktf\") pod \"kuadrant-operator-catalog-r5vhh\" (UID: \"23e625da-7fcd-4e76-b7d8-aaa342aa9787\") " pod="kuadrant-system/kuadrant-operator-catalog-r5vhh"
Jul 23 18:09:35.865711 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.865674    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5vhh"]
Jul 23 18:09:35.865910 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:35.865758    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r5vhh"
Jul 23 18:09:36.001814 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:36.001786    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5vhh"]
Jul 23 18:09:36.003565 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:09:36.003535    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e625da_7fcd_4e76_b7d8_aaa342aa9787.slice/crio-e01d036fe9ba8abb1a4ec108767b8581d5fdae81f48c9ce47f602688939fe1fe WatchSource:0}: Error finding container e01d036fe9ba8abb1a4ec108767b8581d5fdae81f48c9ce47f602688939fe1fe: Status 404 returned error can't find the container with id e01d036fe9ba8abb1a4ec108767b8581d5fdae81f48c9ce47f602688939fe1fe
Jul 23 18:09:36.078456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:36.078404    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5nj4q"]
Jul 23 18:09:36.083085 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:36.083067    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5nj4q"
Jul 23 18:09:36.092449 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:36.092418    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5nj4q"]
Jul 23 18:09:36.148059 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:36.148023    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g79zq\" (UniqueName: \"kubernetes.io/projected/0098b149-ca73-4edf-9c1e-0da361483330-kube-api-access-g79zq\") pod \"kuadrant-operator-catalog-5nj4q\" (UID: \"0098b149-ca73-4edf-9c1e-0da361483330\") " pod="kuadrant-system/kuadrant-operator-catalog-5nj4q"
Jul 23 18:09:36.189265 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:36.189218    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r5vhh" event={"ID":"23e625da-7fcd-4e76-b7d8-aaa342aa9787","Type":"ContainerStarted","Data":"e01d036fe9ba8abb1a4ec108767b8581d5fdae81f48c9ce47f602688939fe1fe"}
Jul 23 18:09:36.248516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:36.248477    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g79zq\" (UniqueName: \"kubernetes.io/projected/0098b149-ca73-4edf-9c1e-0da361483330-kube-api-access-g79zq\") pod \"kuadrant-operator-catalog-5nj4q\" (UID: \"0098b149-ca73-4edf-9c1e-0da361483330\") " pod="kuadrant-system/kuadrant-operator-catalog-5nj4q"
Jul 23 18:09:36.257767 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:36.257707    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g79zq\" (UniqueName: \"kubernetes.io/projected/0098b149-ca73-4edf-9c1e-0da361483330-kube-api-access-g79zq\") pod \"kuadrant-operator-catalog-5nj4q\" (UID: \"0098b149-ca73-4edf-9c1e-0da361483330\") " pod="kuadrant-system/kuadrant-operator-catalog-5nj4q"
Jul 23 18:09:36.394122 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:36.394063    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5nj4q"
Jul 23 18:09:36.529123 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:36.529097    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5nj4q"]
Jul 23 18:09:36.530596 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:09:36.530572    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0098b149_ca73_4edf_9c1e_0da361483330.slice/crio-6d281984f644bae934eb6d29f83f62fab6f12b0178040ac7a16837eb3e09b743 WatchSource:0}: Error finding container 6d281984f644bae934eb6d29f83f62fab6f12b0178040ac7a16837eb3e09b743: Status 404 returned error can't find the container with id 6d281984f644bae934eb6d29f83f62fab6f12b0178040ac7a16837eb3e09b743
Jul 23 18:09:37.034027 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:37.033889    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:09:37.133086 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:37.133052    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:09:37.198931 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:37.198892    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5nj4q" event={"ID":"0098b149-ca73-4edf-9c1e-0da361483330","Type":"ContainerStarted","Data":"6d281984f644bae934eb6d29f83f62fab6f12b0178040ac7a16837eb3e09b743"}
Jul 23 18:09:38.205236 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:38.205124    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5nj4q" event={"ID":"0098b149-ca73-4edf-9c1e-0da361483330","Type":"ContainerStarted","Data":"eb557efd01febce0405cb266be4b37186316f0b06c1b26ecc6cb387ffd6909cc"}
Jul 23 18:09:38.206664 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:38.206640    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r5vhh" event={"ID":"23e625da-7fcd-4e76-b7d8-aaa342aa9787","Type":"ContainerStarted","Data":"7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34"}
Jul 23 18:09:38.206789 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:38.206707    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-r5vhh" podUID="23e625da-7fcd-4e76-b7d8-aaa342aa9787" containerName="registry-server" containerID="cri-o://7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34" gracePeriod=2
Jul 23 18:09:38.221745 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:38.221668    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5nj4q" podStartSLOduration=0.794736551 podStartE2EDuration="2.221648307s" totalImagesPullingTime="1.426911756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:09:38.221130711 +0000 UTC m=+438.583974564" watchObservedRunningTime="2026-07-23 18:09:38.221648307 +0000 UTC m=+438.584492157"
Jul 23 18:09:38.239048 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:38.239000    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r5vhh" podStartSLOduration=1.285847115 podStartE2EDuration="3.238983826s" totalImagesPullingTime="1.953136711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:09:38.237100361 +0000 UTC m=+438.599944211" watchObservedRunningTime="2026-07-23 18:09:38.238983826 +0000 UTC m=+438.601827679"
Jul 23 18:09:38.447571 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:38.447546    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r5vhh"
Jul 23 18:09:38.467959 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:38.467873    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbktf\" (UniqueName: \"kubernetes.io/projected/23e625da-7fcd-4e76-b7d8-aaa342aa9787-kube-api-access-mbktf\") pod \"23e625da-7fcd-4e76-b7d8-aaa342aa9787\" (UID: \"23e625da-7fcd-4e76-b7d8-aaa342aa9787\") "
Jul 23 18:09:38.469959 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:38.469932    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23e625da-7fcd-4e76-b7d8-aaa342aa9787-kube-api-access-mbktf" (OuterVolumeSpecName: "kube-api-access-mbktf") pod "23e625da-7fcd-4e76-b7d8-aaa342aa9787" (UID: "23e625da-7fcd-4e76-b7d8-aaa342aa9787"). InnerVolumeSpecName "kube-api-access-mbktf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:09:38.569539 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:38.569506    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbktf\" (UniqueName: \"kubernetes.io/projected/23e625da-7fcd-4e76-b7d8-aaa342aa9787-kube-api-access-mbktf\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:39.212143 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:39.212109    2574 generic.go:356] "Generic (PLEG): container finished" podID="23e625da-7fcd-4e76-b7d8-aaa342aa9787" containerID="7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34" exitCode=0
Jul 23 18:09:39.212598 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:39.212155    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r5vhh"
Jul 23 18:09:39.212598 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:39.212186    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r5vhh" event={"ID":"23e625da-7fcd-4e76-b7d8-aaa342aa9787","Type":"ContainerDied","Data":"7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34"}
Jul 23 18:09:39.212598 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:39.212244    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r5vhh" event={"ID":"23e625da-7fcd-4e76-b7d8-aaa342aa9787","Type":"ContainerDied","Data":"e01d036fe9ba8abb1a4ec108767b8581d5fdae81f48c9ce47f602688939fe1fe"}
Jul 23 18:09:39.212598 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:39.212264    2574 scope.go:117] "RemoveContainer" containerID="7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34"
Jul 23 18:09:39.221646 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:39.221628    2574 scope.go:117] "RemoveContainer" containerID="7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34"
Jul 23 18:09:39.221937 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:09:39.221919    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34\": container with ID starting with 7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34 not found: ID does not exist" containerID="7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34"
Jul 23 18:09:39.222069 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:39.221948    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34"} err="failed to get container status \"7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34\": rpc error: code = NotFound desc = could not find container \"7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34\": container with ID starting with 7b2fb57e6c33991c26db25a39f6fd9cea49c26eb6c9c99bacb5256f7045ced34 not found: ID does not exist"
Jul 23 18:09:39.234582 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:39.234515    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5vhh"]
Jul 23 18:09:39.238522 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:39.238498    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r5vhh"]
Jul 23 18:09:40.187112 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:40.187079    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23e625da-7fcd-4e76-b7d8-aaa342aa9787" path="/var/lib/kubelet/pods/23e625da-7fcd-4e76-b7d8-aaa342aa9787/volumes"
Jul 23 18:09:46.395017 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:46.394915    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5nj4q"
Jul 23 18:09:46.395017 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:46.394991    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5nj4q"
Jul 23 18:09:46.417664 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:46.417638    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5nj4q"
Jul 23 18:09:47.276939 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:47.276909    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5nj4q"
Jul 23 18:09:50.898749 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:50.898714    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"]
Jul 23 18:09:50.899195 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:50.899136    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e625da-7fcd-4e76-b7d8-aaa342aa9787" containerName="registry-server"
Jul 23 18:09:50.899195 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:50.899154    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e625da-7fcd-4e76-b7d8-aaa342aa9787" containerName="registry-server"
Jul 23 18:09:50.899318 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:50.899259    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="23e625da-7fcd-4e76-b7d8-aaa342aa9787" containerName="registry-server"
Jul 23 18:09:50.902491 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:50.902468    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:50.904930 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:50.904908    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9jsj5\""
Jul 23 18:09:50.911968 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:50.911942    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"]
Jul 23 18:09:50.976006 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:50.975968    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:50.976203 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:50.976012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:50.976203 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:50.976053    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtcq8\" (UniqueName: \"kubernetes.io/projected/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-kube-api-access-rtcq8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:51.077308 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.077265    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:51.077308 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.077313    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:51.077563 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.077349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtcq8\" (UniqueName: \"kubernetes.io/projected/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-kube-api-access-rtcq8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:51.077622 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.077607    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:51.077675 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.077648    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:51.086815 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.086784    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtcq8\" (UniqueName: \"kubernetes.io/projected/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-kube-api-access-rtcq8\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:51.213460 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.213377    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:51.351707 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.351681    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"]
Jul 23 18:09:51.353575 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:09:51.353549    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1596d7a7_f6ef_461f_a4e5_18d365dcb6ed.slice/crio-97dd6387d129664e26688663ea819bef45297d2ef52a3691a5809830eeffffea WatchSource:0}: Error finding container 97dd6387d129664e26688663ea819bef45297d2ef52a3691a5809830eeffffea: Status 404 returned error can't find the container with id 97dd6387d129664e26688663ea819bef45297d2ef52a3691a5809830eeffffea
Jul 23 18:09:51.703621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.703577    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"]
Jul 23 18:09:51.707191 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.707168    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:51.716252 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.716214    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"]
Jul 23 18:09:51.784243 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.784192    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:51.784440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.784261    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnbg4\" (UniqueName: \"kubernetes.io/projected/4ff7e150-95de-4985-8325-b60321b22295-kube-api-access-nnbg4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:51.784440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.784319    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:51.885726 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.885690    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:51.885954 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.885733    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnbg4\" (UniqueName: \"kubernetes.io/projected/4ff7e150-95de-4985-8325-b60321b22295-kube-api-access-nnbg4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:51.885954 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.885765    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:51.886089 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.886074    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:51.886160 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.886141    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:51.896509 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:51.896479    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnbg4\" (UniqueName: \"kubernetes.io/projected/4ff7e150-95de-4985-8325-b60321b22295-kube-api-access-nnbg4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:52.016662 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.016576    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:52.147819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.147795    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"]
Jul 23 18:09:52.149630 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:09:52.149598    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff7e150_95de_4985_8325_b60321b22295.slice/crio-2b99d47f6d8b63fff6da9c452f6f7fc363d7830f32237d135b37de81654f3de3 WatchSource:0}: Error finding container 2b99d47f6d8b63fff6da9c452f6f7fc363d7830f32237d135b37de81654f3de3: Status 404 returned error can't find the container with id 2b99d47f6d8b63fff6da9c452f6f7fc363d7830f32237d135b37de81654f3de3
Jul 23 18:09:52.280598 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.280515    2574 generic.go:356] "Generic (PLEG): container finished" podID="1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" containerID="2f20e40439df5e6f944c964936e81a15523f47b62d4413a9fc9763dd37626819" exitCode=0
Jul 23 18:09:52.280745 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.280593    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt" event={"ID":"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed","Type":"ContainerDied","Data":"2f20e40439df5e6f944c964936e81a15523f47b62d4413a9fc9763dd37626819"}
Jul 23 18:09:52.280745 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.280646    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt" event={"ID":"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed","Type":"ContainerStarted","Data":"97dd6387d129664e26688663ea819bef45297d2ef52a3691a5809830eeffffea"}
Jul 23 18:09:52.282260 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.282236    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ff7e150-95de-4985-8325-b60321b22295" containerID="f0cdf1a23c87a8cf292e77a6ff9ebf1e3379183b3fb6ecb6e658fff4948aabe2" exitCode=0
Jul 23 18:09:52.282365 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.282315    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24" event={"ID":"4ff7e150-95de-4985-8325-b60321b22295","Type":"ContainerDied","Data":"f0cdf1a23c87a8cf292e77a6ff9ebf1e3379183b3fb6ecb6e658fff4948aabe2"}
Jul 23 18:09:52.282427 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.282402    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24" event={"ID":"4ff7e150-95de-4985-8325-b60321b22295","Type":"ContainerStarted","Data":"2b99d47f6d8b63fff6da9c452f6f7fc363d7830f32237d135b37de81654f3de3"}
Jul 23 18:09:52.297072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.297038    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"]
Jul 23 18:09:52.300980 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.300955    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.309770 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.309744    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"]
Jul 23 18:09:52.390657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.390617    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.390657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.390660    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frhfv\" (UniqueName: \"kubernetes.io/projected/9ab5eeba-1a82-420b-af49-571b749e15f4-kube-api-access-frhfv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.390891 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.390756    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.491483 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.491449    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.491658 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.491493    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frhfv\" (UniqueName: \"kubernetes.io/projected/9ab5eeba-1a82-420b-af49-571b749e15f4-kube-api-access-frhfv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.491658 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.491534    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.491827 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.491806    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.491864 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.491835    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.501754 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.501724    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frhfv\" (UniqueName: \"kubernetes.io/projected/9ab5eeba-1a82-420b-af49-571b749e15f4-kube-api-access-frhfv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.625784 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.625748    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:52.700385 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.700354    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"]
Jul 23 18:09:52.705157 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.705136    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:52.722067 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.715154    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"]
Jul 23 18:09:52.772311 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.772285    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"]
Jul 23 18:09:52.774384 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:09:52.774361    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ab5eeba_1a82_420b_af49_571b749e15f4.slice/crio-baf604dc62d779bf0005ba75c1e257314b57f9bf1ed76bfb2bd68c387d3c725a WatchSource:0}: Error finding container baf604dc62d779bf0005ba75c1e257314b57f9bf1ed76bfb2bd68c387d3c725a: Status 404 returned error can't find the container with id baf604dc62d779bf0005ba75c1e257314b57f9bf1ed76bfb2bd68c387d3c725a
Jul 23 18:09:52.793624 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.793590    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:52.793741 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.793670    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47wbc\" (UniqueName: \"kubernetes.io/projected/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-kube-api-access-47wbc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:52.793741 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.793705    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:52.894889 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.894860    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:52.895031 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.894912    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47wbc\" (UniqueName: \"kubernetes.io/projected/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-kube-api-access-47wbc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:52.895031 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.894933    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:52.895324 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.895295    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:52.895394 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.895302    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:52.905067 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:52.905045    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47wbc\" (UniqueName: \"kubernetes.io/projected/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-kube-api-access-47wbc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:53.019298 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:53.019272    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:53.217409 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:53.217119    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"]
Jul 23 18:09:53.219653 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:09:53.219625    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f6376f_f6a2_4a8c_8aaf_6a029fc82806.slice/crio-51cfc162d64e68c5ea227671bb64835b9a06ee867ea5857e2ab61e1acb5c527f WatchSource:0}: Error finding container 51cfc162d64e68c5ea227671bb64835b9a06ee867ea5857e2ab61e1acb5c527f: Status 404 returned error can't find the container with id 51cfc162d64e68c5ea227671bb64835b9a06ee867ea5857e2ab61e1acb5c527f
Jul 23 18:09:53.289791 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:53.289765    2574 generic.go:356] "Generic (PLEG): container finished" podID="1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" containerID="a3989721e41883ba71394b10b2bdfd9a912ee255284636c82e23e3bcc69504f3" exitCode=0
Jul 23 18:09:53.289940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:53.289842    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt" event={"ID":"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed","Type":"ContainerDied","Data":"a3989721e41883ba71394b10b2bdfd9a912ee255284636c82e23e3bcc69504f3"}
Jul 23 18:09:53.291345 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:53.291310    2574 generic.go:356] "Generic (PLEG): container finished" podID="9ab5eeba-1a82-420b-af49-571b749e15f4" containerID="1fdd7219fc9dd55e81e422ef345c5b94a16bb8e9c93d8b6bf07667b7b6a9e986" exitCode=0
Jul 23 18:09:53.291471 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:53.291396    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j" event={"ID":"9ab5eeba-1a82-420b-af49-571b749e15f4","Type":"ContainerDied","Data":"1fdd7219fc9dd55e81e422ef345c5b94a16bb8e9c93d8b6bf07667b7b6a9e986"}
Jul 23 18:09:53.291471 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:53.291440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j" event={"ID":"9ab5eeba-1a82-420b-af49-571b749e15f4","Type":"ContainerStarted","Data":"baf604dc62d779bf0005ba75c1e257314b57f9bf1ed76bfb2bd68c387d3c725a"}
Jul 23 18:09:53.293100 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:53.293077    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ff7e150-95de-4985-8325-b60321b22295" containerID="93cfd5bb8aa801c158c3531f4fe4a2fac1749fdefc78df3bb638bc76e16892ee" exitCode=0
Jul 23 18:09:53.293179 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:53.293161    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24" event={"ID":"4ff7e150-95de-4985-8325-b60321b22295","Type":"ContainerDied","Data":"93cfd5bb8aa801c158c3531f4fe4a2fac1749fdefc78df3bb638bc76e16892ee"}
Jul 23 18:09:53.294388 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:53.294282    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z" event={"ID":"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806","Type":"ContainerStarted","Data":"51cfc162d64e68c5ea227671bb64835b9a06ee867ea5857e2ab61e1acb5c527f"}
Jul 23 18:09:54.301952 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:54.301921    2574 generic.go:356] "Generic (PLEG): container finished" podID="4ff7e150-95de-4985-8325-b60321b22295" containerID="4a4c87741d74912805346c359713a9e80a1f7849cee9087ddc69c59cc585bdc9" exitCode=0
Jul 23 18:09:54.302401 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:54.301999    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24" event={"ID":"4ff7e150-95de-4985-8325-b60321b22295","Type":"ContainerDied","Data":"4a4c87741d74912805346c359713a9e80a1f7849cee9087ddc69c59cc585bdc9"}
Jul 23 18:09:54.303536 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:54.303512    2574 generic.go:356] "Generic (PLEG): container finished" podID="a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" containerID="970906b8438b5f45b192b75a7532dc1292bb2f88d854fe8ef59a619dbad13a43" exitCode=0
Jul 23 18:09:54.303630 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:54.303590    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z" event={"ID":"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806","Type":"ContainerDied","Data":"970906b8438b5f45b192b75a7532dc1292bb2f88d854fe8ef59a619dbad13a43"}
Jul 23 18:09:54.305820 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:54.305793    2574 generic.go:356] "Generic (PLEG): container finished" podID="1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" containerID="4d1c4aca77fef27a8b9804143c0357ae647145e826d49cb17b9aa4939bcf22be" exitCode=0
Jul 23 18:09:54.306036 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:54.305900    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt" event={"ID":"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed","Type":"ContainerDied","Data":"4d1c4aca77fef27a8b9804143c0357ae647145e826d49cb17b9aa4939bcf22be"}
Jul 23 18:09:54.307805 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:54.307781    2574 generic.go:356] "Generic (PLEG): container finished" podID="9ab5eeba-1a82-420b-af49-571b749e15f4" containerID="8de9b14f48566573f1f4b8948fa475e4e9dfa46c916a8fe806191f140e26876c" exitCode=0
Jul 23 18:09:54.307893 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:54.307808    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j" event={"ID":"9ab5eeba-1a82-420b-af49-571b749e15f4","Type":"ContainerDied","Data":"8de9b14f48566573f1f4b8948fa475e4e9dfa46c916a8fe806191f140e26876c"}
Jul 23 18:09:55.315000 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.314967    2574 generic.go:356] "Generic (PLEG): container finished" podID="a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" containerID="2b78448fd66d6a45d0bf2ca59785775466389f7afdb65224713ca7fa831ab275" exitCode=0
Jul 23 18:09:55.315482 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.315056    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z" event={"ID":"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806","Type":"ContainerDied","Data":"2b78448fd66d6a45d0bf2ca59785775466389f7afdb65224713ca7fa831ab275"}
Jul 23 18:09:55.317301 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.317279    2574 generic.go:356] "Generic (PLEG): container finished" podID="9ab5eeba-1a82-420b-af49-571b749e15f4" containerID="8f096d45e38aa82e1d94d604c2b843d531ae75dcbaca8bab4ab70a29e1504073" exitCode=0
Jul 23 18:09:55.317401 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.317363    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j" event={"ID":"9ab5eeba-1a82-420b-af49-571b749e15f4","Type":"ContainerDied","Data":"8f096d45e38aa82e1d94d604c2b843d531ae75dcbaca8bab4ab70a29e1504073"}
Jul 23 18:09:55.468370 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.468347    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:55.517334 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.517305    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtcq8\" (UniqueName: \"kubernetes.io/projected/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-kube-api-access-rtcq8\") pod \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") "
Jul 23 18:09:55.517493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.517405    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-util\") pod \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") "
Jul 23 18:09:55.517493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.517473    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-bundle\") pod \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\" (UID: \"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed\") "
Jul 23 18:09:55.517959 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.517926    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-bundle" (OuterVolumeSpecName: "bundle") pod "1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" (UID: "1596d7a7-f6ef-461f-a4e5-18d365dcb6ed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:09:55.519413 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.519388    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-kube-api-access-rtcq8" (OuterVolumeSpecName: "kube-api-access-rtcq8") pod "1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" (UID: "1596d7a7-f6ef-461f-a4e5-18d365dcb6ed"). InnerVolumeSpecName "kube-api-access-rtcq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:09:55.522524 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.522500    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-util" (OuterVolumeSpecName: "util") pod "1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" (UID: "1596d7a7-f6ef-461f-a4e5-18d365dcb6ed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:09:55.563617 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.563588    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:55.618768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.618681    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-bundle\") pod \"4ff7e150-95de-4985-8325-b60321b22295\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") "
Jul 23 18:09:55.618768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.618761    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnbg4\" (UniqueName: \"kubernetes.io/projected/4ff7e150-95de-4985-8325-b60321b22295-kube-api-access-nnbg4\") pod \"4ff7e150-95de-4985-8325-b60321b22295\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") "
Jul 23 18:09:55.618961 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.618804    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-util\") pod \"4ff7e150-95de-4985-8325-b60321b22295\" (UID: \"4ff7e150-95de-4985-8325-b60321b22295\") "
Jul 23 18:09:55.619007 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.618993    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:55.619007 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.619004    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtcq8\" (UniqueName: \"kubernetes.io/projected/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-kube-api-access-rtcq8\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:55.619082 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.619012    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1596d7a7-f6ef-461f-a4e5-18d365dcb6ed-util\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:55.619498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.619473    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-bundle" (OuterVolumeSpecName: "bundle") pod "4ff7e150-95de-4985-8325-b60321b22295" (UID: "4ff7e150-95de-4985-8325-b60321b22295"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:09:55.620866 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.620844    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff7e150-95de-4985-8325-b60321b22295-kube-api-access-nnbg4" (OuterVolumeSpecName: "kube-api-access-nnbg4") pod "4ff7e150-95de-4985-8325-b60321b22295" (UID: "4ff7e150-95de-4985-8325-b60321b22295"). InnerVolumeSpecName "kube-api-access-nnbg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:09:55.624321 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.624301    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-util" (OuterVolumeSpecName: "util") pod "4ff7e150-95de-4985-8325-b60321b22295" (UID: "4ff7e150-95de-4985-8325-b60321b22295"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:09:55.719601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.719561    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-util\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:55.719601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.719593    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff7e150-95de-4985-8325-b60321b22295-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:55.719601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:55.719605    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnbg4\" (UniqueName: \"kubernetes.io/projected/4ff7e150-95de-4985-8325-b60321b22295-kube-api-access-nnbg4\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:56.325547 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.325522    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24"
Jul 23 18:09:56.325977 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.325509    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24" event={"ID":"4ff7e150-95de-4985-8325-b60321b22295","Type":"ContainerDied","Data":"2b99d47f6d8b63fff6da9c452f6f7fc363d7830f32237d135b37de81654f3de3"}
Jul 23 18:09:56.325977 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.325683    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b99d47f6d8b63fff6da9c452f6f7fc363d7830f32237d135b37de81654f3de3"
Jul 23 18:09:56.328161 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.328131    2574 generic.go:356] "Generic (PLEG): container finished" podID="a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" containerID="07382ac743412cae7ba9fa609e3f242786de8661d0b7f8edbb93e616232b6d26" exitCode=0
Jul 23 18:09:56.328350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.328165    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z" event={"ID":"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806","Type":"ContainerDied","Data":"07382ac743412cae7ba9fa609e3f242786de8661d0b7f8edbb93e616232b6d26"}
Jul 23 18:09:56.330172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.330145    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt" event={"ID":"1596d7a7-f6ef-461f-a4e5-18d365dcb6ed","Type":"ContainerDied","Data":"97dd6387d129664e26688663ea819bef45297d2ef52a3691a5809830eeffffea"}
Jul 23 18:09:56.330172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.330164    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt"
Jul 23 18:09:56.330349 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.330204    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97dd6387d129664e26688663ea819bef45297d2ef52a3691a5809830eeffffea"
Jul 23 18:09:56.467048 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.467024    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:56.527730 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.527696    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-bundle\") pod \"9ab5eeba-1a82-420b-af49-571b749e15f4\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") "
Jul 23 18:09:56.527894 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.527808    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-util\") pod \"9ab5eeba-1a82-420b-af49-571b749e15f4\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") "
Jul 23 18:09:56.527894 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.527836    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frhfv\" (UniqueName: \"kubernetes.io/projected/9ab5eeba-1a82-420b-af49-571b749e15f4-kube-api-access-frhfv\") pod \"9ab5eeba-1a82-420b-af49-571b749e15f4\" (UID: \"9ab5eeba-1a82-420b-af49-571b749e15f4\") "
Jul 23 18:09:56.528358 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.528327    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-bundle" (OuterVolumeSpecName: "bundle") pod "9ab5eeba-1a82-420b-af49-571b749e15f4" (UID: "9ab5eeba-1a82-420b-af49-571b749e15f4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:09:56.529886 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.529856    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab5eeba-1a82-420b-af49-571b749e15f4-kube-api-access-frhfv" (OuterVolumeSpecName: "kube-api-access-frhfv") pod "9ab5eeba-1a82-420b-af49-571b749e15f4" (UID: "9ab5eeba-1a82-420b-af49-571b749e15f4"). InnerVolumeSpecName "kube-api-access-frhfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:09:56.533234 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.533192    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-util" (OuterVolumeSpecName: "util") pod "9ab5eeba-1a82-420b-af49-571b749e15f4" (UID: "9ab5eeba-1a82-420b-af49-571b749e15f4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:09:56.628691 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.628656    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frhfv\" (UniqueName: \"kubernetes.io/projected/9ab5eeba-1a82-420b-af49-571b749e15f4-kube-api-access-frhfv\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:56.628691 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.628686    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:56.628691 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:56.628695    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ab5eeba-1a82-420b-af49-571b749e15f4-util\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:57.337656 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.337627    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j"
Jul 23 18:09:57.337656 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.337646    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j" event={"ID":"9ab5eeba-1a82-420b-af49-571b749e15f4","Type":"ContainerDied","Data":"baf604dc62d779bf0005ba75c1e257314b57f9bf1ed76bfb2bd68c387d3c725a"}
Jul 23 18:09:57.338100 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.337691    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="baf604dc62d779bf0005ba75c1e257314b57f9bf1ed76bfb2bd68c387d3c725a"
Jul 23 18:09:57.471350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.471320    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:57.538181 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.538144    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-bundle\") pod \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") "
Jul 23 18:09:57.538377 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.538202    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-util\") pod \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") "
Jul 23 18:09:57.538377 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.538296    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47wbc\" (UniqueName: \"kubernetes.io/projected/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-kube-api-access-47wbc\") pod \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\" (UID: \"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806\") "
Jul 23 18:09:57.538717 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.538688    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-bundle" (OuterVolumeSpecName: "bundle") pod "a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" (UID: "a2f6376f-f6a2-4a8c-8aaf-6a029fc82806"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:09:57.540448 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.540423    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-kube-api-access-47wbc" (OuterVolumeSpecName: "kube-api-access-47wbc") pod "a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" (UID: "a2f6376f-f6a2-4a8c-8aaf-6a029fc82806"). InnerVolumeSpecName "kube-api-access-47wbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:09:57.543896 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.543863    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-util" (OuterVolumeSpecName: "util") pod "a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" (UID: "a2f6376f-f6a2-4a8c-8aaf-6a029fc82806"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:09:57.639761 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.639666    2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-util\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:57.639761 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.639702    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47wbc\" (UniqueName: \"kubernetes.io/projected/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-kube-api-access-47wbc\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:57.639761 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:57.639712    2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f6376f-f6a2-4a8c-8aaf-6a029fc82806-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:09:58.345154 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:58.345126    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z"
Jul 23 18:09:58.345612 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:58.345155    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z" event={"ID":"a2f6376f-f6a2-4a8c-8aaf-6a029fc82806","Type":"ContainerDied","Data":"51cfc162d64e68c5ea227671bb64835b9a06ee867ea5857e2ab61e1acb5c527f"}
Jul 23 18:09:58.345612 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:09:58.345201    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51cfc162d64e68c5ea227671bb64835b9a06ee867ea5857e2ab61e1acb5c527f"
Jul 23 18:10:05.127811 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:05.127765    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:07.767365 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767327    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"]
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767684    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" containerName="util"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767694    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" containerName="util"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767703    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" containerName="pull"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767708    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" containerName="pull"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767719    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab5eeba-1a82-420b-af49-571b749e15f4" containerName="util"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767725    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab5eeba-1a82-420b-af49-571b749e15f4" containerName="util"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767732    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" containerName="pull"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767737    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" containerName="pull"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767747    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff7e150-95de-4985-8325-b60321b22295" containerName="util"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767751    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff7e150-95de-4985-8325-b60321b22295" containerName="util"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767758    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab5eeba-1a82-420b-af49-571b749e15f4" containerName="extract"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767763    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab5eeba-1a82-420b-af49-571b749e15f4" containerName="extract"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767770    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" containerName="extract"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767775    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" containerName="extract"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767784    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" containerName="util"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767790    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" containerName="util"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767796    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" containerName="extract"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767801    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" containerName="extract"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767808    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab5eeba-1a82-420b-af49-571b749e15f4" containerName="pull"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767813    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab5eeba-1a82-420b-af49-571b749e15f4" containerName="pull"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767825    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff7e150-95de-4985-8325-b60321b22295" containerName="extract"
Jul 23 18:10:07.767819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767831    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff7e150-95de-4985-8325-b60321b22295" containerName="extract"
Jul 23 18:10:07.768516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767839    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff7e150-95de-4985-8325-b60321b22295" containerName="pull"
Jul 23 18:10:07.768516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767844    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff7e150-95de-4985-8325-b60321b22295" containerName="pull"
Jul 23 18:10:07.768516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767895    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ab5eeba-1a82-420b-af49-571b749e15f4" containerName="extract"
Jul 23 18:10:07.768516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767902    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff7e150-95de-4985-8325-b60321b22295" containerName="extract"
Jul 23 18:10:07.768516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767913    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2f6376f-f6a2-4a8c-8aaf-6a029fc82806" containerName="extract"
Jul 23 18:10:07.768516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.767919    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1596d7a7-f6ef-461f-a4e5-18d365dcb6ed" containerName="extract"
Jul 23 18:10:07.772273 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.772257    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:07.775336 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.775315    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bpwpb\""
Jul 23 18:10:07.781346 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.781324    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"]
Jul 23 18:10:07.941792 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:07.941757    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt9x4\" (UniqueName: \"kubernetes.io/projected/51050f98-b5b0-4963-9bf6-dc5047a627dc-kube-api-access-qt9x4\") pod \"limitador-operator-controller-manager-859d7b78bd-xnxc7\" (UID: \"51050f98-b5b0-4963-9bf6-dc5047a627dc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:08.042848 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:08.042740    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt9x4\" (UniqueName: \"kubernetes.io/projected/51050f98-b5b0-4963-9bf6-dc5047a627dc-kube-api-access-qt9x4\") pod \"limitador-operator-controller-manager-859d7b78bd-xnxc7\" (UID: \"51050f98-b5b0-4963-9bf6-dc5047a627dc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:08.054482 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:08.054444    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt9x4\" (UniqueName: \"kubernetes.io/projected/51050f98-b5b0-4963-9bf6-dc5047a627dc-kube-api-access-qt9x4\") pod \"limitador-operator-controller-manager-859d7b78bd-xnxc7\" (UID: \"51050f98-b5b0-4963-9bf6-dc5047a627dc\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:08.082772 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:08.082740    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:08.238059 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:08.238028    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"]
Jul 23 18:10:08.239010 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:10:08.238983    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51050f98_b5b0_4963_9bf6_dc5047a627dc.slice/crio-05a4c5cf85e0400ecdd780ef130f126c7c93cca39c1ef0ff7a37d4bde894b586 WatchSource:0}: Error finding container 05a4c5cf85e0400ecdd780ef130f126c7c93cca39c1ef0ff7a37d4bde894b586: Status 404 returned error can't find the container with id 05a4c5cf85e0400ecdd780ef130f126c7c93cca39c1ef0ff7a37d4bde894b586
Jul 23 18:10:08.401799 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:08.401768    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7" event={"ID":"51050f98-b5b0-4963-9bf6-dc5047a627dc","Type":"ContainerStarted","Data":"05a4c5cf85e0400ecdd780ef130f126c7c93cca39c1ef0ff7a37d4bde894b586"}
Jul 23 18:10:08.736387 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:08.736301    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:08.838949 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:08.838918    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:10.416739 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:10.416705    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7" event={"ID":"51050f98-b5b0-4963-9bf6-dc5047a627dc","Type":"ContainerStarted","Data":"735bfe3a960ae5287ebeaac28960e4d3f33f5b045baec2cc5f18bd632a44fbe3"}
Jul 23 18:10:10.417130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:10.416871    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:10.441578 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:10.441530    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7" podStartSLOduration=1.430406471 podStartE2EDuration="3.441513004s" totalImagesPullingTime="2.011106533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:10.440202609 +0000 UTC m=+470.803046459" watchObservedRunningTime="2026-07-23 18:10:10.441513004 +0000 UTC m=+470.804356858"
Jul 23 18:10:12.726022 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.725984    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"]
Jul 23 18:10:12.729386 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.729359    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:12.733029 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.733006    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hhrwg\""
Jul 23 18:10:12.744508 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.744478    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"]
Jul 23 18:10:12.793325 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.793292    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/432d505b-0a96-43c3-87c9-ea4022f3bad7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" (UID: \"432d505b-0a96-43c3-87c9-ea4022f3bad7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:12.793500 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.793344    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6j8g\" (UniqueName: \"kubernetes.io/projected/432d505b-0a96-43c3-87c9-ea4022f3bad7-kube-api-access-w6j8g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" (UID: \"432d505b-0a96-43c3-87c9-ea4022f3bad7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:12.894472 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.894426    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/432d505b-0a96-43c3-87c9-ea4022f3bad7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" (UID: \"432d505b-0a96-43c3-87c9-ea4022f3bad7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:12.894679 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.894493    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6j8g\" (UniqueName: \"kubernetes.io/projected/432d505b-0a96-43c3-87c9-ea4022f3bad7-kube-api-access-w6j8g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" (UID: \"432d505b-0a96-43c3-87c9-ea4022f3bad7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:12.894873 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.894849    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/432d505b-0a96-43c3-87c9-ea4022f3bad7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" (UID: \"432d505b-0a96-43c3-87c9-ea4022f3bad7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:12.904652 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.904620    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6j8g\" (UniqueName: \"kubernetes.io/projected/432d505b-0a96-43c3-87c9-ea4022f3bad7-kube-api-access-w6j8g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" (UID: \"432d505b-0a96-43c3-87c9-ea4022f3bad7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:12.920906 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:12.920869    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:13.040384 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:13.040287    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:13.183086 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:13.183057    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"]
Jul 23 18:10:13.184943 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:10:13.184911    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432d505b_0a96_43c3_87c9_ea4022f3bad7.slice/crio-e153a8440f433c1dbeaf191a7c87fc55af9c31e3e2de038389b625435f1cd7bc WatchSource:0}: Error finding container e153a8440f433c1dbeaf191a7c87fc55af9c31e3e2de038389b625435f1cd7bc: Status 404 returned error can't find the container with id e153a8440f433c1dbeaf191a7c87fc55af9c31e3e2de038389b625435f1cd7bc
Jul 23 18:10:13.318077 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:13.318043    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:13.433805 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:13.433770    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct" event={"ID":"432d505b-0a96-43c3-87c9-ea4022f3bad7","Type":"ContainerStarted","Data":"e153a8440f433c1dbeaf191a7c87fc55af9c31e3e2de038389b625435f1cd7bc"}
Jul 23 18:10:14.777703 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:14.777671    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:15.039405 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:15.039319    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v"]
Jul 23 18:10:15.043537 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:15.043504    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v"
Jul 23 18:10:15.046401 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:15.046379    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zfb87\""
Jul 23 18:10:15.054130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:15.054106    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v"]
Jul 23 18:10:15.114515 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:15.114474    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw7mk\" (UniqueName: \"kubernetes.io/projected/35bf8764-4d6f-4fff-a559-4da1fcc1b6de-kube-api-access-bw7mk\") pod \"authorino-operator-75cc8d5cb7-q6m5v\" (UID: \"35bf8764-4d6f-4fff-a559-4da1fcc1b6de\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v"
Jul 23 18:10:15.215618 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:15.215575    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw7mk\" (UniqueName: \"kubernetes.io/projected/35bf8764-4d6f-4fff-a559-4da1fcc1b6de-kube-api-access-bw7mk\") pod \"authorino-operator-75cc8d5cb7-q6m5v\" (UID: \"35bf8764-4d6f-4fff-a559-4da1fcc1b6de\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v"
Jul 23 18:10:15.225476 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:15.225444    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw7mk\" (UniqueName: \"kubernetes.io/projected/35bf8764-4d6f-4fff-a559-4da1fcc1b6de-kube-api-access-bw7mk\") pod \"authorino-operator-75cc8d5cb7-q6m5v\" (UID: \"35bf8764-4d6f-4fff-a559-4da1fcc1b6de\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v"
Jul 23 18:10:15.357710 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:15.357675    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v"
Jul 23 18:10:15.535735 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:15.535702    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v"]
Jul 23 18:10:15.538157 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:10:15.537754    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35bf8764_4d6f_4fff_a559_4da1fcc1b6de.slice/crio-4413b22b81969b27dae1d88afd9786bf972e4edc1aaae8dd6574f29f69516a10 WatchSource:0}: Error finding container 4413b22b81969b27dae1d88afd9786bf972e4edc1aaae8dd6574f29f69516a10: Status 404 returned error can't find the container with id 4413b22b81969b27dae1d88afd9786bf972e4edc1aaae8dd6574f29f69516a10
Jul 23 18:10:16.344712 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:16.344553    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:16.455013 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:16.454976    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v" event={"ID":"35bf8764-4d6f-4fff-a559-4da1fcc1b6de","Type":"ContainerStarted","Data":"4413b22b81969b27dae1d88afd9786bf972e4edc1aaae8dd6574f29f69516a10"}
Jul 23 18:10:17.164542 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:17.164497    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:18.470410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:18.470352    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v" event={"ID":"35bf8764-4d6f-4fff-a559-4da1fcc1b6de","Type":"ContainerStarted","Data":"d1abe60abbc7cc07337abee7a4ef4938ea40ce96c40b44eafbc5479cbb232342"}
Jul 23 18:10:18.470912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:18.470630    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v"
Jul 23 18:10:18.497253 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:18.496195    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v" podStartSLOduration=1.115729994 podStartE2EDuration="3.496174561s" totalImagesPullingTime="2.380444567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:18.49440232 +0000 UTC m=+478.857246170" watchObservedRunningTime="2026-07-23 18:10:18.496174561 +0000 UTC m=+478.859018411"
Jul 23 18:10:19.227712 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:19.227676    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:19.476890 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:19.476853    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct" event={"ID":"432d505b-0a96-43c3-87c9-ea4022f3bad7","Type":"ContainerStarted","Data":"1e7f008faf21d604a220ff615d05bd274c3b9f72b98f6feb6342b174af7df0e4"}
Jul 23 18:10:19.477278 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:19.476929    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:19.500995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:19.500892    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct" podStartSLOduration=1.403007554 podStartE2EDuration="7.500875155s" totalImagesPullingTime="6.097867601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:19.498587548 +0000 UTC m=+479.861431420" watchObservedRunningTime="2026-07-23 18:10:19.500875155 +0000 UTC m=+479.863719004"
Jul 23 18:10:20.530953 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:20.530865    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:20.635005 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:20.634970    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:21.189783 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:21.189739    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:21.249642 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:21.249603    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:21.424905 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:21.424872    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:22.448756 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.448722    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"]
Jul 23 18:10:22.453679 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.453653    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:22.455953 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.455929    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 23 18:10:22.456077 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.455984    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 23 18:10:22.456077 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.456060    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9jsj5\""
Jul 23 18:10:22.463747 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.463723    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"]
Jul 23 18:10:22.464193 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.464154    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:22.484086 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.484050    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9bsf4\" (UID: \"a5e8b7ae-8335-44ca-8f4f-060c13b0180a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:22.484290 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.484124    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9bsf4\" (UID: \"a5e8b7ae-8335-44ca-8f4f-060c13b0180a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:22.484290 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.484188    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhwgr\" (UniqueName: \"kubernetes.io/projected/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-kube-api-access-lhwgr\") pod \"kuadrant-console-plugin-66b5774985-9bsf4\" (UID: \"a5e8b7ae-8335-44ca-8f4f-060c13b0180a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:22.585614 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.585581    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9bsf4\" (UID: \"a5e8b7ae-8335-44ca-8f4f-060c13b0180a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:22.585614 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.585628    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhwgr\" (UniqueName: \"kubernetes.io/projected/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-kube-api-access-lhwgr\") pod \"kuadrant-console-plugin-66b5774985-9bsf4\" (UID: \"a5e8b7ae-8335-44ca-8f4f-060c13b0180a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:22.585879 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.585673    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9bsf4\" (UID: \"a5e8b7ae-8335-44ca-8f4f-060c13b0180a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:22.585879 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:22.585750    2574 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 23 18:10:22.585879 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:22.585824    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-plugin-serving-cert podName:a5e8b7ae-8335-44ca-8f4f-060c13b0180a nodeName:}" failed. No retries permitted until 2026-07-23 18:10:23.085801396 +0000 UTC m=+483.448645224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9bsf4" (UID: "a5e8b7ae-8335-44ca-8f4f-060c13b0180a") : secret "plugin-serving-cert" not found
Jul 23 18:10:22.586381 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.586363    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9bsf4\" (UID: \"a5e8b7ae-8335-44ca-8f4f-060c13b0180a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:22.594667 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.594646    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhwgr\" (UniqueName: \"kubernetes.io/projected/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-kube-api-access-lhwgr\") pod \"kuadrant-console-plugin-66b5774985-9bsf4\" (UID: \"a5e8b7ae-8335-44ca-8f4f-060c13b0180a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:22.722803 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:22.722704    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:23.092003 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:23.091968    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9bsf4\" (UID: \"a5e8b7ae-8335-44ca-8f4f-060c13b0180a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:23.094486 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:23.094461    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a5e8b7ae-8335-44ca-8f4f-060c13b0180a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9bsf4\" (UID: \"a5e8b7ae-8335-44ca-8f4f-060c13b0180a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:23.363826 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:23.363726    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"
Jul 23 18:10:23.495534 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:23.495508    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4"]
Jul 23 18:10:23.497529 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:10:23.497487    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5e8b7ae_8335_44ca_8f4f_060c13b0180a.slice/crio-356dc270d144b873cd129b6a16c959be2f55c3105ba26bdf2a324345038465b8 WatchSource:0}: Error finding container 356dc270d144b873cd129b6a16c959be2f55c3105ba26bdf2a324345038465b8: Status 404 returned error can't find the container with id 356dc270d144b873cd129b6a16c959be2f55c3105ba26bdf2a324345038465b8
Jul 23 18:10:23.738296 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:23.738187    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:23.794177 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:23.794141    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:24.506654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:24.506615    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4" event={"ID":"a5e8b7ae-8335-44ca-8f4f-060c13b0180a","Type":"ContainerStarted","Data":"356dc270d144b873cd129b6a16c959be2f55c3105ba26bdf2a324345038465b8"}
Jul 23 18:10:24.519548 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:24.519514    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:24.619897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:24.619860    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:29.479662 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:29.479632    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-q6m5v"
Jul 23 18:10:30.486705 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:30.486672    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:31.571843 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:31.571805    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"]
Jul 23 18:10:31.578010 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:31.577977    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:31.604114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:31.604077    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"]
Jul 23 18:10:31.686605 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:31.686572    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a92d4ac8-8880-48c3-b781-aa67bc70a895-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" (UID: \"a92d4ac8-8880-48c3-b781-aa67bc70a895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:31.686605 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:31.686608    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlfr6\" (UniqueName: \"kubernetes.io/projected/a92d4ac8-8880-48c3-b781-aa67bc70a895-kube-api-access-qlfr6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" (UID: \"a92d4ac8-8880-48c3-b781-aa67bc70a895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:31.788072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:31.788032    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a92d4ac8-8880-48c3-b781-aa67bc70a895-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" (UID: \"a92d4ac8-8880-48c3-b781-aa67bc70a895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:31.788072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:31.788074    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlfr6\" (UniqueName: \"kubernetes.io/projected/a92d4ac8-8880-48c3-b781-aa67bc70a895-kube-api-access-qlfr6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" (UID: \"a92d4ac8-8880-48c3-b781-aa67bc70a895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:31.788545 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:31.788508    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a92d4ac8-8880-48c3-b781-aa67bc70a895-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" (UID: \"a92d4ac8-8880-48c3-b781-aa67bc70a895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:31.800527 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:31.800488    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlfr6\" (UniqueName: \"kubernetes.io/projected/a92d4ac8-8880-48c3-b781-aa67bc70a895-kube-api-access-qlfr6\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" (UID: \"a92d4ac8-8880-48c3-b781-aa67bc70a895\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:31.891553 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:31.891454    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:32.244950 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.244864    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f87b69b-xcwb8"]
Jul 23 18:10:32.429753 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.429704    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:32.540122 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.540020    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:32.569107 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.569073    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"]
Jul 23 18:10:32.583562 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.583533    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"]
Jul 23 18:10:32.619063 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.619019    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"]
Jul 23 18:10:32.619360 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.619326    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" containerName="manager" containerID="cri-o://1e7f008faf21d604a220ff615d05bd274c3b9f72b98f6feb6342b174af7df0e4" gracePeriod=2
Jul 23 18:10:32.626214 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.626187    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"]
Jul 23 18:10:32.638275 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.636832    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"]
Jul 23 18:10:32.638275 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.637463    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" containerName="manager"
Jul 23 18:10:32.638275 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.637483    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" containerName="manager"
Jul 23 18:10:32.638275 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.637579    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" containerName="manager"
Jul 23 18:10:32.641153 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.641128    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"]
Jul 23 18:10:32.641328 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.641293    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:10:32.641396 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.641365    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" containerName="manager" containerID="cri-o://735bfe3a960ae5287ebeaac28960e4d3f33f5b045baec2cc5f18bd632a44fbe3" gracePeriod=2
Jul 23 18:10:32.656350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.656276    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"]
Jul 23 18:10:32.684033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.683958    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"]
Jul 23 18:10:32.686249 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:32.686011    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:32.687739 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.687710    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"]
Jul 23 18:10:32.688358 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.688336    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" containerName="manager"
Jul 23 18:10:32.688487 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.688474    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" containerName="manager"
Jul 23 18:10:32.688729 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.688715    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" containerName="manager"
Jul 23 18:10:32.688902 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:32.688867    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xnxc7\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:32.692097 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:32.691930    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:32.693360 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.693338    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:32.709569 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.709538    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:32.716816 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.716736    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"]
Jul 23 18:10:32.718803 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:32.718658    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xnxc7\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:32.722048 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:32.721885    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:32.798330 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.798209    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wngt\" (UniqueName: \"kubernetes.io/projected/f87da6d7-0e20-4ac3-8962-b796258e4f8a-kube-api-access-8wngt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5js6d\" (UID: \"f87da6d7-0e20-4ac3-8962-b796258e4f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:32.798490 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.798384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/016337de-cc7c-4a11-a240-86c0162ea614-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pfcp7\" (UID: \"016337de-cc7c-4a11-a240-86c0162ea614\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:10:32.798556 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.798499    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdfs2\" (UniqueName: \"kubernetes.io/projected/016337de-cc7c-4a11-a240-86c0162ea614-kube-api-access-fdfs2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pfcp7\" (UID: \"016337de-cc7c-4a11-a240-86c0162ea614\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:10:32.798556 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.798540    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f87da6d7-0e20-4ac3-8962-b796258e4f8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5js6d\" (UID: \"f87da6d7-0e20-4ac3-8962-b796258e4f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:32.851150 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.851103    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:32.899913 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.899873    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wngt\" (UniqueName: \"kubernetes.io/projected/f87da6d7-0e20-4ac3-8962-b796258e4f8a-kube-api-access-8wngt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5js6d\" (UID: \"f87da6d7-0e20-4ac3-8962-b796258e4f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:32.900097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.899959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/016337de-cc7c-4a11-a240-86c0162ea614-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pfcp7\" (UID: \"016337de-cc7c-4a11-a240-86c0162ea614\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:10:32.900097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.900022    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdfs2\" (UniqueName: \"kubernetes.io/projected/016337de-cc7c-4a11-a240-86c0162ea614-kube-api-access-fdfs2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pfcp7\" (UID: \"016337de-cc7c-4a11-a240-86c0162ea614\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:10:32.900097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.900050    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f87da6d7-0e20-4ac3-8962-b796258e4f8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5js6d\" (UID: \"f87da6d7-0e20-4ac3-8962-b796258e4f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:32.900438 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.900406    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/016337de-cc7c-4a11-a240-86c0162ea614-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pfcp7\" (UID: \"016337de-cc7c-4a11-a240-86c0162ea614\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:10:32.900530 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.900512    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f87da6d7-0e20-4ac3-8962-b796258e4f8a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5js6d\" (UID: \"f87da6d7-0e20-4ac3-8962-b796258e4f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:32.931772 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.931738    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdfs2\" (UniqueName: \"kubernetes.io/projected/016337de-cc7c-4a11-a240-86c0162ea614-kube-api-access-fdfs2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-pfcp7\" (UID: \"016337de-cc7c-4a11-a240-86c0162ea614\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:10:32.931772 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.931762    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wngt\" (UniqueName: \"kubernetes.io/projected/f87da6d7-0e20-4ac3-8962-b796258e4f8a-kube-api-access-8wngt\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5js6d\" (UID: \"f87da6d7-0e20-4ac3-8962-b796258e4f8a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:32.967146 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:32.967105    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:33.031001 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:33.030952    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:10:33.039475 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:33.039450    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:35.065537 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:35.065491    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:35.166379 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:35.166337    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:39.364781 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:39.364742    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:39.468113 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:39.468070    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:42.539638 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:42.539591    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:42.644367 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:42.644293    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:46.661383 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.661301    2574 generic.go:356] "Generic (PLEG): container finished" podID="432d505b-0a96-43c3-87c9-ea4022f3bad7" containerID="1e7f008faf21d604a220ff615d05bd274c3b9f72b98f6feb6342b174af7df0e4" exitCode=0
Jul 23 18:10:46.661383 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.661381    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e153a8440f433c1dbeaf191a7c87fc55af9c31e3e2de038389b625435f1cd7bc"
Jul 23 18:10:46.662882 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.662858    2574 generic.go:356] "Generic (PLEG): container finished" podID="51050f98-b5b0-4963-9bf6-dc5047a627dc" containerID="735bfe3a960ae5287ebeaac28960e4d3f33f5b045baec2cc5f18bd632a44fbe3" exitCode=0
Jul 23 18:10:46.663010 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.662910    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05a4c5cf85e0400ecdd780ef130f126c7c93cca39c1ef0ff7a37d4bde894b586"
Jul 23 18:10:46.677645 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.677616    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:46.680101 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:46.680073    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xnxc7\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:46.683697 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.683669    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:46.684742 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.684712    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:46.686893 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:46.686863    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xnxc7\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:46.688798 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:46.688770    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:46.807116 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.803130    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"]
Jul 23 18:10:46.807459 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.807392    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"]
Jul 23 18:10:46.808368 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:10:46.808317    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016337de_cc7c_4a11_a240_86c0162ea614.slice/crio-950aabed2834ebd1e79ddb096adcea8529bac68734177f0e7e1ffe7e43263e87 WatchSource:0}: Error finding container 950aabed2834ebd1e79ddb096adcea8529bac68734177f0e7e1ffe7e43263e87: Status 404 returned error can't find the container with id 950aabed2834ebd1e79ddb096adcea8529bac68734177f0e7e1ffe7e43263e87
Jul 23 18:10:46.843493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.843469    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt9x4\" (UniqueName: \"kubernetes.io/projected/51050f98-b5b0-4963-9bf6-dc5047a627dc-kube-api-access-qt9x4\") pod \"51050f98-b5b0-4963-9bf6-dc5047a627dc\" (UID: \"51050f98-b5b0-4963-9bf6-dc5047a627dc\") "
Jul 23 18:10:46.843590 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.843521    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6j8g\" (UniqueName: \"kubernetes.io/projected/432d505b-0a96-43c3-87c9-ea4022f3bad7-kube-api-access-w6j8g\") pod \"432d505b-0a96-43c3-87c9-ea4022f3bad7\" (UID: \"432d505b-0a96-43c3-87c9-ea4022f3bad7\") "
Jul 23 18:10:46.843658 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.843631    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/432d505b-0a96-43c3-87c9-ea4022f3bad7-extensions-socket-volume\") pod \"432d505b-0a96-43c3-87c9-ea4022f3bad7\" (UID: \"432d505b-0a96-43c3-87c9-ea4022f3bad7\") "
Jul 23 18:10:46.844051 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.844023    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/432d505b-0a96-43c3-87c9-ea4022f3bad7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "432d505b-0a96-43c3-87c9-ea4022f3bad7" (UID: "432d505b-0a96-43c3-87c9-ea4022f3bad7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:10:46.845636 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.845615    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51050f98-b5b0-4963-9bf6-dc5047a627dc-kube-api-access-qt9x4" (OuterVolumeSpecName: "kube-api-access-qt9x4") pod "51050f98-b5b0-4963-9bf6-dc5047a627dc" (UID: "51050f98-b5b0-4963-9bf6-dc5047a627dc"). InnerVolumeSpecName "kube-api-access-qt9x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:10:46.845757 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.845695    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/432d505b-0a96-43c3-87c9-ea4022f3bad7-kube-api-access-w6j8g" (OuterVolumeSpecName: "kube-api-access-w6j8g") pod "432d505b-0a96-43c3-87c9-ea4022f3bad7" (UID: "432d505b-0a96-43c3-87c9-ea4022f3bad7"). InnerVolumeSpecName "kube-api-access-w6j8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:10:46.944548 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.944522    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/432d505b-0a96-43c3-87c9-ea4022f3bad7-extensions-socket-volume\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:46.944628 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.944554    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt9x4\" (UniqueName: \"kubernetes.io/projected/51050f98-b5b0-4963-9bf6-dc5047a627dc-kube-api-access-qt9x4\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:46.944628 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:46.944569    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6j8g\" (UniqueName: \"kubernetes.io/projected/432d505b-0a96-43c3-87c9-ea4022f3bad7-kube-api-access-w6j8g\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:47.677497 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.677403    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4" event={"ID":"a5e8b7ae-8335-44ca-8f4f-060c13b0180a","Type":"ContainerStarted","Data":"483409f02105714f6ee5ea59075520926bfdc2700e1baf0aa7967407bd2fdcfd"}
Jul 23 18:10:47.679008 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.678984    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d" event={"ID":"f87da6d7-0e20-4ac3-8962-b796258e4f8a","Type":"ContainerStarted","Data":"3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524"}
Jul 23 18:10:47.679133 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.679048    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d" event={"ID":"f87da6d7-0e20-4ac3-8962-b796258e4f8a","Type":"ContainerStarted","Data":"cfbb415cfa81b8b224ff675b01efcc2bed102b7fc0262d435a66a647c3165546"}
Jul 23 18:10:47.679133 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.679094    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:47.679989 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:47.679961    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xnxc7\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:47.680702 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.680675    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7" event={"ID":"016337de-cc7c-4a11-a240-86c0162ea614","Type":"ContainerStarted","Data":"8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7"}
Jul 23 18:10:47.680827 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.680720    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7" event={"ID":"016337de-cc7c-4a11-a240-86c0162ea614","Type":"ContainerStarted","Data":"950aabed2834ebd1e79ddb096adcea8529bac68734177f0e7e1ffe7e43263e87"}
Jul 23 18:10:47.680827 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.680748    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:10:47.680827 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.680754    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:47.680981 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.680757    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:47.683325 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:47.683293    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:47.703110 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.703064    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9bsf4" podStartSLOduration=2.510891396 podStartE2EDuration="25.703049141s" totalImagesPullingTime="23.192157745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:47.701803459 +0000 UTC m=+508.064647309" watchObservedRunningTime="2026-07-23 18:10:47.703049141 +0000 UTC m=+508.065892968"
Jul 23 18:10:47.728639 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.728574    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7" podStartSLOduration=15.728550668 podStartE2EDuration="15.728550668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:47.725809744 +0000 UTC m=+508.088653605" watchObservedRunningTime="2026-07-23 18:10:47.728550668 +0000 UTC m=+508.091394517"
Jul 23 18:10:47.748983 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:47.748939    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-xnxc7\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnxc7"
Jul 23 18:10:47.749630 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:47.749577    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d" podStartSLOduration=15.749555663 podStartE2EDuration="15.749555663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:47.747061364 +0000 UTC m=+508.109905232" watchObservedRunningTime="2026-07-23 18:10:47.749555663 +0000 UTC m=+508.112399512"
Jul 23 18:10:47.751108 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:47.751083    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8w9ct\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8w9ct"
Jul 23 18:10:48.185722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:48.185692    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="432d505b-0a96-43c3-87c9-ea4022f3bad7" path="/var/lib/kubelet/pods/432d505b-0a96-43c3-87c9-ea4022f3bad7/volumes"
Jul 23 18:10:48.186114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:48.186098    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51050f98-b5b0-4963-9bf6-dc5047a627dc" path="/var/lib/kubelet/pods/51050f98-b5b0-4963-9bf6-dc5047a627dc/volumes"
Jul 23 18:10:48.959965 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:48.959920    2574 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-6tjhn_kuadrant-system_a92d4ac8-8880-48c3-b781-aa67bc70a895_0(fd47cd0bbc743f50f78d23bb2f6b1a9d79595db0979fefcc640a8ca40505cbf1): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-6tjhn to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 23 18:10:48.960358 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:48.959989    2574 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-6tjhn_kuadrant-system_a92d4ac8-8880-48c3-b781-aa67bc70a895_0(fd47cd0bbc743f50f78d23bb2f6b1a9d79595db0979fefcc640a8ca40505cbf1): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-6tjhn to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:49.692451 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:49.692412    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:49.694774 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:49.694740    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="a92d4ac8-8880-48c3-b781-aa67bc70a895" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:49.771517 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:49.771480    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:49.773908 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:49.773877    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="a92d4ac8-8880-48c3-b781-aa67bc70a895" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:49.872216 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:49.872177    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a92d4ac8-8880-48c3-b781-aa67bc70a895-extensions-socket-volume\") pod \"a92d4ac8-8880-48c3-b781-aa67bc70a895\" (UID: \"a92d4ac8-8880-48c3-b781-aa67bc70a895\") "
Jul 23 18:10:49.872415 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:49.872257    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlfr6\" (UniqueName: \"kubernetes.io/projected/a92d4ac8-8880-48c3-b781-aa67bc70a895-kube-api-access-qlfr6\") pod \"a92d4ac8-8880-48c3-b781-aa67bc70a895\" (UID: \"a92d4ac8-8880-48c3-b781-aa67bc70a895\") "
Jul 23 18:10:49.872534 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:49.872505    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a92d4ac8-8880-48c3-b781-aa67bc70a895-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a92d4ac8-8880-48c3-b781-aa67bc70a895" (UID: "a92d4ac8-8880-48c3-b781-aa67bc70a895"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:10:49.874306 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:49.874284    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a92d4ac8-8880-48c3-b781-aa67bc70a895-kube-api-access-qlfr6" (OuterVolumeSpecName: "kube-api-access-qlfr6") pod "a92d4ac8-8880-48c3-b781-aa67bc70a895" (UID: "a92d4ac8-8880-48c3-b781-aa67bc70a895"). InnerVolumeSpecName "kube-api-access-qlfr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:10:49.973627 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:49.973536    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a92d4ac8-8880-48c3-b781-aa67bc70a895-extensions-socket-volume\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:49.973627 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:49.973569    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlfr6\" (UniqueName: \"kubernetes.io/projected/a92d4ac8-8880-48c3-b781-aa67bc70a895-kube-api-access-qlfr6\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:50.184855 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:50.184822    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="a92d4ac8-8880-48c3-b781-aa67bc70a895" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:50.185837 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:50.185815    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a92d4ac8-8880-48c3-b781-aa67bc70a895" path="/var/lib/kubelet/pods/a92d4ac8-8880-48c3-b781-aa67bc70a895/volumes"
Jul 23 18:10:50.568164 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:50.568124    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:50.697825 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:50.697794    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:50.700455 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:50.700425    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="a92d4ac8-8880-48c3-b781-aa67bc70a895" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:50.702728 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:50.702700    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6tjhn\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="a92d4ac8-8880-48c3-b781-aa67bc70a895" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6tjhn"
Jul 23 18:10:51.359538 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:51.359451    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:51.459887 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:51.459854    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:53.814289 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:53.814246    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:53.872543 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:53.872499    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:57.272401 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:57.272358    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78f87b69b-xcwb8" podUID="cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" containerName="console" containerID="cri-o://630f976a6521f53114bd80a54db3555517cd3c4876b3e0f9b71d8a65137a1e59" gracePeriod=15
Jul 23 18:10:57.739464 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:57.739429    2574 generic.go:356] "Generic (PLEG): container finished" podID="cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" containerID="630f976a6521f53114bd80a54db3555517cd3c4876b3e0f9b71d8a65137a1e59" exitCode=0
Jul 23 18:10:57.739621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:57.739501    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f87b69b-xcwb8" event={"ID":"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b","Type":"ContainerDied","Data":"630f976a6521f53114bd80a54db3555517cd3c4876b3e0f9b71d8a65137a1e59"}
Jul 23 18:10:58.057475 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.057453    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:10:58.151783 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.151754    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-oauth-serving-cert\") pod \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") "
Jul 23 18:10:58.151783 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.151784    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-service-ca\") pod \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") "
Jul 23 18:10:58.152033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.151842    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbf6g\" (UniqueName: \"kubernetes.io/projected/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-kube-api-access-kbf6g\") pod \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") "
Jul 23 18:10:58.152033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.151893    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-trusted-ca-bundle\") pod \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") "
Jul 23 18:10:58.152033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.151912    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-serving-cert\") pod \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") "
Jul 23 18:10:58.152033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.151936    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-config\") pod \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") "
Jul 23 18:10:58.152033 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.151960    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-oauth-config\") pod \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\" (UID: \"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b\") "
Jul 23 18:10:58.152329 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.152282    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-service-ca" (OuterVolumeSpecName: "service-ca") pod "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" (UID: "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:10:58.152329 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.152309    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" (UID: "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:10:58.152495 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.152476    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" (UID: "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:10:58.152621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.152593    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-config" (OuterVolumeSpecName: "console-config") pod "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" (UID: "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:10:58.154152 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.154128    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" (UID: "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:10:58.154274 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.154186    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-kube-api-access-kbf6g" (OuterVolumeSpecName: "kube-api-access-kbf6g") pod "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" (UID: "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b"). InnerVolumeSpecName "kube-api-access-kbf6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:10:58.154274 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.154258    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" (UID: "cca0cd08-fff3-4c6a-a884-a4df8a9dd66b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:10:58.207417 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.207384    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:58.253716 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.253673    2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-oauth-serving-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:58.253716 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.253709    2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:58.253716 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.253718    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbf6g\" (UniqueName: \"kubernetes.io/projected/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-kube-api-access-kbf6g\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:58.253716 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.253727    2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-trusted-ca-bundle\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:58.254011 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.253739    2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-serving-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:58.254011 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.253752    2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-config\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:58.254011 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.253764    2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b-console-oauth-config\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:58.307493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.307409    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:10:58.688727 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.688685    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:10:58.688895 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.688764    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:58.748552 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.748520    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f87b69b-xcwb8"
Jul 23 18:10:58.748751 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.748517    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f87b69b-xcwb8" event={"ID":"cca0cd08-fff3-4c6a-a884-a4df8a9dd66b","Type":"ContainerDied","Data":"f09f6ab65e0a3225d6bdc942aca928d714e11c26540e90f184f6f92ba4ba5a0b"}
Jul 23 18:10:58.748826 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.748751    2574 scope.go:117] "RemoveContainer" containerID="630f976a6521f53114bd80a54db3555517cd3c4876b3e0f9b71d8a65137a1e59"
Jul 23 18:10:58.761399 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.761370    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"]
Jul 23 18:10:58.761599 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.761576    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d" podUID="f87da6d7-0e20-4ac3-8962-b796258e4f8a" containerName="manager" containerID="cri-o://3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524" gracePeriod=10
Jul 23 18:10:58.779784 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.779754    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f87b69b-xcwb8"]
Jul 23 18:10:58.785459 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:58.785433    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78f87b69b-xcwb8"]
Jul 23 18:10:59.010986 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.010955    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"]
Jul 23 18:10:59.011399 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.011386    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" containerName="console"
Jul 23 18:10:59.011450 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.011401    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" containerName="console"
Jul 23 18:10:59.011483 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.011473    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" containerName="console"
Jul 23 18:10:59.011548 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.011533    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:59.013317 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.013299    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:10:59.028692 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.028664    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"]
Jul 23 18:10:59.060532 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.060494    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wngt\" (UniqueName: \"kubernetes.io/projected/f87da6d7-0e20-4ac3-8962-b796258e4f8a-kube-api-access-8wngt\") pod \"f87da6d7-0e20-4ac3-8962-b796258e4f8a\" (UID: \"f87da6d7-0e20-4ac3-8962-b796258e4f8a\") "
Jul 23 18:10:59.060722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.060659    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f87da6d7-0e20-4ac3-8962-b796258e4f8a-extensions-socket-volume\") pod \"f87da6d7-0e20-4ac3-8962-b796258e4f8a\" (UID: \"f87da6d7-0e20-4ac3-8962-b796258e4f8a\") "
Jul 23 18:10:59.060803 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.060779    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jntpg\" (UniqueName: \"kubernetes.io/projected/3b6e196f-ad7f-415e-997c-a2f17da6d627-kube-api-access-jntpg\") pod \"kuadrant-operator-controller-manager-86878c769f-2tgt4\" (UID: \"3b6e196f-ad7f-415e-997c-a2f17da6d627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:10:59.060949 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.060921    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6e196f-ad7f-415e-997c-a2f17da6d627-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2tgt4\" (UID: \"3b6e196f-ad7f-415e-997c-a2f17da6d627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:10:59.061123 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.061096    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87da6d7-0e20-4ac3-8962-b796258e4f8a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f87da6d7-0e20-4ac3-8962-b796258e4f8a" (UID: "f87da6d7-0e20-4ac3-8962-b796258e4f8a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:10:59.062683 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.062660    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f87da6d7-0e20-4ac3-8962-b796258e4f8a-kube-api-access-8wngt" (OuterVolumeSpecName: "kube-api-access-8wngt") pod "f87da6d7-0e20-4ac3-8962-b796258e4f8a" (UID: "f87da6d7-0e20-4ac3-8962-b796258e4f8a"). InnerVolumeSpecName "kube-api-access-8wngt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:10:59.162124 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.162089    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6e196f-ad7f-415e-997c-a2f17da6d627-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2tgt4\" (UID: \"3b6e196f-ad7f-415e-997c-a2f17da6d627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:10:59.162363 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.162183    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jntpg\" (UniqueName: \"kubernetes.io/projected/3b6e196f-ad7f-415e-997c-a2f17da6d627-kube-api-access-jntpg\") pod \"kuadrant-operator-controller-manager-86878c769f-2tgt4\" (UID: \"3b6e196f-ad7f-415e-997c-a2f17da6d627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:10:59.162363 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.162287    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f87da6d7-0e20-4ac3-8962-b796258e4f8a-extensions-socket-volume\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:59.162363 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.162304    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wngt\" (UniqueName: \"kubernetes.io/projected/f87da6d7-0e20-4ac3-8962-b796258e4f8a-kube-api-access-8wngt\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:10:59.162499 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.162484    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6e196f-ad7f-415e-997c-a2f17da6d627-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2tgt4\" (UID: \"3b6e196f-ad7f-415e-997c-a2f17da6d627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:10:59.172398 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.172372    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jntpg\" (UniqueName: \"kubernetes.io/projected/3b6e196f-ad7f-415e-997c-a2f17da6d627-kube-api-access-jntpg\") pod \"kuadrant-operator-controller-manager-86878c769f-2tgt4\" (UID: \"3b6e196f-ad7f-415e-997c-a2f17da6d627\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:10:59.323623 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.323595    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:10:59.481246 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.481203    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"]
Jul 23 18:10:59.483300 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:10:59.483272    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6e196f_ad7f_415e_997c_a2f17da6d627.slice/crio-68b456f8c8d1485f33cf585137efe48a129aa90f5af45008ecb0c9ea55c78eea WatchSource:0}: Error finding container 68b456f8c8d1485f33cf585137efe48a129aa90f5af45008ecb0c9ea55c78eea: Status 404 returned error can't find the container with id 68b456f8c8d1485f33cf585137efe48a129aa90f5af45008ecb0c9ea55c78eea
Jul 23 18:10:59.756349 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.756263    2574 generic.go:356] "Generic (PLEG): container finished" podID="f87da6d7-0e20-4ac3-8962-b796258e4f8a" containerID="3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524" exitCode=0
Jul 23 18:10:59.756349 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.756307    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"
Jul 23 18:10:59.756539 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.756359    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d" event={"ID":"f87da6d7-0e20-4ac3-8962-b796258e4f8a","Type":"ContainerDied","Data":"3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524"}
Jul 23 18:10:59.756539 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.756414    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d" event={"ID":"f87da6d7-0e20-4ac3-8962-b796258e4f8a","Type":"ContainerDied","Data":"cfbb415cfa81b8b224ff675b01efcc2bed102b7fc0262d435a66a647c3165546"}
Jul 23 18:10:59.756539 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.756446    2574 scope.go:117] "RemoveContainer" containerID="3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524"
Jul 23 18:10:59.759196 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.759168    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4" event={"ID":"3b6e196f-ad7f-415e-997c-a2f17da6d627","Type":"ContainerStarted","Data":"fd518d2cbd7f9b20fea2062d3543275a48003acd1957a2b27d359587b50c8a3f"}
Jul 23 18:10:59.759336 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.759218    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4" event={"ID":"3b6e196f-ad7f-415e-997c-a2f17da6d627","Type":"ContainerStarted","Data":"68b456f8c8d1485f33cf585137efe48a129aa90f5af45008ecb0c9ea55c78eea"}
Jul 23 18:10:59.759336 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.759303    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:10:59.766279 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.766263    2574 scope.go:117] "RemoveContainer" containerID="3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524"
Jul 23 18:10:59.766548 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:10:59.766530    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524\": container with ID starting with 3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524 not found: ID does not exist" containerID="3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524"
Jul 23 18:10:59.766606 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.766560    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524"} err="failed to get container status \"3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524\": rpc error: code = NotFound desc = could not find container \"3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524\": container with ID starting with 3f4111ea89d01b8a670f8e632468341d55ed595c610f762efc303dc94404f524 not found: ID does not exist"
Jul 23 18:10:59.784122 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.784076    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4" podStartSLOduration=1.7840614540000002 podStartE2EDuration="1.784061454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:59.781216985 +0000 UTC m=+520.144060835" watchObservedRunningTime="2026-07-23 18:10:59.784061454 +0000 UTC m=+520.146905304"
Jul 23 18:10:59.798629 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.798589    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"]
Jul 23 18:10:59.805867 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:10:59.805843    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5js6d"]
Jul 23 18:11:00.185801 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:00.185770    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cca0cd08-fff3-4c6a-a884-a4df8a9dd66b" path="/var/lib/kubelet/pods/cca0cd08-fff3-4c6a-a884-a4df8a9dd66b/volumes"
Jul 23 18:11:00.186125 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:00.186113    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f87da6d7-0e20-4ac3-8962-b796258e4f8a" path="/var/lib/kubelet/pods/f87da6d7-0e20-4ac3-8962-b796258e4f8a/volumes"
Jul 23 18:11:01.828164 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:01.828123    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:01.916975 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:01.916937    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:10.768429 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:10.768399    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:11:10.825417 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:10.825385    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"]
Jul 23 18:11:10.825626 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:10.825596    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7" podUID="016337de-cc7c-4a11-a240-86c0162ea614" containerName="manager" containerID="cri-o://8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7" gracePeriod=10
Jul 23 18:11:11.082767 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.082741    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:11:11.169099 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.169070    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdfs2\" (UniqueName: \"kubernetes.io/projected/016337de-cc7c-4a11-a240-86c0162ea614-kube-api-access-fdfs2\") pod \"016337de-cc7c-4a11-a240-86c0162ea614\" (UID: \"016337de-cc7c-4a11-a240-86c0162ea614\") "
Jul 23 18:11:11.169316 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.169147    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/016337de-cc7c-4a11-a240-86c0162ea614-extensions-socket-volume\") pod \"016337de-cc7c-4a11-a240-86c0162ea614\" (UID: \"016337de-cc7c-4a11-a240-86c0162ea614\") "
Jul 23 18:11:11.169549 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.169523    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/016337de-cc7c-4a11-a240-86c0162ea614-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "016337de-cc7c-4a11-a240-86c0162ea614" (UID: "016337de-cc7c-4a11-a240-86c0162ea614"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:11:11.171114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.171091    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/016337de-cc7c-4a11-a240-86c0162ea614-kube-api-access-fdfs2" (OuterVolumeSpecName: "kube-api-access-fdfs2") pod "016337de-cc7c-4a11-a240-86c0162ea614" (UID: "016337de-cc7c-4a11-a240-86c0162ea614"). InnerVolumeSpecName "kube-api-access-fdfs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:11:11.269867 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.269833    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdfs2\" (UniqueName: \"kubernetes.io/projected/016337de-cc7c-4a11-a240-86c0162ea614-kube-api-access-fdfs2\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:11:11.269867 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.269858    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/016337de-cc7c-4a11-a240-86c0162ea614-extensions-socket-volume\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:11:11.835116 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.835035    2574 generic.go:356] "Generic (PLEG): container finished" podID="016337de-cc7c-4a11-a240-86c0162ea614" containerID="8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7" exitCode=0
Jul 23 18:11:11.835116 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.835081    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"
Jul 23 18:11:11.835621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.835118    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7" event={"ID":"016337de-cc7c-4a11-a240-86c0162ea614","Type":"ContainerDied","Data":"8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7"}
Jul 23 18:11:11.835621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.835171    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7" event={"ID":"016337de-cc7c-4a11-a240-86c0162ea614","Type":"ContainerDied","Data":"950aabed2834ebd1e79ddb096adcea8529bac68734177f0e7e1ffe7e43263e87"}
Jul 23 18:11:11.835621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.835203    2574 scope.go:117] "RemoveContainer" containerID="8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7"
Jul 23 18:11:11.844573 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.844549    2574 scope.go:117] "RemoveContainer" containerID="8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7"
Jul 23 18:11:11.844812 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:11:11.844795    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7\": container with ID starting with 8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7 not found: ID does not exist" containerID="8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7"
Jul 23 18:11:11.844874 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.844822    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7"} err="failed to get container status \"8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7\": rpc error: code = NotFound desc = could not find container \"8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7\": container with ID starting with 8191370fd083f49576fb46df0b3170713e81d49962026dae4da88368a78ff9c7 not found: ID does not exist"
Jul 23 18:11:11.864118 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.864072    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"]
Jul 23 18:11:11.869044 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:11.869015    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-pfcp7"]
Jul 23 18:11:12.004456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:12.004424    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:12.108302 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:12.108183    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:12.185868 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:12.185834    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="016337de-cc7c-4a11-a240-86c0162ea614" path="/var/lib/kubelet/pods/016337de-cc7c-4a11-a240-86c0162ea614/volumes"
Jul 23 18:11:14.429469 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:14.429427    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:14.528422 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:14.528389    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:15.204344 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.204300    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"]
Jul 23 18:11:15.204758 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.204740    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="016337de-cc7c-4a11-a240-86c0162ea614" containerName="manager"
Jul 23 18:11:15.204817 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.204762    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="016337de-cc7c-4a11-a240-86c0162ea614" containerName="manager"
Jul 23 18:11:15.204817 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.204775    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87da6d7-0e20-4ac3-8962-b796258e4f8a" containerName="manager"
Jul 23 18:11:15.204817 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.204780    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87da6d7-0e20-4ac3-8962-b796258e4f8a" containerName="manager"
Jul 23 18:11:15.204910 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.204860    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="016337de-cc7c-4a11-a240-86c0162ea614" containerName="manager"
Jul 23 18:11:15.204910 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.204872    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f87da6d7-0e20-4ac3-8962-b796258e4f8a" containerName="manager"
Jul 23 18:11:15.226093 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.226048    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:15.299169 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.299122    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"]
Jul 23 18:11:15.299376 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.299280    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.302445 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.302410    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:15.302611 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.302571    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 18:11:15.302611 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.302604    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-p4wdf\""
Jul 23 18:11:15.413782 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.413743    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27c48f64-09ee-441e-b24c-40cf615d962b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.413782 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.413793    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.414018 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.413816    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27c48f64-09ee-441e-b24c-40cf615d962b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.414018 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.413877    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.414018 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.413941    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27c48f64-09ee-441e-b24c-40cf615d962b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.414018 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.413980    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.414018 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.414000    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.414254 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.414020    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9hhw\" (UniqueName: \"kubernetes.io/projected/27c48f64-09ee-441e-b24c-40cf615d962b-kube-api-access-q9hhw\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.414254 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.414041    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515201 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515097    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27c48f64-09ee-441e-b24c-40cf615d962b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515201 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515156    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515201 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515200    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27c48f64-09ee-441e-b24c-40cf615d962b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515269    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515308    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27c48f64-09ee-441e-b24c-40cf615d962b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515365    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515396    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515422    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9hhw\" (UniqueName: \"kubernetes.io/projected/27c48f64-09ee-441e-b24c-40cf615d962b-kube-api-access-q9hhw\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515456    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515702    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.515818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515745    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.516267 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.515939    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.516267 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.516171    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27c48f64-09ee-441e-b24c-40cf615d962b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.516392 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.516333    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.517700 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.517675    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27c48f64-09ee-441e-b24c-40cf615d962b-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.517806 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.517755    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27c48f64-09ee-441e-b24c-40cf615d962b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.524529 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.524505    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27c48f64-09ee-441e-b24c-40cf615d962b-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.524716 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.524696    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9hhw\" (UniqueName: \"kubernetes.io/projected/27c48f64-09ee-441e-b24c-40cf615d962b-kube-api-access-q9hhw\") pod \"maas-default-gateway-openshift-default-56654dcf7-m4tc6\" (UID: \"27c48f64-09ee-441e-b24c-40cf615d962b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.610052 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.610018    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:15.773387 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.773362    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"]
Jul 23 18:11:15.775139 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:11:15.775098    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c48f64_09ee_441e_b24c_40cf615d962b.slice/crio-07d63e9822594646a4c8a264a94690fd2ffad8a9c2e6f7f71186d8f4758aa01d WatchSource:0}: Error finding container 07d63e9822594646a4c8a264a94690fd2ffad8a9c2e6f7f71186d8f4758aa01d: Status 404 returned error can't find the container with id 07d63e9822594646a4c8a264a94690fd2ffad8a9c2e6f7f71186d8f4758aa01d
Jul 23 18:11:15.863200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:15.863169    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6" event={"ID":"27c48f64-09ee-441e-b24c-40cf615d962b","Type":"ContainerStarted","Data":"07d63e9822594646a4c8a264a94690fd2ffad8a9c2e6f7f71186d8f4758aa01d"}
Jul 23 18:11:18.548191 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:18.548158    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:11:18.548558 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:18.548252    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:11:18.548558 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:18.548281    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:11:18.888352 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:18.888313    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6" event={"ID":"27c48f64-09ee-441e-b24c-40cf615d962b","Type":"ContainerStarted","Data":"9d41fe5eea42c338f7d3b412157eb34fc83d5e8b4857089fe80822f0b23f63ac"}
Jul 23 18:11:18.928949 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:18.928886    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6" podStartSLOduration=1.158303057 podStartE2EDuration="3.928864197s" totalImagesPullingTime="2.77056114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:18.927584419 +0000 UTC m=+539.290428290" watchObservedRunningTime="2026-07-23 18:11:18.928864197 +0000 UTC m=+539.291708047"
Jul 23 18:11:19.610629 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:19.610593    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:19.616311 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:19.616280    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:19.894586 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:19.894493    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:19.895582 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:19.895565    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:11:22.354007 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:22.353967    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:28.140744 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.140695    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:28.149434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.149400    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"]
Jul 23 18:11:28.155122 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.155100    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:28.158277 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.158254    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 18:11:28.163998 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.163973    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"]
Jul 23 18:11:28.237374 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.237272    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-config-file\") pod \"limitador-limitador-64c94fd64f-ddf9r\" (UID: \"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:28.237577 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.237497    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tf69\" (UniqueName: \"kubernetes.io/projected/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-kube-api-access-7tf69\") pod \"limitador-limitador-64c94fd64f-ddf9r\" (UID: \"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:28.250125 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.250089    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"]
Jul 23 18:11:28.260635 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.260599    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:28.324172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.324132    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:28.338867 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.338836    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-config-file\") pod \"limitador-limitador-64c94fd64f-ddf9r\" (UID: \"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:28.339045 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.338980    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tf69\" (UniqueName: \"kubernetes.io/projected/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-kube-api-access-7tf69\") pod \"limitador-limitador-64c94fd64f-ddf9r\" (UID: \"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:28.339573 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.339552    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-config-file\") pod \"limitador-limitador-64c94fd64f-ddf9r\" (UID: \"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:28.350180 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.350148    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tf69\" (UniqueName: \"kubernetes.io/projected/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-kube-api-access-7tf69\") pod \"limitador-limitador-64c94fd64f-ddf9r\" (UID: \"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:28.407654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.407569    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:11:28.411270 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.411245    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"
Jul 23 18:11:28.422747 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.422720    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:11:28.440385 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.440356    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq59v\" (UniqueName: \"kubernetes.io/projected/e3c7620d-ebb6-4564-97e0-1b1942524880-kube-api-access-wq59v\") pod \"limitador-limitador-54d6d988d5-pqwtd\" (UID: \"e3c7620d-ebb6-4564-97e0-1b1942524880\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"
Jul 23 18:11:28.440526 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.440483    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3c7620d-ebb6-4564-97e0-1b1942524880-config-file\") pod \"limitador-limitador-54d6d988d5-pqwtd\" (UID: \"e3c7620d-ebb6-4564-97e0-1b1942524880\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"
Jul 23 18:11:28.450629 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.450601    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:11:28.467554 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.467521    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:28.541683 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.541513    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq59v\" (UniqueName: \"kubernetes.io/projected/e3c7620d-ebb6-4564-97e0-1b1942524880-kube-api-access-wq59v\") pod \"limitador-limitador-54d6d988d5-pqwtd\" (UID: \"e3c7620d-ebb6-4564-97e0-1b1942524880\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"
Jul 23 18:11:28.541831 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.541775    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3c7620d-ebb6-4564-97e0-1b1942524880-config-file\") pod \"limitador-limitador-54d6d988d5-pqwtd\" (UID: \"e3c7620d-ebb6-4564-97e0-1b1942524880\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"
Jul 23 18:11:28.542418 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.542401    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e3c7620d-ebb6-4564-97e0-1b1942524880-config-file\") pod \"limitador-limitador-54d6d988d5-pqwtd\" (UID: \"e3c7620d-ebb6-4564-97e0-1b1942524880\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"
Jul 23 18:11:28.550607 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.550575    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq59v\" (UniqueName: \"kubernetes.io/projected/e3c7620d-ebb6-4564-97e0-1b1942524880-kube-api-access-wq59v\") pod \"limitador-limitador-54d6d988d5-pqwtd\" (UID: \"e3c7620d-ebb6-4564-97e0-1b1942524880\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"
Jul 23 18:11:28.610366 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.610342    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"]
Jul 23 18:11:28.611932 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:11:28.611909    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e53da4f_2b16_4d6a_a3a9_6e4accd14e73.slice/crio-1aa4edbe48c8467ae73839904baa700f984e32313aac0c06362e1cb0b4b0be98 WatchSource:0}: Error finding container 1aa4edbe48c8467ae73839904baa700f984e32313aac0c06362e1cb0b4b0be98: Status 404 returned error can't find the container with id 1aa4edbe48c8467ae73839904baa700f984e32313aac0c06362e1cb0b4b0be98
Jul 23 18:11:28.722753 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.722646    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"
Jul 23 18:11:28.857103 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.857077    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:11:28.858458 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:11:28.858432    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c7620d_ebb6_4564_97e0_1b1942524880.slice/crio-15e84d2548db81855bece3840cba5e78bd3479dc46f6014eb0a9f5626904e993 WatchSource:0}: Error finding container 15e84d2548db81855bece3840cba5e78bd3479dc46f6014eb0a9f5626904e993: Status 404 returned error can't find the container with id 15e84d2548db81855bece3840cba5e78bd3479dc46f6014eb0a9f5626904e993
Jul 23 18:11:28.945623 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.945588    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd" event={"ID":"e3c7620d-ebb6-4564-97e0-1b1942524880","Type":"ContainerStarted","Data":"15e84d2548db81855bece3840cba5e78bd3479dc46f6014eb0a9f5626904e993"}
Jul 23 18:11:28.946793 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:28.946761    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r" event={"ID":"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73","Type":"ContainerStarted","Data":"1aa4edbe48c8467ae73839904baa700f984e32313aac0c06362e1cb0b4b0be98"}
Jul 23 18:11:29.012495 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:29.012401    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:29.102726 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:29.102678    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:31.968316 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:31.968280    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd" event={"ID":"e3c7620d-ebb6-4564-97e0-1b1942524880","Type":"ContainerStarted","Data":"b4921e8a20d73c754eff7961e43ff4c46b66f0492dab64a9b4147286172526e9"}
Jul 23 18:11:31.968796 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:31.968342    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"
Jul 23 18:11:31.969744 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:31.969722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r" event={"ID":"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73","Type":"ContainerStarted","Data":"3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa"}
Jul 23 18:11:31.969862 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:31.969847    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:31.989446 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:31.989396    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd" podStartSLOduration=1.384775696 podStartE2EDuration="3.989379891s" totalImagesPullingTime="2.604604195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:31.987096698 +0000 UTC m=+552.349940559" watchObservedRunningTime="2026-07-23 18:11:31.989379891 +0000 UTC m=+552.352223739"
Jul 23 18:11:32.006373 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:32.006320    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r" podStartSLOduration=1.1626071119999999 podStartE2EDuration="4.006301715s" totalImagesPullingTime="2.843694603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:32.005529945 +0000 UTC m=+552.368373818" watchObservedRunningTime="2026-07-23 18:11:32.006301715 +0000 UTC m=+552.369145565"
Jul 23 18:11:42.976928 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:42.976894    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"
Jul 23 18:11:42.977330 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:42.976981    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:43.047752 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:43.047718    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"]
Jul 23 18:11:43.047935 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:43.047901    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r" podUID="4e53da4f-2b16-4d6a-a3a9-6e4accd14e73" containerName="limitador" containerID="cri-o://3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa" gracePeriod=30
Jul 23 18:11:43.589819 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:43.589795    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:43.684098 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:43.684005    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tf69\" (UniqueName: \"kubernetes.io/projected/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-kube-api-access-7tf69\") pod \"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73\" (UID: \"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73\") "
Jul 23 18:11:43.684098 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:43.684045    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-config-file\") pod \"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73\" (UID: \"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73\") "
Jul 23 18:11:43.684462 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:43.684440    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-config-file" (OuterVolumeSpecName: "config-file") pod "4e53da4f-2b16-4d6a-a3a9-6e4accd14e73" (UID: "4e53da4f-2b16-4d6a-a3a9-6e4accd14e73"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:11:43.686162 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:43.686143    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-kube-api-access-7tf69" (OuterVolumeSpecName: "kube-api-access-7tf69") pod "4e53da4f-2b16-4d6a-a3a9-6e4accd14e73" (UID: "4e53da4f-2b16-4d6a-a3a9-6e4accd14e73"). InnerVolumeSpecName "kube-api-access-7tf69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:11:43.785128 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:43.785090    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tf69\" (UniqueName: \"kubernetes.io/projected/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-kube-api-access-7tf69\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:11:43.785128 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:43.785122    2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73-config-file\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:11:44.037980 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:44.037885    2574 generic.go:356] "Generic (PLEG): container finished" podID="4e53da4f-2b16-4d6a-a3a9-6e4accd14e73" containerID="3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa" exitCode=0
Jul 23 18:11:44.037980 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:44.037926    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"
Jul 23 18:11:44.038434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:44.037977    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r" event={"ID":"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73","Type":"ContainerDied","Data":"3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa"}
Jul 23 18:11:44.038434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:44.038027    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-ddf9r" event={"ID":"4e53da4f-2b16-4d6a-a3a9-6e4accd14e73","Type":"ContainerDied","Data":"1aa4edbe48c8467ae73839904baa700f984e32313aac0c06362e1cb0b4b0be98"}
Jul 23 18:11:44.038434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:44.038051    2574 scope.go:117] "RemoveContainer" containerID="3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa"
Jul 23 18:11:44.046958 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:44.046936    2574 scope.go:117] "RemoveContainer" containerID="3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa"
Jul 23 18:11:44.047261 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:11:44.047215    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa\": container with ID starting with 3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa not found: ID does not exist" containerID="3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa"
Jul 23 18:11:44.047358 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:44.047274    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa"} err="failed to get container status \"3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa\": rpc error: code = NotFound desc = could not find container \"3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa\": container with ID starting with 3d5dd4312992e75fd9844d7b68d7795bc599f97a35ff2f0cf83fa1ac103ba0fa not found: ID does not exist"
Jul 23 18:11:44.061375 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:44.061346    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"]
Jul 23 18:11:44.065346 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:44.065325    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-ddf9r"]
Jul 23 18:11:44.185871 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:44.185837    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e53da4f-2b16-4d6a-a3a9-6e4accd14e73" path="/var/lib/kubelet/pods/4e53da4f-2b16-4d6a-a3a9-6e4accd14e73/volumes"
Jul 23 18:11:46.498492 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:46.498450    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:46.598503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:46.598458    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:47.048749 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:47.048707    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:58.765369 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:58.765335    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:11:59.252350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:11:59.252317    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:06.724296 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.724255    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:06.746470 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.746436    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-zd4gq"]
Jul 23 18:12:06.747021 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.746996    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e53da4f-2b16-4d6a-a3a9-6e4accd14e73" containerName="limitador"
Jul 23 18:12:06.747021 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.747021    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e53da4f-2b16-4d6a-a3a9-6e4accd14e73" containerName="limitador"
Jul 23 18:12:06.747199 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.747149    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e53da4f-2b16-4d6a-a3a9-6e4accd14e73" containerName="limitador"
Jul 23 18:12:06.754048 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.754023    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:06.756758 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.756729    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 18:12:06.757393 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.757368    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-82546\""
Jul 23 18:12:06.757626 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.757409    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 18:12:06.760200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.760100    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-zd4gq"]
Jul 23 18:12:06.806202 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.806158    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc8z4\" (UniqueName: \"kubernetes.io/projected/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-kube-api-access-dc8z4\") pod \"maas-controller-b9fbb96bd-zd4gq\" (UID: \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\") " pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:06.806407 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.806334    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-webhook-cert\") pod \"maas-controller-b9fbb96bd-zd4gq\" (UID: \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\") " pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:06.807065 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.807042    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:06.864877 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.864839    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:06.907128 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.907086    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-webhook-cert\") pod \"maas-controller-b9fbb96bd-zd4gq\" (UID: \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\") " pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:06.907354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.907163    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc8z4\" (UniqueName: \"kubernetes.io/projected/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-kube-api-access-dc8z4\") pod \"maas-controller-b9fbb96bd-zd4gq\" (UID: \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\") " pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:06.907354 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:12:06.907272    2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 23 18:12:06.907354 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:12:06.907362    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-webhook-cert podName:fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06 nodeName:}" failed. No retries permitted until 2026-07-23 18:12:07.407334076 +0000 UTC m=+587.770177908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-webhook-cert") pod "maas-controller-b9fbb96bd-zd4gq" (UID: "fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06") : secret "maas-controller-webhook-cert" not found
Jul 23 18:12:06.916714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:06.916684    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc8z4\" (UniqueName: \"kubernetes.io/projected/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-kube-api-access-dc8z4\") pod \"maas-controller-b9fbb96bd-zd4gq\" (UID: \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\") " pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:07.412103 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:07.412064    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-webhook-cert\") pod \"maas-controller-b9fbb96bd-zd4gq\" (UID: \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\") " pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:07.414534 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:07.414511    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-webhook-cert\") pod \"maas-controller-b9fbb96bd-zd4gq\" (UID: \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\") " pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:07.424700 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:07.424667    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:07.667836 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:07.667746    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:07.804672 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:07.804646    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-zd4gq"]
Jul 23 18:12:07.807056 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:12:07.807029    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe8ab0a3_016e_4ff6_b4f4_e07f2d60bd06.slice/crio-2cf6caef654476a125d96b657d63f906482024d8f1ae985fa2fba152a0e4ee8d WatchSource:0}: Error finding container 2cf6caef654476a125d96b657d63f906482024d8f1ae985fa2fba152a0e4ee8d: Status 404 returned error can't find the container with id 2cf6caef654476a125d96b657d63f906482024d8f1ae985fa2fba152a0e4ee8d
Jul 23 18:12:08.176276 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:08.176241    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq" event={"ID":"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06","Type":"ContainerStarted","Data":"2cf6caef654476a125d96b657d63f906482024d8f1ae985fa2fba152a0e4ee8d"}
Jul 23 18:12:10.422174 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:10.422131    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:10.512778 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:10.512737    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:11.200572 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:11.200537    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq" event={"ID":"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06","Type":"ContainerStarted","Data":"5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d"}
Jul 23 18:12:11.200755 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:11.200716    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:11.223294 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:11.223214    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq" podStartSLOduration=2.722469906 podStartE2EDuration="5.223195877s" totalImagesPullingTime="2.500725971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:11.220020411 +0000 UTC m=+591.582864278" watchObservedRunningTime="2026-07-23 18:12:11.223195877 +0000 UTC m=+591.586039725"
Jul 23 18:12:20.067174 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:20.067144    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:12:20.074007 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:20.073985    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:12:21.694892 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:21.694847    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-zd4gq"]
Jul 23 18:12:21.697633 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:21.695071    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq" podUID="fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06" containerName="manager" containerID="cri-o://5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d" gracePeriod=30
Jul 23 18:12:21.697633 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:21.696943    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:21.945130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:21.945069    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:22.056628 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.056593    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dc8z4\" (UniqueName: \"kubernetes.io/projected/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-kube-api-access-dc8z4\") pod \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\" (UID: \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\") "
Jul 23 18:12:22.056825 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.056811    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-webhook-cert\") pod \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\" (UID: \"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06\") "
Jul 23 18:12:22.058874 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.058844    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06" (UID: "fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:12:22.058874 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.058861    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-kube-api-access-dc8z4" (OuterVolumeSpecName: "kube-api-access-dc8z4") pod "fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06" (UID: "fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06"). InnerVolumeSpecName "kube-api-access-dc8z4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:12:22.158238 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.158194    2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-webhook-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:12:22.158392 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.158249    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dc8z4\" (UniqueName: \"kubernetes.io/projected/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06-kube-api-access-dc8z4\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:12:22.261072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.260990    2574 generic.go:356] "Generic (PLEG): container finished" podID="fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06" containerID="5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d" exitCode=0
Jul 23 18:12:22.261072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.261031    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq"
Jul 23 18:12:22.261278 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.261073    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq" event={"ID":"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06","Type":"ContainerDied","Data":"5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d"}
Jul 23 18:12:22.261278 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.261121    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b9fbb96bd-zd4gq" event={"ID":"fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06","Type":"ContainerDied","Data":"2cf6caef654476a125d96b657d63f906482024d8f1ae985fa2fba152a0e4ee8d"}
Jul 23 18:12:22.261278 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.261134    2574 scope.go:117] "RemoveContainer" containerID="5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d"
Jul 23 18:12:22.269875 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.269858    2574 scope.go:117] "RemoveContainer" containerID="5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d"
Jul 23 18:12:22.270133 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:12:22.270110    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d\": container with ID starting with 5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d not found: ID does not exist" containerID="5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d"
Jul 23 18:12:22.270185 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.270140    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d"} err="failed to get container status \"5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d\": rpc error: code = NotFound desc = could not find container \"5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d\": container with ID starting with 5a1652e99424edc6a1a2e94494d0845f6a6d23379348005bbab0944265fdab3d not found: ID does not exist"
Jul 23 18:12:22.284503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.284476    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-zd4gq"]
Jul 23 18:12:22.289261 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:22.289218    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b9fbb96bd-zd4gq"]
Jul 23 18:12:24.185719 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:24.185689    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06" path="/var/lib/kubelet/pods/fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06/volumes"
Jul 23 18:12:40.067018 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.066972    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:40.707692 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.707655    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"]
Jul 23 18:12:40.708157 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.708141    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06" containerName="manager"
Jul 23 18:12:40.708215 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.708160    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06" containerName="manager"
Jul 23 18:12:40.708291 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.708268    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe8ab0a3-016e-4ff6-b4f4-e07f2d60bd06" containerName="manager"
Jul 23 18:12:40.713846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.713825    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:40.718347 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.718322    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fr6bq\""
Jul 23 18:12:40.718479 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.718331    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 18:12:40.718479 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.718378    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 18:12:40.718479 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.718381    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 18:12:40.723666 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.723639    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"]
Jul 23 18:12:40.836143 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.836096    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2819b97-92d1-406c-b7ac-2b215ab1988c-openshift-service-ca\") pod \"maas-api-79b7dbcf5c-9dkhc\" (UID: \"a2819b97-92d1-406c-b7ac-2b215ab1988c\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:40.836143 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.836146    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxzpl\" (UniqueName: \"kubernetes.io/projected/a2819b97-92d1-406c-b7ac-2b215ab1988c-kube-api-access-rxzpl\") pod \"maas-api-79b7dbcf5c-9dkhc\" (UID: \"a2819b97-92d1-406c-b7ac-2b215ab1988c\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:40.836412 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.836262    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2819b97-92d1-406c-b7ac-2b215ab1988c-maas-api-tls\") pod \"maas-api-79b7dbcf5c-9dkhc\" (UID: \"a2819b97-92d1-406c-b7ac-2b215ab1988c\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:40.937211 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.937170    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2819b97-92d1-406c-b7ac-2b215ab1988c-maas-api-tls\") pod \"maas-api-79b7dbcf5c-9dkhc\" (UID: \"a2819b97-92d1-406c-b7ac-2b215ab1988c\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:40.937427 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.937327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2819b97-92d1-406c-b7ac-2b215ab1988c-openshift-service-ca\") pod \"maas-api-79b7dbcf5c-9dkhc\" (UID: \"a2819b97-92d1-406c-b7ac-2b215ab1988c\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:40.937427 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.937360    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxzpl\" (UniqueName: \"kubernetes.io/projected/a2819b97-92d1-406c-b7ac-2b215ab1988c-kube-api-access-rxzpl\") pod \"maas-api-79b7dbcf5c-9dkhc\" (UID: \"a2819b97-92d1-406c-b7ac-2b215ab1988c\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:40.937953 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.937931    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2819b97-92d1-406c-b7ac-2b215ab1988c-openshift-service-ca\") pod \"maas-api-79b7dbcf5c-9dkhc\" (UID: \"a2819b97-92d1-406c-b7ac-2b215ab1988c\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:40.939532 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.939513    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2819b97-92d1-406c-b7ac-2b215ab1988c-maas-api-tls\") pod \"maas-api-79b7dbcf5c-9dkhc\" (UID: \"a2819b97-92d1-406c-b7ac-2b215ab1988c\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:40.945873 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:40.945854    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxzpl\" (UniqueName: \"kubernetes.io/projected/a2819b97-92d1-406c-b7ac-2b215ab1988c-kube-api-access-rxzpl\") pod \"maas-api-79b7dbcf5c-9dkhc\" (UID: \"a2819b97-92d1-406c-b7ac-2b215ab1988c\") " pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:41.025169 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.025072    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:41.184999 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.184968    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"]
Jul 23 18:12:41.187070 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:12:41.187044    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2819b97_92d1_406c_b7ac_2b215ab1988c.slice/crio-28ec8e1c6c5aa4ccd157f73b7f8fd535327e9ee7f43043215745f1a92ff8d85b WatchSource:0}: Error finding container 28ec8e1c6c5aa4ccd157f73b7f8fd535327e9ee7f43043215745f1a92ff8d85b: Status 404 returned error can't find the container with id 28ec8e1c6c5aa4ccd157f73b7f8fd535327e9ee7f43043215745f1a92ff8d85b
Jul 23 18:12:41.188533 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.188514    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:12:41.370624 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.370593    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc" event={"ID":"a2819b97-92d1-406c-b7ac-2b215ab1988c","Type":"ContainerStarted","Data":"28ec8e1c6c5aa4ccd157f73b7f8fd535327e9ee7f43043215745f1a92ff8d85b"}
Jul 23 18:12:41.375479 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.375451    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:41.478238 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.478201    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:41.514684 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.514647    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"]
Jul 23 18:12:41.520168 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.520144    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"
Jul 23 18:12:41.523773 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.523750    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-tc252\""
Jul 23 18:12:41.523930 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.523904    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 18:12:41.531105 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.531079    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"]
Jul 23 18:12:41.534253 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.534197    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-l9m2f"]
Jul 23 18:12:41.538035 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.538019    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f"
Jul 23 18:12:41.549493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.549472    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-l9m2f"]
Jul 23 18:12:41.582526 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.582491    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:41.599184 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.599153    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:12:41.643601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.643508    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc362a74-6587-47b8-9def-ede22fee5e3d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-l9m2f\" (UID: \"bc362a74-6587-47b8-9def-ede22fee5e3d\") " pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f"
Jul 23 18:12:41.643746 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.643606    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gssq\" (UniqueName: \"kubernetes.io/projected/bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947-kube-api-access-9gssq\") pod \"payload-pre-processing-7677b774bb-8gbf7\" (UID: \"bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"
Jul 23 18:12:41.643746 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.643714    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b2fj\" (UniqueName: \"kubernetes.io/projected/bc362a74-6587-47b8-9def-ede22fee5e3d-kube-api-access-8b2fj\") pod \"payload-processing-5bf47cd988-l9m2f\" (UID: \"bc362a74-6587-47b8-9def-ede22fee5e3d\") " pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f"
Jul 23 18:12:41.643746 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.643743    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8gbf7\" (UID: \"bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"
Jul 23 18:12:41.744657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.744580    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc362a74-6587-47b8-9def-ede22fee5e3d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-l9m2f\" (UID: \"bc362a74-6587-47b8-9def-ede22fee5e3d\") " pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f"
Jul 23 18:12:41.744657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.744626    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gssq\" (UniqueName: \"kubernetes.io/projected/bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947-kube-api-access-9gssq\") pod \"payload-pre-processing-7677b774bb-8gbf7\" (UID: \"bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"
Jul 23 18:12:41.744863 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.744732    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b2fj\" (UniqueName: \"kubernetes.io/projected/bc362a74-6587-47b8-9def-ede22fee5e3d-kube-api-access-8b2fj\") pod \"payload-processing-5bf47cd988-l9m2f\" (UID: \"bc362a74-6587-47b8-9def-ede22fee5e3d\") " pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f"
Jul 23 18:12:41.744863 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.744764    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8gbf7\" (UID: \"bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"
Jul 23 18:12:41.745569 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.745545    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-8gbf7\" (UID: \"bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"
Jul 23 18:12:41.745823 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.745806    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc362a74-6587-47b8-9def-ede22fee5e3d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-l9m2f\" (UID: \"bc362a74-6587-47b8-9def-ede22fee5e3d\") " pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f"
Jul 23 18:12:41.755038 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.755005    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b2fj\" (UniqueName: \"kubernetes.io/projected/bc362a74-6587-47b8-9def-ede22fee5e3d-kube-api-access-8b2fj\") pod \"payload-processing-5bf47cd988-l9m2f\" (UID: \"bc362a74-6587-47b8-9def-ede22fee5e3d\") " pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f"
Jul 23 18:12:41.755038 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.755026    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gssq\" (UniqueName: \"kubernetes.io/projected/bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947-kube-api-access-9gssq\") pod \"payload-pre-processing-7677b774bb-8gbf7\" (UID: \"bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"
Jul 23 18:12:41.832609 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.832574    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"
Jul 23 18:12:41.849319 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.849294    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f"
Jul 23 18:12:41.997161 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:41.997122    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"]
Jul 23 18:12:41.998891 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:12:41.998861    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd3a5cd0_3a0c_44c5_abd6_1d4b8517a947.slice/crio-7a70c856fa18e4602512640546e0ad2ddb31a3dd76bb841a03a01be39a47bf03 WatchSource:0}: Error finding container 7a70c856fa18e4602512640546e0ad2ddb31a3dd76bb841a03a01be39a47bf03: Status 404 returned error can't find the container with id 7a70c856fa18e4602512640546e0ad2ddb31a3dd76bb841a03a01be39a47bf03
Jul 23 18:12:42.036124 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:42.032253    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-l9m2f"]
Jul 23 18:12:42.381493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:42.381416    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f" event={"ID":"bc362a74-6587-47b8-9def-ede22fee5e3d","Type":"ContainerStarted","Data":"59f93bd58a4eda4179dfcf08cf0c48977156791f6f22c0070a19075ae432c422"}
Jul 23 18:12:42.382897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:42.382863    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7" event={"ID":"bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947","Type":"ContainerStarted","Data":"7a70c856fa18e4602512640546e0ad2ddb31a3dd76bb841a03a01be39a47bf03"}
Jul 23 18:12:44.397900 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:44.397875    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc" event={"ID":"a2819b97-92d1-406c-b7ac-2b215ab1988c","Type":"ContainerStarted","Data":"01ebe0dd9297f5974085482868ebc4721cd83fdc183d5d66cb0acd2fe9e629a1"}
Jul 23 18:12:44.398255 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:44.397994    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:44.418997 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:44.418854    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc" podStartSLOduration=1.936764259 podStartE2EDuration="4.418833581s" totalImagesPullingTime="2.482069322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:44.416276403 +0000 UTC m=+624.779120277" watchObservedRunningTime="2026-07-23 18:12:44.418833581 +0000 UTC m=+624.781677432"
Jul 23 18:12:45.405085 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:45.405048    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f" event={"ID":"bc362a74-6587-47b8-9def-ede22fee5e3d","Type":"ContainerStarted","Data":"6a3f2f0674cc24fd3be5c4b5237dcd92c45f3ad4608b65000edb0bb3a9d38e0c"}
Jul 23 18:12:45.405582 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:45.405214    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f"
Jul 23 18:12:45.406612 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:45.406583    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7" event={"ID":"bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947","Type":"ContainerStarted","Data":"3aed045af74af2c2d6471c71c41488c450b751650a74e88ef57282995d85919b"}
Jul 23 18:12:45.406765 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:45.406750    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"
Jul 23 18:12:45.423786 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:45.423741    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f" podStartSLOduration=2.13028424 podStartE2EDuration="4.423725538s" totalImagesPullingTime="2.293441298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:45.421798087 +0000 UTC m=+625.784641963" watchObservedRunningTime="2026-07-23 18:12:45.423725538 +0000 UTC m=+625.786569386"
Jul 23 18:12:45.439023 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:45.438946    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7" podStartSLOduration=2.093429886 podStartE2EDuration="4.438923555s" totalImagesPullingTime="2.345493669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:45.43810422 +0000 UTC m=+625.800948069" watchObservedRunningTime="2026-07-23 18:12:45.438923555 +0000 UTC m=+625.801767405"
Jul 23 18:12:49.435577 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:49.435541    2574 generic.go:356] "Generic (PLEG): container finished" podID="27c48f64-09ee-441e-b24c-40cf615d962b" containerID="9d41fe5eea42c338f7d3b412157eb34fc83d5e8b4857089fe80822f0b23f63ac" exitCode=0
Jul 23 18:12:49.435994 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:49.435612    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6" event={"ID":"27c48f64-09ee-441e-b24c-40cf615d962b","Type":"ContainerDied","Data":"9d41fe5eea42c338f7d3b412157eb34fc83d5e8b4857089fe80822f0b23f63ac"}
Jul 23 18:12:49.436037 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:49.436003    2574 scope.go:117] "RemoveContainer" containerID="9d41fe5eea42c338f7d3b412157eb34fc83d5e8b4857089fe80822f0b23f63ac"
Jul 23 18:12:49.437133 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:49.437102    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:12:49.437237 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:49.437209    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:12:49.437287 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:49.437271    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:12:49.894918 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:49.894884    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:12:50.412854 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:50.412828    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-79b7dbcf5c-9dkhc"
Jul 23 18:12:50.453249 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:50.451522    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6" event={"ID":"27c48f64-09ee-441e-b24c-40cf615d962b","Type":"ContainerStarted","Data":"cb009c08a39e09619b6a8504c16ffba58c333f6e5cb206291a342debe2866625"}
Jul 23 18:12:50.610723 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:50.610679    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:12:50.611894 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:50.611871    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-m4tc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:12:50.611967 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:50.611917    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6" podUID="27c48f64-09ee-441e-b24c-40cf615d962b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 23 18:12:51.512285 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:51.512246    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:51.610901 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:51.610867    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-m4tc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:12:51.611068 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:51.610922    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6" podUID="27c48f64-09ee-441e-b24c-40cf615d962b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 23 18:12:51.625423 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:51.625393    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:52.610813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:52.610774    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-m4tc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:12:52.611194 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:52.610845    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6" podUID="27c48f64-09ee-441e-b24c-40cf615d962b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 23 18:12:53.611384 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:53.611336    2574 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-m4tc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 23 18:12:53.611855 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:53.611424    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6" podUID="27c48f64-09ee-441e-b24c-40cf615d962b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 23 18:12:54.614949 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:54.614917    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:12:54.615418 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:54.615194    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:12:54.615960 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:54.615942    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-m4tc6"
Jul 23 18:12:56.417043 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:56.417015    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-8gbf7"
Jul 23 18:12:56.417481 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:56.417093    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-l9m2f"
Jul 23 18:12:56.442860 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:56.442828    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:12:56.540144 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:12:56.540107    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:13:04.322003 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:04.321959    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:13:04.805336 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:04.805250    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:13:15.027205 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:15.027162    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:13:15.900782 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:15.900745    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:13:20.635602 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:20.635558    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:13:21.923119 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:21.923077    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:13:26.833655 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:26.833614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:13:28.512114 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:28.512071    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:13:30.230734 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:30.230700    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:13:30.292892 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:30.292860    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:13:33.752774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:33.752739    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:13:35.132237 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:13:35.132188    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:14:07.412472 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.412437    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"]
Jul 23 18:14:07.416390 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.416371    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.420491 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.420465    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8jklp\""
Jul 23 18:14:07.420491 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.420475    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 23 18:14:07.420666 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.420545    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 18:14:07.420666 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.420556    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 18:14:07.426579 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.426555    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"]
Jul 23 18:14:07.426755 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.426731    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:14:07.503235 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.503190    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.503413 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.503251    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.503413 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.503282    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr2vk\" (UniqueName: \"kubernetes.io/projected/568bffd2-bca3-4a8d-a570-551979306b7a-kube-api-access-jr2vk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.503413 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.503313    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.503524 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.503426    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/568bffd2-bca3-4a8d-a570-551979306b7a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.503524 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.503458    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.604455 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.604414    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.604455 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.604454    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.604706 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.604486    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr2vk\" (UniqueName: \"kubernetes.io/projected/568bffd2-bca3-4a8d-a570-551979306b7a-kube-api-access-jr2vk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.604706 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.604525    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.604706 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.604587    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/568bffd2-bca3-4a8d-a570-551979306b7a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.604706 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.604613    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.604937 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.604908    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.605074 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.604957    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.605074 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.604970    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.606866 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.606845    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/568bffd2-bca3-4a8d-a570-551979306b7a-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.607293 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.607270    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/568bffd2-bca3-4a8d-a570-551979306b7a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.614001 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.613981    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr2vk\" (UniqueName: \"kubernetes.io/projected/568bffd2-bca3-4a8d-a570-551979306b7a-kube-api-access-jr2vk\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj\" (UID: \"568bffd2-bca3-4a8d-a570-551979306b7a\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.726552 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.726459    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:07.865286 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.865256    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"]
Jul 23 18:14:07.866995 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:14:07.866971    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod568bffd2_bca3_4a8d_a570_551979306b7a.slice/crio-e6921e1acf087e4a9904853f8c9117381c13b779ec5c49efc1c199105ac27210 WatchSource:0}: Error finding container e6921e1acf087e4a9904853f8c9117381c13b779ec5c49efc1c199105ac27210: Status 404 returned error can't find the container with id e6921e1acf087e4a9904853f8c9117381c13b779ec5c49efc1c199105ac27210
Jul 23 18:14:07.914135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:07.914102    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj" event={"ID":"568bffd2-bca3-4a8d-a570-551979306b7a","Type":"ContainerStarted","Data":"e6921e1acf087e4a9904853f8c9117381c13b779ec5c49efc1c199105ac27210"}
Jul 23 18:14:10.995241 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:10.995188    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:14:11.943542 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:11.943440    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj" event={"ID":"568bffd2-bca3-4a8d-a570-551979306b7a","Type":"ContainerStarted","Data":"1b40fa7560ab8a306554555f7fbbc47618e6d99f81a2fa08f90bbab670dbd2ec"}
Jul 23 18:14:11.964830 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:11.964777    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj" podStartSLOduration=1.803756465 podStartE2EDuration="4.9647602s" totalImagesPullingTime="3.161003735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:14:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:14:11.963470671 +0000 UTC m=+712.326314519" watchObservedRunningTime="2026-07-23 18:14:11.9647602 +0000 UTC m=+712.327604056"
Jul 23 18:14:17.727077 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:17.727037    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:17.727505 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:17.727093    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:17.741868 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:17.741839    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:14:17.988577 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:14:17.988488    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj"
Jul 23 18:15:00.154472 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:00.154435    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7"]
Jul 23 18:15:00.158905 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:00.158887    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7"
Jul 23 18:15:00.161347 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:00.161321    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:15:00.164833 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:00.164808    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7"]
Jul 23 18:15:00.170877 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:00.170857    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7"
Jul 23 18:15:00.317359 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:00.317337    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7"]
Jul 23 18:15:00.319587 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:15:00.319546    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fee0e3b_f2e0_4633_bc4f_7e9070bcee51.slice/crio-1fd6c77e86c824d60c4a1a5ad9df69ffd6de56d9a59642df1aaf5397b54d844f WatchSource:0}: Error finding container 1fd6c77e86c824d60c4a1a5ad9df69ffd6de56d9a59642df1aaf5397b54d844f: Status 404 returned error can't find the container with id 1fd6c77e86c824d60c4a1a5ad9df69ffd6de56d9a59642df1aaf5397b54d844f
Jul 23 18:15:00.732413 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:00.732372    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:15:01.224284 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:01.224247    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7" event={"ID":"3fee0e3b-f2e0-4633-bc4f-7e9070bcee51","Type":"ContainerStarted","Data":"1fd6c77e86c824d60c4a1a5ad9df69ffd6de56d9a59642df1aaf5397b54d844f"}
Jul 23 18:15:01.687393 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:01.687349    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:15:01.744747 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:01.744702    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:15:03.239473 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:03.239433    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7" event={"ID":"3fee0e3b-f2e0-4633-bc4f-7e9070bcee51","Type":"ContainerStarted","Data":"df4803cecaec4d67d42c544c431bae10d5f5cfee52beff55e70530223509158d"}
Jul 23 18:15:03.257474 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:03.257423    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7" podStartSLOduration=0.846119366 podStartE2EDuration="3.257407597s" totalImagesPullingTime="2.411288231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:15:03.255364308 +0000 UTC m=+763.618208155" watchObservedRunningTime="2026-07-23 18:15:03.257407597 +0000 UTC m=+763.620251475"
Jul 23 18:15:04.247685 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:04.247654    2574 generic.go:356] "Generic (PLEG): container finished" podID="3fee0e3b-f2e0-4633-bc4f-7e9070bcee51" containerID="df4803cecaec4d67d42c544c431bae10d5f5cfee52beff55e70530223509158d" exitCode=0
Jul 23 18:15:04.248083 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:04.247735    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7" event={"ID":"3fee0e3b-f2e0-4633-bc4f-7e9070bcee51","Type":"ContainerDied","Data":"df4803cecaec4d67d42c544c431bae10d5f5cfee52beff55e70530223509158d"}
Jul 23 18:15:05.397783 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:05.397761    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7"
Jul 23 18:15:06.260606 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:06.260578    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7"
Jul 23 18:15:06.260768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:06.260615    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747175-w6tm7" event={"ID":"3fee0e3b-f2e0-4633-bc4f-7e9070bcee51","Type":"ContainerDied","Data":"1fd6c77e86c824d60c4a1a5ad9df69ffd6de56d9a59642df1aaf5397b54d844f"}
Jul 23 18:15:06.260768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:06.260661    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fd6c77e86c824d60c4a1a5ad9df69ffd6de56d9a59642df1aaf5397b54d844f"
Jul 23 18:15:16.286542 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:16.286489    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:15:16.348461 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:16.348426    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:15:17.565942 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:17.565906    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:15:17.675611 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:17.675572    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:15:46.106043 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:46.105969    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:15:49.585367 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:49.585315    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:15:55.593266 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:55.593234    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:15:55.977737 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:15:55.977637    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:16:06.602999 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:16:06.602963    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:16:20.153352 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:16:20.153316    2574 scope.go:117] "RemoveContainer" containerID="1e7f008faf21d604a220ff615d05bd274c3b9f72b98f6feb6342b174af7df0e4"
Jul 23 18:16:20.167653 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:16:20.167629    2574 scope.go:117] "RemoveContainer" containerID="735bfe3a960ae5287ebeaac28960e4d3f33f5b045baec2cc5f18bd632a44fbe3"
Jul 23 18:17:20.105181 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:17:20.105097    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:17:20.114853 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:17:20.114832    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:17:23.572625 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:17:23.572586    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:17:24.803290 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:17:24.803252    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:17:50.299542 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:17:50.299509    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:17:58.592137 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:17:58.592093    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:17:59.298653 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:17:59.298618    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:18:02.435798 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:02.435763    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:18:04.865471 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:04.865433    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:18:04.969850 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:04.969798    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:18:05.065106 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:05.065072    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:18:05.248064 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:05.247961    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:18:11.433704 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:11.433663    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:18:11.503608 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:11.503555    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:18:12.127650 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:12.127608    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:18:28.795279 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:28.795240    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:18:37.805586 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:37.805551    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:18:46.507317 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:46.507207    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:18:57.904635 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:18:57.904593    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:19:09.489437 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:19:09.489399    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:19:18.456031 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:19:18.455999    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:19:30.796863 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:19:30.796825    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:19:40.891649 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:19:40.891614    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:20:05.699340 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:20:05.699296    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:20:17.901487 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:20:17.901401    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:20:41.501289 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:20:41.501247    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:21:00.004841 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:21:00.004805    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:21:00.102898 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:21:00.102866    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:21:11.102610 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:21:11.102573    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:21:22.904446 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:21:22.904400    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:21:32.609922 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:21:32.609886    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:21:42.199484 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:21:42.199396    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:21:51.589524 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:21:51.589485    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:22:17.166439 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:17.166399    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"]
Jul 23 18:22:17.166955 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:17.166603    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4" podUID="3b6e196f-ad7f-415e-997c-a2f17da6d627" containerName="manager" containerID="cri-o://fd518d2cbd7f9b20fea2062d3543275a48003acd1957a2b27d359587b50c8a3f" gracePeriod=10
Jul 23 18:22:20.133361 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.133324    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:22:20.146387 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.146359    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:22:20.161872 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.161843    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:22:20.233164 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.233084    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6e196f-ad7f-415e-997c-a2f17da6d627-extensions-socket-volume\") pod \"3b6e196f-ad7f-415e-997c-a2f17da6d627\" (UID: \"3b6e196f-ad7f-415e-997c-a2f17da6d627\") "
Jul 23 18:22:20.233164 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.233119    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jntpg\" (UniqueName: \"kubernetes.io/projected/3b6e196f-ad7f-415e-997c-a2f17da6d627-kube-api-access-jntpg\") pod \"3b6e196f-ad7f-415e-997c-a2f17da6d627\" (UID: \"3b6e196f-ad7f-415e-997c-a2f17da6d627\") "
Jul 23 18:22:20.233576 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.233548    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b6e196f-ad7f-415e-997c-a2f17da6d627-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3b6e196f-ad7f-415e-997c-a2f17da6d627" (UID: "3b6e196f-ad7f-415e-997c-a2f17da6d627"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:22:20.234134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.234111    2574 scope.go:117] "RemoveContainer" containerID="fd518d2cbd7f9b20fea2062d3543275a48003acd1957a2b27d359587b50c8a3f"
Jul 23 18:22:20.235373 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.235351    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b6e196f-ad7f-415e-997c-a2f17da6d627-kube-api-access-jntpg" (OuterVolumeSpecName: "kube-api-access-jntpg") pod "3b6e196f-ad7f-415e-997c-a2f17da6d627" (UID: "3b6e196f-ad7f-415e-997c-a2f17da6d627"). InnerVolumeSpecName "kube-api-access-jntpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:22:20.334736 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.334702    2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b6e196f-ad7f-415e-997c-a2f17da6d627-extensions-socket-volume\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:22:20.334736 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.334729    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jntpg\" (UniqueName: \"kubernetes.io/projected/3b6e196f-ad7f-415e-997c-a2f17da6d627-kube-api-access-jntpg\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:22:20.813143 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.813101    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4" event={"ID":"3b6e196f-ad7f-415e-997c-a2f17da6d627","Type":"ContainerDied","Data":"fd518d2cbd7f9b20fea2062d3543275a48003acd1957a2b27d359587b50c8a3f"}
Jul 23 18:22:20.813364 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.813150    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"
Jul 23 18:22:20.813364 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.813210    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4" event={"ID":"3b6e196f-ad7f-415e-997c-a2f17da6d627","Type":"ContainerDied","Data":"68b456f8c8d1485f33cf585137efe48a129aa90f5af45008ecb0c9ea55c78eea"}
Jul 23 18:22:20.845980 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.845951    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"]
Jul 23 18:22:20.851295 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:20.851266    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2tgt4"]
Jul 23 18:22:22.185467 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:22:22.185437    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b6e196f-ad7f-415e-997c-a2f17da6d627" path="/var/lib/kubelet/pods/3b6e196f-ad7f-415e-997c-a2f17da6d627/volumes"
Jul 23 18:23:18.427648 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.427564    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"]
Jul 23 18:23:18.430214 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.427974    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fee0e3b-f2e0-4633-bc4f-7e9070bcee51" containerName="cleanup"
Jul 23 18:23:18.430214 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.427985    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fee0e3b-f2e0-4633-bc4f-7e9070bcee51" containerName="cleanup"
Jul 23 18:23:18.430214 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.428011    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6e196f-ad7f-415e-997c-a2f17da6d627" containerName="manager"
Jul 23 18:23:18.430214 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.428017    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6e196f-ad7f-415e-997c-a2f17da6d627" containerName="manager"
Jul 23 18:23:18.430214 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.428077    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6e196f-ad7f-415e-997c-a2f17da6d627" containerName="manager"
Jul 23 18:23:18.430214 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.428087    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fee0e3b-f2e0-4633-bc4f-7e9070bcee51" containerName="cleanup"
Jul 23 18:23:18.430446 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.430265    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"
Jul 23 18:23:18.433768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.433749    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hhrwg\""
Jul 23 18:23:18.455007 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.454982    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"]
Jul 23 18:23:18.604284 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.604251    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36635919-09a8-477e-9f9a-7d980e98f240-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qknsf\" (UID: \"36635919-09a8-477e-9f9a-7d980e98f240\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"
Jul 23 18:23:18.604451 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.604297    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9lhx\" (UniqueName: \"kubernetes.io/projected/36635919-09a8-477e-9f9a-7d980e98f240-kube-api-access-f9lhx\") pod \"kuadrant-operator-controller-manager-86878c769f-qknsf\" (UID: \"36635919-09a8-477e-9f9a-7d980e98f240\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"
Jul 23 18:23:18.705578 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.705488    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36635919-09a8-477e-9f9a-7d980e98f240-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qknsf\" (UID: \"36635919-09a8-477e-9f9a-7d980e98f240\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"
Jul 23 18:23:18.705578 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.705537    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9lhx\" (UniqueName: \"kubernetes.io/projected/36635919-09a8-477e-9f9a-7d980e98f240-kube-api-access-f9lhx\") pod \"kuadrant-operator-controller-manager-86878c769f-qknsf\" (UID: \"36635919-09a8-477e-9f9a-7d980e98f240\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"
Jul 23 18:23:18.705892 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.705869    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36635919-09a8-477e-9f9a-7d980e98f240-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qknsf\" (UID: \"36635919-09a8-477e-9f9a-7d980e98f240\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"
Jul 23 18:23:18.717577 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.717552    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9lhx\" (UniqueName: \"kubernetes.io/projected/36635919-09a8-477e-9f9a-7d980e98f240-kube-api-access-f9lhx\") pod \"kuadrant-operator-controller-manager-86878c769f-qknsf\" (UID: \"36635919-09a8-477e-9f9a-7d980e98f240\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"
Jul 23 18:23:18.740127 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.740101    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"
Jul 23 18:23:18.888928 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:18.888899    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"]
Jul 23 18:23:18.891489 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:23:18.891464    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36635919_09a8_477e_9f9a_7d980e98f240.slice/crio-108ac9e776b5c4608f1cd3ef8a12180617f39a08631cf79936fcf8cb4c96fd91 WatchSource:0}: Error finding container 108ac9e776b5c4608f1cd3ef8a12180617f39a08631cf79936fcf8cb4c96fd91: Status 404 returned error can't find the container with id 108ac9e776b5c4608f1cd3ef8a12180617f39a08631cf79936fcf8cb4c96fd91
Jul 23 18:23:19.143892 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:19.143854    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf" event={"ID":"36635919-09a8-477e-9f9a-7d980e98f240","Type":"ContainerStarted","Data":"030f65a1fa427513e7ee2eb7cb2c54a437faa08b68ce942b544640bff922334d"}
Jul 23 18:23:19.144304 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:19.143910    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf" event={"ID":"36635919-09a8-477e-9f9a-7d980e98f240","Type":"ContainerStarted","Data":"108ac9e776b5c4608f1cd3ef8a12180617f39a08631cf79936fcf8cb4c96fd91"}
Jul 23 18:23:19.144304 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:19.143982    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"
Jul 23 18:23:19.201102 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:19.201043    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf" podStartSLOduration=1.201026409 podStartE2EDuration="1.201026409s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:23:19.19886893 +0000 UTC m=+1259.561712807" watchObservedRunningTime="2026-07-23 18:23:19.201026409 +0000 UTC m=+1259.563870259"
Jul 23 18:23:30.153564 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:30.153533    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qknsf"
Jul 23 18:23:39.009172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:39.009135    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:23:46.703639 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:23:46.703584    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:24:00.311553 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:24:00.311512    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:24:09.618373 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:24:09.615960    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:24:19.399622 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:24:19.399588    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:24:28.004539 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:24:28.004501    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:24:31.553145 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:24:31.553094    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:32.958566 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:24:32.958531    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:24:37.231551 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:24:37.231512    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:24:49.303010 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:24:49.302932    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:24:57.616517 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:24:57.616473    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:25:08.538257 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:25:08.538196    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:25:20.206146 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:25:20.206110    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:25:27.907142 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:25:27.907104    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:25:37.642919 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:25:37.642882    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:45.901839 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:25:45.901796    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:25:47.355511 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:25:47.355465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:47.456209 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:25:47.456173    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:25:55.216115 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:25:55.216074    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:26:24.945802 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:26:24.945706    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:28.318809 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:26:28.318768    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:26:36.055906 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:26:36.055848    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:26:41.909930 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:26:41.909891    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:27:04.516595 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:27:04.516556    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:05.950477 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:27:05.950440    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:06.098808 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:27:06.098772    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:27:16.302922 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:27:16.302884    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:27:20.189625 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:27:20.189595    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:27:20.214299 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:27:20.214271    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:27:26.098517 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:27:26.098463    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:27:42.709175 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:27:42.709099    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:27:46.464528 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:27:46.464487    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:27:52.208529 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:27:52.208490    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:28:01.620843 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:28:01.620801    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:28:11.506897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:28:11.506858    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:28:20.610266 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:28:20.610214    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:28:31.705247 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:28:31.705183    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:28:44.899492 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:28:44.899452    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:28:53.613894 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:28:53.613857    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:29:03.902562 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:29:03.902520    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:29:13.605470 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:29:13.605386    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:29:15.888548 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:29:15.888512    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:29:26.497070 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:29:26.497033    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:29:34.603344 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:29:34.603299    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:29:47.002095 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:29:47.002059    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:29:59.404052 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:29:59.404011    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:30:00.141897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:00.141858    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747190-g5s97"]
Jul 23 18:30:00.145578 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:00.145560    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-g5s97"
Jul 23 18:30:00.148764 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:00.148740    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:30:00.155170 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:00.155150    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-g5s97"
Jul 23 18:30:00.160477 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:00.160456    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747190-g5s97"]
Jul 23 18:30:00.338520 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:00.338472    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747190-g5s97"]
Jul 23 18:30:00.340663 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:30:00.340636    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c25e689_d93e_437d_aefd_53a8909f76fa.slice/crio-7ec29d63849c524586c14fd9d8c592dbf337a62b7533c8fe6ce4852e6da15108 WatchSource:0}: Error finding container 7ec29d63849c524586c14fd9d8c592dbf337a62b7533c8fe6ce4852e6da15108: Status 404 returned error can't find the container with id 7ec29d63849c524586c14fd9d8c592dbf337a62b7533c8fe6ce4852e6da15108
Jul 23 18:30:00.476442 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:00.476357    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-g5s97" event={"ID":"7c25e689-d93e-437d-aefd-53a8909f76fa","Type":"ContainerStarted","Data":"7ec29d63849c524586c14fd9d8c592dbf337a62b7533c8fe6ce4852e6da15108"}
Jul 23 18:30:01.484005 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:01.483970    2574 generic.go:356] "Generic (PLEG): container finished" podID="7c25e689-d93e-437d-aefd-53a8909f76fa" containerID="13a20234fecf3b12d826e45643eca9c72e419ddcc7603f756d352f4123c94f02" exitCode=0
Jul 23 18:30:01.484399 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:01.484034    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-g5s97" event={"ID":"7c25e689-d93e-437d-aefd-53a8909f76fa","Type":"ContainerDied","Data":"13a20234fecf3b12d826e45643eca9c72e419ddcc7603f756d352f4123c94f02"}
Jul 23 18:30:02.636456 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:02.636427    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-g5s97"
Jul 23 18:30:03.496094 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:03.496065    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-g5s97"
Jul 23 18:30:03.496094 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:03.496086    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747190-g5s97" event={"ID":"7c25e689-d93e-437d-aefd-53a8909f76fa","Type":"ContainerDied","Data":"7ec29d63849c524586c14fd9d8c592dbf337a62b7533c8fe6ce4852e6da15108"}
Jul 23 18:30:03.496330 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:03.496129    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ec29d63849c524586c14fd9d8c592dbf337a62b7533c8fe6ce4852e6da15108"
Jul 23 18:30:10.605129 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:10.605094    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:30:11.587677 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:11.587641    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:23.803055 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:23.803021    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:30:33.202310 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:33.202269    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:30:33.273537 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:33.273498    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:36.654992 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:36.654955    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:36.765417 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:36.765368    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:37.186440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:37.186402    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:43.491347 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:43.491255    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:43.591780 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:43.591739    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:43.604491 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:43.604462    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:30:43.780404 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:43.780306    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:44.218437 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:44.218399    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:44.888690 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:44.888636    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:46.428330 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.428297    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:46.462558 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.462523    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"]
Jul 23 18:30:46.462955 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.462942    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c25e689-d93e-437d-aefd-53a8909f76fa" containerName="cleanup"
Jul 23 18:30:46.463011 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.462957    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c25e689-d93e-437d-aefd-53a8909f76fa" containerName="cleanup"
Jul 23 18:30:46.463048 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.463033    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c25e689-d93e-437d-aefd-53a8909f76fa" containerName="cleanup"
Jul 23 18:30:46.466054 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.466033    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.468882 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.468863    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a922dc39-serving-cert\""
Jul 23 18:30:46.481080 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.481052    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"]
Jul 23 18:30:46.505298 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.505266    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:46.547689 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.547654    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dql78\" (UniqueName: \"kubernetes.io/projected/5283034d-8f35-4b26-a1e8-aca4bed9e91b-kube-api-access-dql78\") pod \"maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.547863 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.547699    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5283034d-8f35-4b26-a1e8-aca4bed9e91b-maas-api-tls\") pod \"maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.547863 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.547772    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5283034d-8f35-4b26-a1e8-aca4bed9e91b-openshift-service-ca\") pod \"maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.572640 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.572596    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:46.649172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.649131    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dql78\" (UniqueName: \"kubernetes.io/projected/5283034d-8f35-4b26-a1e8-aca4bed9e91b-kube-api-access-dql78\") pod \"maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.649172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.649178    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5283034d-8f35-4b26-a1e8-aca4bed9e91b-maas-api-tls\") pod \"maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.649440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.649214    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5283034d-8f35-4b26-a1e8-aca4bed9e91b-openshift-service-ca\") pod \"maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.650020 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.649997    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5283034d-8f35-4b26-a1e8-aca4bed9e91b-openshift-service-ca\") pod \"maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.651796 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.651777    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5283034d-8f35-4b26-a1e8-aca4bed9e91b-maas-api-tls\") pod \"maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.658979 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.658948    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dql78\" (UniqueName: \"kubernetes.io/projected/5283034d-8f35-4b26-a1e8-aca4bed9e91b-kube-api-access-dql78\") pod \"maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.776158 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.776069    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:46.984768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:46.984726    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:47.085403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:47.085367    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:30:47.132918 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:47.132891    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"]
Jul 23 18:30:47.134260 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:30:47.134204    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5283034d_8f35_4b26_a1e8_aca4bed9e91b.slice/crio-e5026360c823fe8e0fb45b1adda632012e2bf17d465630624307706120341608 WatchSource:0}: Error finding container e5026360c823fe8e0fb45b1adda632012e2bf17d465630624307706120341608: Status 404 returned error can't find the container with id e5026360c823fe8e0fb45b1adda632012e2bf17d465630624307706120341608
Jul 23 18:30:47.136009 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:47.135986    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:30:47.755862 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:47.755829    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj" event={"ID":"5283034d-8f35-4b26-a1e8-aca4bed9e91b","Type":"ContainerStarted","Data":"0995ac94b45f1fd2e8e370d96666b35b308cdb72fac800f15e0528d012736dcc"}
Jul 23 18:30:47.756200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:47.755883    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj" event={"ID":"5283034d-8f35-4b26-a1e8-aca4bed9e91b","Type":"ContainerStarted","Data":"e5026360c823fe8e0fb45b1adda632012e2bf17d465630624307706120341608"}
Jul 23 18:30:47.756200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:47.755924    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:47.774617 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:47.774566    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj" podStartSLOduration=1.240642271 podStartE2EDuration="1.774546022s" totalImagesPullingTime="533.903751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:47.773661846 +0000 UTC m=+1708.136505694" watchObservedRunningTime="2026-07-23 18:30:47.774546022 +0000 UTC m=+1708.137389871"
Jul 23 18:30:53.767727 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:53.767694    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:30:53.800066 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:30:53.800032    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:31:12.142278 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:12.142202    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"]
Jul 23 18:31:12.146201 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:12.146177    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"
Jul 23 18:31:12.149523 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:12.149495    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:31:12.155379 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:12.155318    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"]
Jul 23 18:31:12.297279 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:12.297240    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fc7201-5799-4444-8831-ad71d713a312-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4\" (UID: \"19fc7201-5799-4444-8831-ad71d713a312\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"
Jul 23 18:31:12.398150 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:12.398048    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fc7201-5799-4444-8831-ad71d713a312-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4\" (UID: \"19fc7201-5799-4444-8831-ad71d713a312\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"
Jul 23 18:31:12.398787 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:12.398760    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fc7201-5799-4444-8831-ad71d713a312-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4\" (UID: \"19fc7201-5799-4444-8831-ad71d713a312\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"
Jul 23 18:31:12.459722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:12.459686    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"
Jul 23 18:31:12.606001 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:12.605970    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"]
Jul 23 18:31:12.607566 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:31:12.607532    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fc7201_5799_4444_8831_ad71d713a312.slice/crio-5ef4a06ec7503ef38d8ce81a697947f748d0caea52e245652de5f3d00aa22742 WatchSource:0}: Error finding container 5ef4a06ec7503ef38d8ce81a697947f748d0caea52e245652de5f3d00aa22742: Status 404 returned error can't find the container with id 5ef4a06ec7503ef38d8ce81a697947f748d0caea52e245652de5f3d00aa22742
Jul 23 18:31:12.901606 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:12.901568    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4" event={"ID":"19fc7201-5799-4444-8831-ad71d713a312","Type":"ContainerStarted","Data":"5ef4a06ec7503ef38d8ce81a697947f748d0caea52e245652de5f3d00aa22742"}
Jul 23 18:31:13.909328 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:13.909289    2574 generic.go:356] "Generic (PLEG): container finished" podID="19fc7201-5799-4444-8831-ad71d713a312" containerID="f6d55a4a0b6c2bd3d4fcebb7117bd43b03ed694e276afdd6c2be2fb85879d0ce" exitCode=0
Jul 23 18:31:13.909797 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:13.909376    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4" event={"ID":"19fc7201-5799-4444-8831-ad71d713a312","Type":"ContainerDied","Data":"f6d55a4a0b6c2bd3d4fcebb7117bd43b03ed694e276afdd6c2be2fb85879d0ce"}
Jul 23 18:31:15.056730 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:15.056699    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"
Jul 23 18:31:15.130940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:15.130902    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fc7201-5799-4444-8831-ad71d713a312-maas-api-service-ca\") pod \"19fc7201-5799-4444-8831-ad71d713a312\" (UID: \"19fc7201-5799-4444-8831-ad71d713a312\") "
Jul 23 18:31:15.131323 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:15.131298    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19fc7201-5799-4444-8831-ad71d713a312-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "19fc7201-5799-4444-8831-ad71d713a312" (UID: "19fc7201-5799-4444-8831-ad71d713a312"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:31:15.232382 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:15.232288    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fc7201-5799-4444-8831-ad71d713a312-maas-api-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:31:15.922812 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:15.922780    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"
Jul 23 18:31:15.923031 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:15.922793    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4" event={"ID":"19fc7201-5799-4444-8831-ad71d713a312","Type":"ContainerDied","Data":"5ef4a06ec7503ef38d8ce81a697947f748d0caea52e245652de5f3d00aa22742"}
Jul 23 18:31:15.923031 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:15.922860    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ef4a06ec7503ef38d8ce81a697947f748d0caea52e245652de5f3d00aa22742"
Jul 23 18:31:22.786330 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:22.786285    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"]
Jul 23 18:31:22.787156 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:22.787095    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj" podUID="5283034d-8f35-4b26-a1e8-aca4bed9e91b" containerName="maas-api" containerID="cri-o://0995ac94b45f1fd2e8e370d96666b35b308cdb72fac800f15e0528d012736dcc" gracePeriod=30
Jul 23 18:31:22.807539 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:22.807503    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:22.974665 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:22.974630    2574 generic.go:356] "Generic (PLEG): container finished" podID="5283034d-8f35-4b26-a1e8-aca4bed9e91b" containerID="0995ac94b45f1fd2e8e370d96666b35b308cdb72fac800f15e0528d012736dcc" exitCode=0
Jul 23 18:31:22.974812 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:22.974690    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj" event={"ID":"5283034d-8f35-4b26-a1e8-aca4bed9e91b","Type":"ContainerDied","Data":"0995ac94b45f1fd2e8e370d96666b35b308cdb72fac800f15e0528d012736dcc"}
Jul 23 18:31:23.057030 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.057001    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:31:23.209020 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.208977    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5283034d-8f35-4b26-a1e8-aca4bed9e91b-openshift-service-ca\") pod \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") "
Jul 23 18:31:23.209249 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.209044    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5283034d-8f35-4b26-a1e8-aca4bed9e91b-maas-api-tls\") pod \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") "
Jul 23 18:31:23.209249 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.209101    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dql78\" (UniqueName: \"kubernetes.io/projected/5283034d-8f35-4b26-a1e8-aca4bed9e91b-kube-api-access-dql78\") pod \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\" (UID: \"5283034d-8f35-4b26-a1e8-aca4bed9e91b\") "
Jul 23 18:31:23.209386 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.209323    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5283034d-8f35-4b26-a1e8-aca4bed9e91b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5283034d-8f35-4b26-a1e8-aca4bed9e91b" (UID: "5283034d-8f35-4b26-a1e8-aca4bed9e91b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:31:23.209450 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.209395    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5283034d-8f35-4b26-a1e8-aca4bed9e91b-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:31:23.211409 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.211384    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5283034d-8f35-4b26-a1e8-aca4bed9e91b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5283034d-8f35-4b26-a1e8-aca4bed9e91b" (UID: "5283034d-8f35-4b26-a1e8-aca4bed9e91b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:31:23.211495 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.211387    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5283034d-8f35-4b26-a1e8-aca4bed9e91b-kube-api-access-dql78" (OuterVolumeSpecName: "kube-api-access-dql78") pod "5283034d-8f35-4b26-a1e8-aca4bed9e91b" (UID: "5283034d-8f35-4b26-a1e8-aca4bed9e91b"). InnerVolumeSpecName "kube-api-access-dql78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:31:23.311182 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.311083    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5283034d-8f35-4b26-a1e8-aca4bed9e91b-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:31:23.311182 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.311118    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dql78\" (UniqueName: \"kubernetes.io/projected/5283034d-8f35-4b26-a1e8-aca4bed9e91b-kube-api-access-dql78\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:31:23.982516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.982488    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"
Jul 23 18:31:23.982949 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.982533    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj" event={"ID":"5283034d-8f35-4b26-a1e8-aca4bed9e91b","Type":"ContainerDied","Data":"e5026360c823fe8e0fb45b1adda632012e2bf17d465630624307706120341608"}
Jul 23 18:31:23.982949 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:23.982600    2574 scope.go:117] "RemoveContainer" containerID="0995ac94b45f1fd2e8e370d96666b35b308cdb72fac800f15e0528d012736dcc"
Jul 23 18:31:24.005339 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:24.005299    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"]
Jul 23 18:31:24.009019 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:24.008988    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a922dc39-6cf84c75d5-dp6jj"]
Jul 23 18:31:24.186218 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:24.186178    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5283034d-8f35-4b26-a1e8-aca4bed9e91b" path="/var/lib/kubelet/pods/5283034d-8f35-4b26-a1e8-aca4bed9e91b/volumes"
Jul 23 18:31:25.704255 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:25.704200    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:31:27.222705 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:27.222673    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:27.228904 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:27.228873    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"]
Jul 23 18:31:27.232110 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:27.232082    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a922dc39-mkgh4"]
Jul 23 18:31:27.434164 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:27.434123    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:27.642924 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:27.642880    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:27.913646 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:27.913535    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:28.004837 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:28.004801    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:28.155935 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:28.155899    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:28.186446 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:28.186368    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19fc7201-5799-4444-8831-ad71d713a312" path="/var/lib/kubelet/pods/19fc7201-5799-4444-8831-ad71d713a312/volumes"
Jul 23 18:31:28.502253 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:28.502132    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:28.966096 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:28.966058    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:30.741112 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.741075    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:30.833924 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.833880    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"]
Jul 23 18:31:30.834437 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.834416    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5283034d-8f35-4b26-a1e8-aca4bed9e91b" containerName="maas-api"
Jul 23 18:31:30.834437 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.834439    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5283034d-8f35-4b26-a1e8-aca4bed9e91b" containerName="maas-api"
Jul 23 18:31:30.834605 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.834458    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19fc7201-5799-4444-8831-ad71d713a312" containerName="revoke-keys"
Jul 23 18:31:30.834605 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.834466    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="19fc7201-5799-4444-8831-ad71d713a312" containerName="revoke-keys"
Jul 23 18:31:30.834605 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.834597    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="19fc7201-5799-4444-8831-ad71d713a312" containerName="revoke-keys"
Jul 23 18:31:30.834752 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.834616    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5283034d-8f35-4b26-a1e8-aca4bed9e91b" containerName="maas-api"
Jul 23 18:31:30.839804 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.839763    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:30.842853 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.842826    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-0b3404de-serving-cert\""
Jul 23 18:31:30.850618 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.850590    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"]
Jul 23 18:31:30.869190 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.869153    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:30.884439 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.884403    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl64r\" (UniqueName: \"kubernetes.io/projected/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-kube-api-access-hl64r\") pod \"maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:30.884634 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.884454    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-openshift-service-ca\") pod \"maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:30.884634 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.884521    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-maas-api-tls\") pod \"maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:30.985906 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.985858    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl64r\" (UniqueName: \"kubernetes.io/projected/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-kube-api-access-hl64r\") pod \"maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:30.986091 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.985922    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-openshift-service-ca\") pod \"maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:30.986091 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.985959    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-maas-api-tls\") pod \"maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:30.986169 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:31:30.986090    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-serving-cert: secret "maas-api-e2e-migrate-0b3404de-serving-cert" not found
Jul 23 18:31:30.986204 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:31:30.986174    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-maas-api-tls podName:1f1ec806-43b0-41ca-b4e7-03f2106b19e9 nodeName:}" failed. No retries permitted until 2026-07-23 18:31:31.486153369 +0000 UTC m=+1751.848997199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-maas-api-tls") pod "maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t" (UID: "1f1ec806-43b0-41ca-b4e7-03f2106b19e9") : secret "maas-api-e2e-migrate-0b3404de-serving-cert" not found
Jul 23 18:31:30.986689 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.986667    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-openshift-service-ca\") pod \"maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:30.995866 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:30.995783    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl64r\" (UniqueName: \"kubernetes.io/projected/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-kube-api-access-hl64r\") pod \"maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:31.127097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:31.127052    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:31.481699 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:31.481656    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:31.491897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:31.491851    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-maas-api-tls\") pod \"maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:31.494398 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:31.494378    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-maas-api-tls\") pod \"maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:31.574408 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:31.574365    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:31.754135 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:31.754032    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:31.909665 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:31.909634    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"]
Jul 23 18:31:31.911157 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:31:31.911125    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f1ec806_43b0_41ca_b4e7_03f2106b19e9.slice/crio-5c331d1cbfe5efe679628b3848cbf9d20aff9faa46103e967313582b02e33789 WatchSource:0}: Error finding container 5c331d1cbfe5efe679628b3848cbf9d20aff9faa46103e967313582b02e33789: Status 404 returned error can't find the container with id 5c331d1cbfe5efe679628b3848cbf9d20aff9faa46103e967313582b02e33789
Jul 23 18:31:32.032463 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:32.032363    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t" event={"ID":"1f1ec806-43b0-41ca-b4e7-03f2106b19e9","Type":"ContainerStarted","Data":"5c331d1cbfe5efe679628b3848cbf9d20aff9faa46103e967313582b02e33789"}
Jul 23 18:31:33.040521 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:33.040471    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t" event={"ID":"1f1ec806-43b0-41ca-b4e7-03f2106b19e9","Type":"ContainerStarted","Data":"76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84"}
Jul 23 18:31:33.040995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:33.040546    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:33.061710 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:33.061643    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t" podStartSLOduration=2.590547793 podStartE2EDuration="3.061617647s" totalImagesPullingTime="471.069854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:33.057952873 +0000 UTC m=+1753.420796738" watchObservedRunningTime="2026-07-23 18:31:33.061617647 +0000 UTC m=+1753.424461497"
Jul 23 18:31:37.497732 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:37.497698    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:31:39.052971 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:39.052943    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:31:53.224974 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:53.224916    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:31:53.345304 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:31:53.345270    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:00.934532 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:00.934500    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"]
Jul 23 18:32:00.938003 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:00.937986    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"
Jul 23 18:32:00.940450 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:00.940429    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:32:00.946770 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:00.946747    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"]
Jul 23 18:32:01.081335 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:01.081299    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc6ed6b-7476-4db9-ae20-9344e8107a37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk\" (UID: \"1bc6ed6b-7476-4db9-ae20-9344e8107a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"
Jul 23 18:32:01.182551 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:01.182516    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc6ed6b-7476-4db9-ae20-9344e8107a37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk\" (UID: \"1bc6ed6b-7476-4db9-ae20-9344e8107a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"
Jul 23 18:32:01.183139 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:01.183115    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc6ed6b-7476-4db9-ae20-9344e8107a37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk\" (UID: \"1bc6ed6b-7476-4db9-ae20-9344e8107a37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"
Jul 23 18:32:01.249746 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:01.249673    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"
Jul 23 18:32:01.384314 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:01.384285    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"]
Jul 23 18:32:01.386179 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:32:01.386141    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc6ed6b_7476_4db9_ae20_9344e8107a37.slice/crio-c8dedb67b4540a6fb77578209c9bf4e5d2eb9f006f47c999836430be48228c02 WatchSource:0}: Error finding container c8dedb67b4540a6fb77578209c9bf4e5d2eb9f006f47c999836430be48228c02: Status 404 returned error can't find the container with id c8dedb67b4540a6fb77578209c9bf4e5d2eb9f006f47c999836430be48228c02
Jul 23 18:32:02.219098 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:02.219062    2574 generic.go:356] "Generic (PLEG): container finished" podID="1bc6ed6b-7476-4db9-ae20-9344e8107a37" containerID="b919b39b63093675cc1a0a33a0c81645940d925221a05a6695d53c0db3ed95e8" exitCode=0
Jul 23 18:32:02.219442 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:02.219121    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk" event={"ID":"1bc6ed6b-7476-4db9-ae20-9344e8107a37","Type":"ContainerDied","Data":"b919b39b63093675cc1a0a33a0c81645940d925221a05a6695d53c0db3ed95e8"}
Jul 23 18:32:02.219442 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:02.219196    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk" event={"ID":"1bc6ed6b-7476-4db9-ae20-9344e8107a37","Type":"ContainerStarted","Data":"c8dedb67b4540a6fb77578209c9bf4e5d2eb9f006f47c999836430be48228c02"}
Jul 23 18:32:03.362866 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:03.362841    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"
Jul 23 18:32:03.502277 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:03.502157    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc6ed6b-7476-4db9-ae20-9344e8107a37-maas-api-service-ca\") pod \"1bc6ed6b-7476-4db9-ae20-9344e8107a37\" (UID: \"1bc6ed6b-7476-4db9-ae20-9344e8107a37\") "
Jul 23 18:32:03.502509 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:03.502486    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bc6ed6b-7476-4db9-ae20-9344e8107a37-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1bc6ed6b-7476-4db9-ae20-9344e8107a37" (UID: "1bc6ed6b-7476-4db9-ae20-9344e8107a37"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:32:03.602969 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:03.602935    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bc6ed6b-7476-4db9-ae20-9344e8107a37-maas-api-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:32:04.232126 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:04.232099    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"
Jul 23 18:32:04.232280 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:04.232138    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk" event={"ID":"1bc6ed6b-7476-4db9-ae20-9344e8107a37","Type":"ContainerDied","Data":"c8dedb67b4540a6fb77578209c9bf4e5d2eb9f006f47c999836430be48228c02"}
Jul 23 18:32:04.232280 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:04.232183    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8dedb67b4540a6fb77578209c9bf4e5d2eb9f006f47c999836430be48228c02"
Jul 23 18:32:11.434315 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.434279    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"]
Jul 23 18:32:11.434781 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.434531    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t" podUID="1f1ec806-43b0-41ca-b4e7-03f2106b19e9" containerName="maas-api" containerID="cri-o://76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84" gracePeriod=30
Jul 23 18:32:11.463139 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.463111    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:11.689412 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.689357    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:32:11.875977 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.875895    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl64r\" (UniqueName: \"kubernetes.io/projected/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-kube-api-access-hl64r\") pod \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") "
Jul 23 18:32:11.876150 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.876012    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-openshift-service-ca\") pod \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") "
Jul 23 18:32:11.876150 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.876055    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-maas-api-tls\") pod \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\" (UID: \"1f1ec806-43b0-41ca-b4e7-03f2106b19e9\") "
Jul 23 18:32:11.876451 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.876425    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1f1ec806-43b0-41ca-b4e7-03f2106b19e9" (UID: "1f1ec806-43b0-41ca-b4e7-03f2106b19e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:32:11.878021 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.878000    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-kube-api-access-hl64r" (OuterVolumeSpecName: "kube-api-access-hl64r") pod "1f1ec806-43b0-41ca-b4e7-03f2106b19e9" (UID: "1f1ec806-43b0-41ca-b4e7-03f2106b19e9"). InnerVolumeSpecName "kube-api-access-hl64r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:32:11.878095 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.878025    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1f1ec806-43b0-41ca-b4e7-03f2106b19e9" (UID: "1f1ec806-43b0-41ca-b4e7-03f2106b19e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:32:11.976902 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.976825    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:32:11.976902 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.976855    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl64r\" (UniqueName: \"kubernetes.io/projected/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-kube-api-access-hl64r\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:32:11.976902 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:11.976869    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f1ec806-43b0-41ca-b4e7-03f2106b19e9-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:32:12.280861 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:12.280780    2574 generic.go:356] "Generic (PLEG): container finished" podID="1f1ec806-43b0-41ca-b4e7-03f2106b19e9" containerID="76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84" exitCode=0
Jul 23 18:32:12.280861 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:12.280821    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"
Jul 23 18:32:12.280861 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:12.280823    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t" event={"ID":"1f1ec806-43b0-41ca-b4e7-03f2106b19e9","Type":"ContainerDied","Data":"76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84"}
Jul 23 18:32:12.281097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:12.280881    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t" event={"ID":"1f1ec806-43b0-41ca-b4e7-03f2106b19e9","Type":"ContainerDied","Data":"5c331d1cbfe5efe679628b3848cbf9d20aff9faa46103e967313582b02e33789"}
Jul 23 18:32:12.281097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:12.280905    2574 scope.go:117] "RemoveContainer" containerID="76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84"
Jul 23 18:32:12.290140 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:12.290124    2574 scope.go:117] "RemoveContainer" containerID="76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84"
Jul 23 18:32:12.290436 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:32:12.290416    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84\": container with ID starting with 76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84 not found: ID does not exist" containerID="76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84"
Jul 23 18:32:12.290485 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:12.290443    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84"} err="failed to get container status \"76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84\": rpc error: code = NotFound desc = could not find container \"76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84\": container with ID starting with 76293eee88473dfa06db7ee785df2d8c6ebaa95692d3f3d50672c7b7bc525f84 not found: ID does not exist"
Jul 23 18:32:12.302603 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:12.302583    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"]
Jul 23 18:32:12.305098 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:12.305079    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-0b3404de-859b7dfb87-zlr7t"]
Jul 23 18:32:14.186099 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:14.186061    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f1ec806-43b0-41ca-b4e7-03f2106b19e9" path="/var/lib/kubelet/pods/1f1ec806-43b0-41ca-b4e7-03f2106b19e9/volumes"
Jul 23 18:32:14.597773 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:14.597740    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:32:16.004271 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.004219    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:16.013041 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.013009    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"]
Jul 23 18:32:16.015374 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.015355    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0b3404de-zf2lk"]
Jul 23 18:32:16.185372 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.185338    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:16.186285 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.186259    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bc6ed6b-7476-4db9-ae20-9344e8107a37" path="/var/lib/kubelet/pods/1bc6ed6b-7476-4db9-ae20-9344e8107a37/volumes"
Jul 23 18:32:16.432219 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.432187    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:16.676312 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.676268    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:16.977745 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.977713    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"]
Jul 23 18:32:16.978255 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.978208    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc6ed6b-7476-4db9-ae20-9344e8107a37" containerName="revoke-keys"
Jul 23 18:32:16.978255 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.978250    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc6ed6b-7476-4db9-ae20-9344e8107a37" containerName="revoke-keys"
Jul 23 18:32:16.978439 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.978316    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1ec806-43b0-41ca-b4e7-03f2106b19e9" containerName="maas-api"
Jul 23 18:32:16.978439 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.978327    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1ec806-43b0-41ca-b4e7-03f2106b19e9" containerName="maas-api"
Jul 23 18:32:16.978556 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.978442    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bc6ed6b-7476-4db9-ae20-9344e8107a37" containerName="revoke-keys"
Jul 23 18:32:16.978556 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.978456    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f1ec806-43b0-41ca-b4e7-03f2106b19e9" containerName="maas-api"
Jul 23 18:32:16.983330 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.983310    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:16.985861 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.985843    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-eba22494-openshift-default-dockercfg-hwqcb\""
Jul 23 18:32:16.995335 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:16.995311    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"]
Jul 23 18:32:17.000355 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.000329    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:17.014331 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.014307    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg4kp\" (UniqueName: \"kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-kube-api-access-mg4kp\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.014654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.014346    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-socket\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.014654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.014371    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-envoy\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.014654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.014455    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-token\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.014654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.014494    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294cf45a-1615-46a2-8efc-c2b73d609c8e-istiod-ca-cert\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.014654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.014518    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-credential-socket\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.014654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.014566    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-certs\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.014654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.014595    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-data\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.014654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.014634    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-podinfo\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115331 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115297    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-credential-socket\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115480 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115347    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-certs\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115480 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115379    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-data\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115480 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115412    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-podinfo\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115480 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115448    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg4kp\" (UniqueName: \"kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-kube-api-access-mg4kp\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115480 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115469    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-socket\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115747 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115489    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-envoy\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115812 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115758    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-credential-socket\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115812 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115800    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-certs\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115926 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115804    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-token\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115926 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115829    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-data\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115926 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115880    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294cf45a-1615-46a2-8efc-c2b73d609c8e-istiod-ca-cert\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.115926 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.115898    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-socket\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.116416 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.116395    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294cf45a-1615-46a2-8efc-c2b73d609c8e-istiod-ca-cert\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.117693 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.117674    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-envoy\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.117896 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.117880    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-podinfo\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.145601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.145576    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-token\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.145765 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.145745    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg4kp\" (UniqueName: \"kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-kube-api-access-mg4kp\") pod \"e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") " pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.242411 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.242318    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:17.295438 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.295406    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:17.439483 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:32:17.439437    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294cf45a_1615_46a2_8efc_c2b73d609c8e.slice/crio-384d1319aab276a5e91c80308bf934dd146038a50dd5f49b07d1f5964b873335 WatchSource:0}: Error finding container 384d1319aab276a5e91c80308bf934dd146038a50dd5f49b07d1f5964b873335: Status 404 returned error can't find the container with id 384d1319aab276a5e91c80308bf934dd146038a50dd5f49b07d1f5964b873335
Jul 23 18:32:17.440264 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.440214    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"]
Jul 23 18:32:17.441628 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.441594    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:32:17.441711 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.441660    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:32:17.441711 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:17.441690    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:32:18.326043 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:18.326007    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" event={"ID":"294cf45a-1615-46a2-8efc-c2b73d609c8e","Type":"ContainerStarted","Data":"b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220"}
Jul 23 18:32:18.326475 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:18.326064    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" event={"ID":"294cf45a-1615-46a2-8efc-c2b73d609c8e","Type":"ContainerStarted","Data":"384d1319aab276a5e91c80308bf934dd146038a50dd5f49b07d1f5964b873335"}
Jul 23 18:32:18.355334 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:18.355280    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" podStartSLOduration=2.355251208 podStartE2EDuration="2.355251208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:18.353186633 +0000 UTC m=+1798.716030500" watchObservedRunningTime="2026-07-23 18:32:18.355251208 +0000 UTC m=+1798.718095063"
Jul 23 18:32:19.295987 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.295955    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:19.300843 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.300818    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:19.334916 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.334884    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:19.339985 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.339957    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:19.713945 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.713894    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:19.793006 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.792972    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"]
Jul 23 18:32:19.796758 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.796739    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:19.799417 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.799398    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-eba22494-serving-cert\""
Jul 23 18:32:19.807031 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.807011    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"]
Jul 23 18:32:19.827043 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.827018    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:19.846340 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.846305    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae9363b-1159-4a84-bd61-15cbbf18e5c4-maas-api-tls\") pod \"maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:19.846455 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.846361    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t747v\" (UniqueName: \"kubernetes.io/projected/bae9363b-1159-4a84-bd61-15cbbf18e5c4-kube-api-access-t747v\") pod \"maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:19.846455 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.846386    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae9363b-1159-4a84-bd61-15cbbf18e5c4-openshift-service-ca\") pod \"maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:19.886837 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.886802    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:19.947295 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.947250    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae9363b-1159-4a84-bd61-15cbbf18e5c4-maas-api-tls\") pod \"maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:19.947484 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.947310    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t747v\" (UniqueName: \"kubernetes.io/projected/bae9363b-1159-4a84-bd61-15cbbf18e5c4-kube-api-access-t747v\") pod \"maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:19.947484 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.947329    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae9363b-1159-4a84-bd61-15cbbf18e5c4-openshift-service-ca\") pod \"maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:19.947484 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:32:19.947368    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-serving-cert: secret "maas-api-e2e-ait-eba22494-serving-cert" not found
Jul 23 18:32:19.947484 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:32:19.947434    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bae9363b-1159-4a84-bd61-15cbbf18e5c4-maas-api-tls podName:bae9363b-1159-4a84-bd61-15cbbf18e5c4 nodeName:}" failed. No retries permitted until 2026-07-23 18:32:20.447417489 +0000 UTC m=+1800.810261319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bae9363b-1159-4a84-bd61-15cbbf18e5c4-maas-api-tls") pod "maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj" (UID: "bae9363b-1159-4a84-bd61-15cbbf18e5c4") : secret "maas-api-e2e-ait-eba22494-serving-cert" not found
Jul 23 18:32:19.947940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.947918    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae9363b-1159-4a84-bd61-15cbbf18e5c4-openshift-service-ca\") pod \"maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:19.957016 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.956988    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t747v\" (UniqueName: \"kubernetes.io/projected/bae9363b-1159-4a84-bd61-15cbbf18e5c4-kube-api-access-t747v\") pod \"maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:19.997585 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:19.997510    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:20.238287 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:20.238261    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:32:20.257623 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:20.257568    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:32:20.413931 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:20.413899    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:20.451197 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:20.451161    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae9363b-1159-4a84-bd61-15cbbf18e5c4-maas-api-tls\") pod \"maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:20.453490 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:20.453467    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae9363b-1159-4a84-bd61-15cbbf18e5c4-maas-api-tls\") pod \"maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:20.513974 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:20.513895    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:20.709706 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:20.709674    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:20.851549 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:20.851507    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"]
Jul 23 18:32:20.852722 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:32:20.852690    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae9363b_1159_4a84_bd61_15cbbf18e5c4.slice/crio-32ac6e8fa8d6e3f366e08eae59b8eabba92fd3bfb09193508a8eae8666c6299f WatchSource:0}: Error finding container 32ac6e8fa8d6e3f366e08eae59b8eabba92fd3bfb09193508a8eae8666c6299f: Status 404 returned error can't find the container with id 32ac6e8fa8d6e3f366e08eae59b8eabba92fd3bfb09193508a8eae8666c6299f
Jul 23 18:32:21.347371 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:21.347332    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj" event={"ID":"bae9363b-1159-4a84-bd61-15cbbf18e5c4","Type":"ContainerStarted","Data":"7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3"}
Jul 23 18:32:21.347512 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:21.347393    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj" event={"ID":"bae9363b-1159-4a84-bd61-15cbbf18e5c4","Type":"ContainerStarted","Data":"32ac6e8fa8d6e3f366e08eae59b8eabba92fd3bfb09193508a8eae8666c6299f"}
Jul 23 18:32:21.347596 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:21.347579    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:21.367161 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:21.367117    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj" podStartSLOduration=1.952473796 podStartE2EDuration="2.367098306s" totalImagesPullingTime="414.62451ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:32:21.365281189 +0000 UTC m=+1801.728125059" watchObservedRunningTime="2026-07-23 18:32:21.367098306 +0000 UTC m=+1801.729942155"
Jul 23 18:32:25.895061 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:25.895019    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:32:27.364870 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:27.364834    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:34.336119 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:34.336079    2574 patch_prober.go:28] interesting pod/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 23 18:32:34.336562 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:34.336137    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 23 18:32:34.433553 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:34.433516    2574 generic.go:356] "Generic (PLEG): container finished" podID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerID="b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220" exitCode=0
Jul 23 18:32:34.433722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:34.433593    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" event={"ID":"294cf45a-1615-46a2-8efc-c2b73d609c8e","Type":"ContainerDied","Data":"b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220"}
Jul 23 18:32:34.434047 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:34.434030    2574 scope.go:117] "RemoveContainer" containerID="b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220"
Jul 23 18:32:34.435172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:34.435138    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:32:34.435272 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:34.435211    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:32:34.435321 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:34.435276    2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 23 18:32:35.446395 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:35.446331    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" event={"ID":"294cf45a-1615-46a2-8efc-c2b73d609c8e","Type":"ContainerStarted","Data":"e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32"}
Jul 23 18:32:36.295873 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:36.295833    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:36.296096 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:36.296070    2574 patch_prober.go:28] interesting pod/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 23 18:32:36.296160 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:36.296139    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 23 18:32:37.296718 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:37.296683    2574 patch_prober.go:28] interesting pod/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 23 18:32:37.297096 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:37.296735    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 23 18:32:38.296406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:38.296370    2574 patch_prober.go:28] interesting pod/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 23 18:32:38.296589 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:38.296429    2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 23 18:32:39.299723 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:39.299694    2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:39.300143 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:39.299969    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:39.300661 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:39.300643    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:32:46.129877 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:46.129835    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:46.230274 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:46.230206    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:47.258196 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:47.258151    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:47.356948 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:47.356876    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:48.028971 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:48.028929    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:48.129239 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:48.129202    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:48.986268 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:48.986208    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:49.086635 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:49.086589    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:49.796005 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:49.795968    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:49.897413 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:49.897375    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:50.763041 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:50.762999    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:50.863757 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:50.863724    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:51.559561 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:51.559529    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:51.661857 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:51.661820    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:52.462961 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:52.462923    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:52.566792 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:52.566755    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:53.236086 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:53.236047    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:53.336992 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:53.336958    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:54.293208 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:54.293166    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:54.394031 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:54.393994    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:55.101403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:55.101365    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:55.201640 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:55.201603    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:56.071211 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:56.071179    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:56.171995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:56.171953    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:56.916218 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:56.916183    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:57.014107 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.014068    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:57.154821 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.154784    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"]
Jul 23 18:32:57.155370 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.155039    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj" podUID="bae9363b-1159-4a84-bd61-15cbbf18e5c4" containerName="maas-api" containerID="cri-o://7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3" gracePeriod=30
Jul 23 18:32:57.180242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.180203    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:32:57.418577 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.418550    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:57.529887 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.529793    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae9363b-1159-4a84-bd61-15cbbf18e5c4-openshift-service-ca\") pod \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") "
Jul 23 18:32:57.529887 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.529866    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae9363b-1159-4a84-bd61-15cbbf18e5c4-maas-api-tls\") pod \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") "
Jul 23 18:32:57.529887 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.529887    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t747v\" (UniqueName: \"kubernetes.io/projected/bae9363b-1159-4a84-bd61-15cbbf18e5c4-kube-api-access-t747v\") pod \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\" (UID: \"bae9363b-1159-4a84-bd61-15cbbf18e5c4\") "
Jul 23 18:32:57.530295 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.530218    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae9363b-1159-4a84-bd61-15cbbf18e5c4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bae9363b-1159-4a84-bd61-15cbbf18e5c4" (UID: "bae9363b-1159-4a84-bd61-15cbbf18e5c4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:32:57.531995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.531973    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae9363b-1159-4a84-bd61-15cbbf18e5c4-kube-api-access-t747v" (OuterVolumeSpecName: "kube-api-access-t747v") pod "bae9363b-1159-4a84-bd61-15cbbf18e5c4" (UID: "bae9363b-1159-4a84-bd61-15cbbf18e5c4"). InnerVolumeSpecName "kube-api-access-t747v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:32:57.532112 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.532086    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bae9363b-1159-4a84-bd61-15cbbf18e5c4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bae9363b-1159-4a84-bd61-15cbbf18e5c4" (UID: "bae9363b-1159-4a84-bd61-15cbbf18e5c4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:32:57.590071 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.590040    2574 generic.go:356] "Generic (PLEG): container finished" podID="bae9363b-1159-4a84-bd61-15cbbf18e5c4" containerID="7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3" exitCode=0
Jul 23 18:32:57.590323 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.590086    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"
Jul 23 18:32:57.590323 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.590126    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj" event={"ID":"bae9363b-1159-4a84-bd61-15cbbf18e5c4","Type":"ContainerDied","Data":"7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3"}
Jul 23 18:32:57.590323 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.590180    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj" event={"ID":"bae9363b-1159-4a84-bd61-15cbbf18e5c4","Type":"ContainerDied","Data":"32ac6e8fa8d6e3f366e08eae59b8eabba92fd3bfb09193508a8eae8666c6299f"}
Jul 23 18:32:57.590323 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.590202    2574 scope.go:117] "RemoveContainer" containerID="7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3"
Jul 23 18:32:57.600020 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.600003    2574 scope.go:117] "RemoveContainer" containerID="7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3"
Jul 23 18:32:57.600297 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:32:57.600279    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3\": container with ID starting with 7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3 not found: ID does not exist" containerID="7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3"
Jul 23 18:32:57.600366 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.600305    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3"} err="failed to get container status \"7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3\": rpc error: code = NotFound desc = could not find container \"7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3\": container with ID starting with 7945759237f48223d9d9aa7a07afe2304d203a29635d174d2f00e62770806da3 not found: ID does not exist"
Jul 23 18:32:57.613195 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.613169    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"]
Jul 23 18:32:57.618963 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.618938    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj"]
Jul 23 18:32:57.631523 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.631498    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bae9363b-1159-4a84-bd61-15cbbf18e5c4-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:32:57.631523 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.631522    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bae9363b-1159-4a84-bd61-15cbbf18e5c4-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:32:57.631642 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:57.631535    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t747v\" (UniqueName: \"kubernetes.io/projected/bae9363b-1159-4a84-bd61-15cbbf18e5c4-kube-api-access-t747v\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:32:58.195636 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:32:58.195601    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae9363b-1159-4a84-bd61-15cbbf18e5c4" path="/var/lib/kubelet/pods/bae9363b-1159-4a84-bd61-15cbbf18e5c4/volumes"
Jul 23 18:33:00.353732 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:00.353683    2574 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-eba22494-5bdbb5b985-h4cmj" podUID="bae9363b-1159-4a84-bd61-15cbbf18e5c4" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.68:8443/health\": context deadline exceeded"
Jul 23 18:33:00.596696 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:00.596657    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:33:00.785858 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:00.785767    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:02.066883 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:02.066847    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"]
Jul 23 18:33:02.067377 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:02.067156    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy" containerID="cri-o://e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32" gracePeriod=30
Jul 23 18:33:02.076603 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:02.076574    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:02.339341 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:02.339193    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:02.577654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:02.577594    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:02.992595 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:02.992557    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:03.361749 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:03.361715    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:05.015498 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.015446    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:05.104019 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.103952    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:05.106191 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.106159    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"]
Jul 23 18:33:05.106873 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.106853    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae9363b-1159-4a84-bd61-15cbbf18e5c4" containerName="maas-api"
Jul 23 18:33:05.106916 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.106880    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae9363b-1159-4a84-bd61-15cbbf18e5c4" containerName="maas-api"
Jul 23 18:33:05.107015 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.107003    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae9363b-1159-4a84-bd61-15cbbf18e5c4" containerName="maas-api"
Jul 23 18:33:05.112088 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.112064    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.114594 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.114569    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-1b2c435a-serving-cert\""
Jul 23 18:33:05.118788 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.118765    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"]
Jul 23 18:33:05.180398 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.180367    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:05.204304 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.204277    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff97263-bb05-47d8-a240-d4d6f39622dd-maas-api-tls\") pod \"maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.204469 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.204346    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff97263-bb05-47d8-a240-d4d6f39622dd-openshift-service-ca\") pod \"maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.204469 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.204384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh8jh\" (UniqueName: \"kubernetes.io/projected/9ff97263-bb05-47d8-a240-d4d6f39622dd-kube-api-access-vh8jh\") pod \"maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.305383 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.305286    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff97263-bb05-47d8-a240-d4d6f39622dd-maas-api-tls\") pod \"maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.305383 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.305349    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff97263-bb05-47d8-a240-d4d6f39622dd-openshift-service-ca\") pod \"maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.305614 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.305395    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh8jh\" (UniqueName: \"kubernetes.io/projected/9ff97263-bb05-47d8-a240-d4d6f39622dd-kube-api-access-vh8jh\") pod \"maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.305614 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:33:05.305458    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-serving-cert: secret "maas-api-e2e-derive-1b2c435a-serving-cert" not found
Jul 23 18:33:05.305614 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:33:05.305552    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ff97263-bb05-47d8-a240-d4d6f39622dd-maas-api-tls podName:9ff97263-bb05-47d8-a240-d4d6f39622dd nodeName:}" failed. No retries permitted until 2026-07-23 18:33:05.805530733 +0000 UTC m=+1846.168374574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9ff97263-bb05-47d8-a240-d4d6f39622dd-maas-api-tls") pod "maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8" (UID: "9ff97263-bb05-47d8-a240-d4d6f39622dd") : secret "maas-api-e2e-derive-1b2c435a-serving-cert" not found
Jul 23 18:33:05.306046 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.306029    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff97263-bb05-47d8-a240-d4d6f39622dd-openshift-service-ca\") pod \"maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.317555 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.317529    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh8jh\" (UniqueName: \"kubernetes.io/projected/9ff97263-bb05-47d8-a240-d4d6f39622dd-kube-api-access-vh8jh\") pod \"maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.558771 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.558682    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:05.811004 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.810909    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff97263-bb05-47d8-a240-d4d6f39622dd-maas-api-tls\") pod \"maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.813343 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.813322    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff97263-bb05-47d8-a240-d4d6f39622dd-maas-api-tls\") pod \"maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:05.828729 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.828681    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:05.930074 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:05.930035    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:06.024451 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:06.024419    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:06.381263 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:06.381215    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"]
Jul 23 18:33:06.383346 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:33:06.383317    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff97263_bb05_47d8_a240_d4d6f39622dd.slice/crio-2bf4fff78e7f1170e0ff3bd17e630137587ca615cd66bf612be7b44acc976f3c WatchSource:0}: Error finding container 2bf4fff78e7f1170e0ff3bd17e630137587ca615cd66bf612be7b44acc976f3c: Status 404 returned error can't find the container with id 2bf4fff78e7f1170e0ff3bd17e630137587ca615cd66bf612be7b44acc976f3c
Jul 23 18:33:06.647044 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:06.646954    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8" event={"ID":"9ff97263-bb05-47d8-a240-d4d6f39622dd","Type":"ContainerStarted","Data":"2bf4fff78e7f1170e0ff3bd17e630137587ca615cd66bf612be7b44acc976f3c"}
Jul 23 18:33:07.334917 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.334892    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:33:07.428049 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428015    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-certs\") pod \"294cf45a-1615-46a2-8efc-c2b73d609c8e\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") "
Jul 23 18:33:07.428049 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428054    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-podinfo\") pod \"294cf45a-1615-46a2-8efc-c2b73d609c8e\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") "
Jul 23 18:33:07.428341 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428086    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-token\") pod \"294cf45a-1615-46a2-8efc-c2b73d609c8e\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") "
Jul 23 18:33:07.428341 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428107    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-data\") pod \"294cf45a-1615-46a2-8efc-c2b73d609c8e\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") "
Jul 23 18:33:07.428341 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428151    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-credential-socket\") pod \"294cf45a-1615-46a2-8efc-c2b73d609c8e\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") "
Jul 23 18:33:07.428341 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428211    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294cf45a-1615-46a2-8efc-c2b73d609c8e-istiod-ca-cert\") pod \"294cf45a-1615-46a2-8efc-c2b73d609c8e\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") "
Jul 23 18:33:07.428341 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428274    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-envoy\") pod \"294cf45a-1615-46a2-8efc-c2b73d609c8e\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") "
Jul 23 18:33:07.428598 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428347    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg4kp\" (UniqueName: \"kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-kube-api-access-mg4kp\") pod \"294cf45a-1615-46a2-8efc-c2b73d609c8e\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") "
Jul 23 18:33:07.428700 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428677    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-socket\") pod \"294cf45a-1615-46a2-8efc-c2b73d609c8e\" (UID: \"294cf45a-1615-46a2-8efc-c2b73d609c8e\") "
Jul 23 18:33:07.429177 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428358    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "294cf45a-1615-46a2-8efc-c2b73d609c8e" (UID: "294cf45a-1615-46a2-8efc-c2b73d609c8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:33:07.429177 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428501    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "294cf45a-1615-46a2-8efc-c2b73d609c8e" (UID: "294cf45a-1615-46a2-8efc-c2b73d609c8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:33:07.429177 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.428618    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/294cf45a-1615-46a2-8efc-c2b73d609c8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "294cf45a-1615-46a2-8efc-c2b73d609c8e" (UID: "294cf45a-1615-46a2-8efc-c2b73d609c8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:33:07.429177 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.429084    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "294cf45a-1615-46a2-8efc-c2b73d609c8e" (UID: "294cf45a-1615-46a2-8efc-c2b73d609c8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:33:07.429177 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.429091    2574 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-credential-socket\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:07.429177 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.429118    2574 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294cf45a-1615-46a2-8efc-c2b73d609c8e-istiod-ca-cert\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:07.429177 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.429130    2574 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-certs\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:07.429177 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.429144    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "294cf45a-1615-46a2-8efc-c2b73d609c8e" (UID: "294cf45a-1615-46a2-8efc-c2b73d609c8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:33:07.430412 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.430390    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "294cf45a-1615-46a2-8efc-c2b73d609c8e" (UID: "294cf45a-1615-46a2-8efc-c2b73d609c8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:33:07.430510 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.430480    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "294cf45a-1615-46a2-8efc-c2b73d609c8e" (UID: "294cf45a-1615-46a2-8efc-c2b73d609c8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 18:33:07.430772 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.430752    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "294cf45a-1615-46a2-8efc-c2b73d609c8e" (UID: "294cf45a-1615-46a2-8efc-c2b73d609c8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 18:33:07.430818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.430769    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-kube-api-access-mg4kp" (OuterVolumeSpecName: "kube-api-access-mg4kp") pod "294cf45a-1615-46a2-8efc-c2b73d609c8e" (UID: "294cf45a-1615-46a2-8efc-c2b73d609c8e"). InnerVolumeSpecName "kube-api-access-mg4kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:33:07.529884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.529809    2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-token\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:07.529884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.529835    2574 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-data\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:07.529884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.529843    2574 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-envoy\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:07.529884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.529853    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg4kp\" (UniqueName: \"kubernetes.io/projected/294cf45a-1615-46a2-8efc-c2b73d609c8e-kube-api-access-mg4kp\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:07.529884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.529863    2574 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294cf45a-1615-46a2-8efc-c2b73d609c8e-workload-socket\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:07.529884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.529872    2574 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294cf45a-1615-46a2-8efc-c2b73d609c8e-istio-podinfo\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:07.654292 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.654261    2574 generic.go:356] "Generic (PLEG): container finished" podID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerID="e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32" exitCode=0
Jul 23 18:33:07.654485 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.654307    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"
Jul 23 18:33:07.654485 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.654334    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" event={"ID":"294cf45a-1615-46a2-8efc-c2b73d609c8e","Type":"ContainerDied","Data":"e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32"}
Jul 23 18:33:07.654485 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.654382    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5" event={"ID":"294cf45a-1615-46a2-8efc-c2b73d609c8e","Type":"ContainerDied","Data":"384d1319aab276a5e91c80308bf934dd146038a50dd5f49b07d1f5964b873335"}
Jul 23 18:33:07.654485 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.654409    2574 scope.go:117] "RemoveContainer" containerID="e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32"
Jul 23 18:33:07.656016 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.655982    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8" event={"ID":"9ff97263-bb05-47d8-a240-d4d6f39622dd","Type":"ContainerStarted","Data":"ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58"}
Jul 23 18:33:07.656102 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.656041    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:07.664645 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.664630    2574 scope.go:117] "RemoveContainer" containerID="b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220"
Jul 23 18:33:07.672813 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.672798    2574 scope.go:117] "RemoveContainer" containerID="e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32"
Jul 23 18:33:07.673066 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:33:07.673046    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32\": container with ID starting with e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32 not found: ID does not exist" containerID="e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32"
Jul 23 18:33:07.673104 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.673076    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32"} err="failed to get container status \"e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32\": rpc error: code = NotFound desc = could not find container \"e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32\": container with ID starting with e14871b8733487a46a094541a1f3454e34489b3e5a8a4079426c953f2f500a32 not found: ID does not exist"
Jul 23 18:33:07.673104 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.673092    2574 scope.go:117] "RemoveContainer" containerID="b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220"
Jul 23 18:33:07.673420 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:33:07.673402    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220\": container with ID starting with b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220 not found: ID does not exist" containerID="b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220"
Jul 23 18:33:07.673465 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.673427    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220"} err="failed to get container status \"b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220\": rpc error: code = NotFound desc = could not find container \"b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220\": container with ID starting with b6323d7b7d8611f8d573156825054dcdb994666f96ea4bed30482f2ecb5f3220 not found: ID does not exist"
Jul 23 18:33:07.679999 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.679955    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8" podStartSLOduration=2.118893643 podStartE2EDuration="2.67994282s" totalImagesPullingTime="561.049177ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:33:07.677431367 +0000 UTC m=+1848.040275229" watchObservedRunningTime="2026-07-23 18:33:07.67994282 +0000 UTC m=+1848.042786717"
Jul 23 18:33:07.692548 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.692525    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"]
Jul 23 18:33:07.697839 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:07.697817    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-eba22494-openshift-default-fcdc6dcd9-vlqd5"]
Jul 23 18:33:08.185700 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:08.185669    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" path="/var/lib/kubelet/pods/294cf45a-1615-46a2-8efc-c2b73d609c8e/volumes"
Jul 23 18:33:12.015457 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:12.015419    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:33:13.668499 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:13.668466    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:40.494423 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.494385    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"]
Jul 23 18:33:40.494980 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.494670    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8" podUID="9ff97263-bb05-47d8-a240-d4d6f39622dd" containerName="maas-api" containerID="cri-o://ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58" gracePeriod=30
Jul 23 18:33:40.519171 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.519121    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:40.767211 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.767184    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:40.851943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.851912    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff97263-bb05-47d8-a240-d4d6f39622dd-openshift-service-ca\") pod \"9ff97263-bb05-47d8-a240-d4d6f39622dd\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") "
Jul 23 18:33:40.851943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.851951    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff97263-bb05-47d8-a240-d4d6f39622dd-maas-api-tls\") pod \"9ff97263-bb05-47d8-a240-d4d6f39622dd\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") "
Jul 23 18:33:40.852179 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.852015    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh8jh\" (UniqueName: \"kubernetes.io/projected/9ff97263-bb05-47d8-a240-d4d6f39622dd-kube-api-access-vh8jh\") pod \"9ff97263-bb05-47d8-a240-d4d6f39622dd\" (UID: \"9ff97263-bb05-47d8-a240-d4d6f39622dd\") "
Jul 23 18:33:40.852401 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.852373    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ff97263-bb05-47d8-a240-d4d6f39622dd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9ff97263-bb05-47d8-a240-d4d6f39622dd" (UID: "9ff97263-bb05-47d8-a240-d4d6f39622dd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:33:40.854332 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.854306    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ff97263-bb05-47d8-a240-d4d6f39622dd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9ff97263-bb05-47d8-a240-d4d6f39622dd" (UID: "9ff97263-bb05-47d8-a240-d4d6f39622dd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:33:40.854458 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.854341    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ff97263-bb05-47d8-a240-d4d6f39622dd-kube-api-access-vh8jh" (OuterVolumeSpecName: "kube-api-access-vh8jh") pod "9ff97263-bb05-47d8-a240-d4d6f39622dd" (UID: "9ff97263-bb05-47d8-a240-d4d6f39622dd"). InnerVolumeSpecName "kube-api-access-vh8jh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:33:40.855267 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.855212    2574 generic.go:356] "Generic (PLEG): container finished" podID="9ff97263-bb05-47d8-a240-d4d6f39622dd" containerID="ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58" exitCode=0
Jul 23 18:33:40.855379 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.855272    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"
Jul 23 18:33:40.855379 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.855321    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8" event={"ID":"9ff97263-bb05-47d8-a240-d4d6f39622dd","Type":"ContainerDied","Data":"ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58"}
Jul 23 18:33:40.855379 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.855375    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8" event={"ID":"9ff97263-bb05-47d8-a240-d4d6f39622dd","Type":"ContainerDied","Data":"2bf4fff78e7f1170e0ff3bd17e630137587ca615cd66bf612be7b44acc976f3c"}
Jul 23 18:33:40.855505 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.855401    2574 scope.go:117] "RemoveContainer" containerID="ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58"
Jul 23 18:33:40.878045 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.876353    2574 scope.go:117] "RemoveContainer" containerID="ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58"
Jul 23 18:33:40.878432 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:33:40.878398    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58\": container with ID starting with ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58 not found: ID does not exist" containerID="ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58"
Jul 23 18:33:40.878521 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.878443    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58"} err="failed to get container status \"ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58\": rpc error: code = NotFound desc = could not find container \"ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58\": container with ID starting with ecca2df2d5e9da4699e151ab42c8240a1fd6becb4ee26612cf0272c06c9d8f58 not found: ID does not exist"
Jul 23 18:33:40.888580 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.888553    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"]
Jul 23 18:33:40.894820 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.894797    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1b2c435a-7888c4b8b4-nsrr8"]
Jul 23 18:33:40.953777 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.953739    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh8jh\" (UniqueName: \"kubernetes.io/projected/9ff97263-bb05-47d8-a240-d4d6f39622dd-kube-api-access-vh8jh\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:40.953777 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.953774    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9ff97263-bb05-47d8-a240-d4d6f39622dd-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:40.953777 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:40.953789    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9ff97263-bb05-47d8-a240-d4d6f39622dd-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:33:42.186791 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:42.186709    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ff97263-bb05-47d8-a240-d4d6f39622dd" path="/var/lib/kubelet/pods/9ff97263-bb05-47d8-a240-d4d6f39622dd/volumes"
Jul 23 18:33:43.497679 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:43.497640    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:33:45.031583 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:45.031538    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:45.197453 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:45.197417    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:45.462006 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:45.461944    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:45.979648 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:45.979585    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:46.086346 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:46.086308    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:46.187275 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:46.187243    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:47.797311 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:47.797248    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:54.090682 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:54.090614    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:54.151157 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:54.151106    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:54.234624 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:54.234586    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:54.503783 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:54.503684    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:54.605386 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:54.605345    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:33:54.856755 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:33:54.856714    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:20.877339 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:20.877297    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:27.947735 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:27.947689    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:28.057613 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:28.057575    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:28.150875 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:28.150814    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:38.316888 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:38.316845    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:38.374140 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:38.374101    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:44.157005 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:44.156960    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:50.195309 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:50.195273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:50.258990 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:50.258955    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:50.336265 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:50.336200    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:34:50.437691 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:34:50.437653    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:01.029424 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:01.029382    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:02.011912 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:02.011875    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:09.147654 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:09.147610    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:09.249939 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:09.249893    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:09.348326 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:09.348286    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:09.448302 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:09.448189    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:09.549509 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:09.549468    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:11.065501 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:11.065463    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:11.168429 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:11.168393    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:11.262696 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:11.262658    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:13.084780 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:13.084690    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:13.717629 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:13.717593    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:35:19.822415 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:19.822375    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:21.059403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:21.059361    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:27.213260 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:27.213199    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:27.314508 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:27.314469    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:27.512685 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:27.512580    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:27.513015 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:27.512993    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:35:27.822908 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:27.822868    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:28.138771 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:28.138676    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:31.636613 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.636573    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:31.735697 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.735654    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:31.852000 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.851963    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"]
Jul 23 18:35:31.852454 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.852429    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy"
Jul 23 18:35:31.852454 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.852447    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy"
Jul 23 18:35:31.852642 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.852476    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ff97263-bb05-47d8-a240-d4d6f39622dd" containerName="maas-api"
Jul 23 18:35:31.852642 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.852486    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ff97263-bb05-47d8-a240-d4d6f39622dd" containerName="maas-api"
Jul 23 18:35:31.852642 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.852500    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy"
Jul 23 18:35:31.852642 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.852508    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy"
Jul 23 18:35:31.852642 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.852631    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy"
Jul 23 18:35:31.852642 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.852644    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="294cf45a-1615-46a2-8efc-c2b73d609c8e" containerName="istio-proxy"
Jul 23 18:35:31.852854 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.852652    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ff97263-bb05-47d8-a240-d4d6f39622dd" containerName="maas-api"
Jul 23 18:35:31.856063 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.856044    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:31.859664 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.859638    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3c233914-serving-cert\""
Jul 23 18:35:31.869768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.869737    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"]
Jul 23 18:35:31.899056 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.898957    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:31.973022 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.972986    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcqbr\" (UniqueName: \"kubernetes.io/projected/4f7a5ad2-d871-441a-8c58-e888001a2828-kube-api-access-tcqbr\") pod \"maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:31.973237 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.973100    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f7a5ad2-d871-441a-8c58-e888001a2828-openshift-service-ca\") pod \"maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:31.973237 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:31.973181    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f7a5ad2-d871-441a-8c58-e888001a2828-maas-api-tls\") pod \"maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:32.074448 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.074401    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f7a5ad2-d871-441a-8c58-e888001a2828-openshift-service-ca\") pod \"maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:32.074764 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.074509    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f7a5ad2-d871-441a-8c58-e888001a2828-maas-api-tls\") pod \"maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:32.074764 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.074565    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcqbr\" (UniqueName: \"kubernetes.io/projected/4f7a5ad2-d871-441a-8c58-e888001a2828-kube-api-access-tcqbr\") pod \"maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:32.075410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.075384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f7a5ad2-d871-441a-8c58-e888001a2828-openshift-service-ca\") pod \"maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:32.077263 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.077239    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f7a5ad2-d871-441a-8c58-e888001a2828-maas-api-tls\") pod \"maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:32.089406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.089381    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcqbr\" (UniqueName: \"kubernetes.io/projected/4f7a5ad2-d871-441a-8c58-e888001a2828-kube-api-access-tcqbr\") pod \"maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:32.127115 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.127076    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:32.171171 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.171079    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:32.335678 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.335641    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"]
Jul 23 18:35:32.337711 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:35:32.337679    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f7a5ad2_d871_441a_8c58_e888001a2828.slice/crio-b3613c5937cf9388587099c5c757052156dcfd263a6ee94f876627923b94db77 WatchSource:0}: Error finding container b3613c5937cf9388587099c5c757052156dcfd263a6ee94f876627923b94db77: Status 404 returned error can't find the container with id b3613c5937cf9388587099c5c757052156dcfd263a6ee94f876627923b94db77
Jul 23 18:35:32.536526 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.536429    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl" event={"ID":"4f7a5ad2-d871-441a-8c58-e888001a2828","Type":"ContainerStarted","Data":"b3613c5937cf9388587099c5c757052156dcfd263a6ee94f876627923b94db77"}
Jul 23 18:35:32.656653 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.656612    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:32.759843 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:32.759799    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:33.544779 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:33.544739    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl" event={"ID":"4f7a5ad2-d871-441a-8c58-e888001a2828","Type":"ContainerStarted","Data":"6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42"}
Jul 23 18:35:33.544971 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:33.544901    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:33.576977 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:33.576911    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl" podStartSLOduration=2.020747905 podStartE2EDuration="2.576892398s" totalImagesPullingTime="556.144493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:33.573038791 +0000 UTC m=+1993.935882644" watchObservedRunningTime="2026-07-23 18:35:33.576892398 +0000 UTC m=+1993.939736247"
Jul 23 18:35:36.011948 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:36.011904    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:36.681201 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:36.681156    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:36.782376 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:36.782341    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:37.149678 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:37.149624    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:39.560244 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:39.560186    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:41.112191 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:41.112154    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:35:44.047555 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.047519    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:44.154239 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.154189    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:44.434617 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.434579    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"]
Jul 23 18:35:44.438382 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.438355    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"
Jul 23 18:35:44.441081 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.441056    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:35:44.446176 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.446146    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"]
Jul 23 18:35:44.602065 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.602022    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da7bfa23-3e1b-4a70-82b2-aa04570f72e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3c233914-ccptz\" (UID: \"da7bfa23-3e1b-4a70-82b2-aa04570f72e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"
Jul 23 18:35:44.703440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.703327    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da7bfa23-3e1b-4a70-82b2-aa04570f72e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3c233914-ccptz\" (UID: \"da7bfa23-3e1b-4a70-82b2-aa04570f72e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"
Jul 23 18:35:44.703975 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.703952    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da7bfa23-3e1b-4a70-82b2-aa04570f72e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3c233914-ccptz\" (UID: \"da7bfa23-3e1b-4a70-82b2-aa04570f72e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"
Jul 23 18:35:44.751963 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.751926    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"
Jul 23 18:35:44.904179 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:44.904152    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"]
Jul 23 18:35:44.905978 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:35:44.905944    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7bfa23_3e1b_4a70_82b2_aa04570f72e3.slice/crio-134ddfb0355d6e37f554e02d447b5bcb0621b0226f221101c1f9901a223b3566 WatchSource:0}: Error finding container 134ddfb0355d6e37f554e02d447b5bcb0621b0226f221101c1f9901a223b3566: Status 404 returned error can't find the container with id 134ddfb0355d6e37f554e02d447b5bcb0621b0226f221101c1f9901a223b3566
Jul 23 18:35:45.620349 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:45.620304    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz" event={"ID":"da7bfa23-3e1b-4a70-82b2-aa04570f72e3","Type":"ContainerStarted","Data":"01adf7db8fbcc05fcf47221b94b7afa30a2e8433a46911efea4d083350351e39"}
Jul 23 18:35:45.620748 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:45.620368    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz" event={"ID":"da7bfa23-3e1b-4a70-82b2-aa04570f72e3","Type":"ContainerStarted","Data":"134ddfb0355d6e37f554e02d447b5bcb0621b0226f221101c1f9901a223b3566"}
Jul 23 18:35:45.639026 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:45.638972    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz" podStartSLOduration=1.6389545170000002 podStartE2EDuration="1.638954517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:45.636086677 +0000 UTC m=+2005.998930546" watchObservedRunningTime="2026-07-23 18:35:45.638954517 +0000 UTC m=+2006.001798365"
Jul 23 18:35:46.628028 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:46.627988    2574 generic.go:356] "Generic (PLEG): container finished" podID="da7bfa23-3e1b-4a70-82b2-aa04570f72e3" containerID="01adf7db8fbcc05fcf47221b94b7afa30a2e8433a46911efea4d083350351e39" exitCode=0
Jul 23 18:35:46.628507 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:46.628077    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz" event={"ID":"da7bfa23-3e1b-4a70-82b2-aa04570f72e3","Type":"ContainerDied","Data":"01adf7db8fbcc05fcf47221b94b7afa30a2e8433a46911efea4d083350351e39"}
Jul 23 18:35:47.776637 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:47.776608    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"
Jul 23 18:35:47.934250 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:47.934123    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da7bfa23-3e1b-4a70-82b2-aa04570f72e3-maas-api-service-ca\") pod \"da7bfa23-3e1b-4a70-82b2-aa04570f72e3\" (UID: \"da7bfa23-3e1b-4a70-82b2-aa04570f72e3\") "
Jul 23 18:35:47.934533 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:47.934510    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da7bfa23-3e1b-4a70-82b2-aa04570f72e3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da7bfa23-3e1b-4a70-82b2-aa04570f72e3" (UID: "da7bfa23-3e1b-4a70-82b2-aa04570f72e3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:35:48.035766 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:48.035726    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da7bfa23-3e1b-4a70-82b2-aa04570f72e3-maas-api-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:35:48.640967 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:48.640936    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"
Jul 23 18:35:48.640967 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:48.640949    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz" event={"ID":"da7bfa23-3e1b-4a70-82b2-aa04570f72e3","Type":"ContainerDied","Data":"134ddfb0355d6e37f554e02d447b5bcb0621b0226f221101c1f9901a223b3566"}
Jul 23 18:35:48.641194 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:48.640992    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="134ddfb0355d6e37f554e02d447b5bcb0621b0226f221101c1f9901a223b3566"
Jul 23 18:35:55.305509 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.305474    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"]
Jul 23 18:35:55.305938 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.305689    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl" podUID="4f7a5ad2-d871-441a-8c58-e888001a2828" containerName="maas-api" containerID="cri-o://6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42" gracePeriod=30
Jul 23 18:35:55.325450 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.325423    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:55.566491 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.566460    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:55.613164 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.613133    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f7a5ad2-d871-441a-8c58-e888001a2828-openshift-service-ca\") pod \"4f7a5ad2-d871-441a-8c58-e888001a2828\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") "
Jul 23 18:35:55.613382 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.613215    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcqbr\" (UniqueName: \"kubernetes.io/projected/4f7a5ad2-d871-441a-8c58-e888001a2828-kube-api-access-tcqbr\") pod \"4f7a5ad2-d871-441a-8c58-e888001a2828\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") "
Jul 23 18:35:55.613382 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.613345    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f7a5ad2-d871-441a-8c58-e888001a2828-maas-api-tls\") pod \"4f7a5ad2-d871-441a-8c58-e888001a2828\" (UID: \"4f7a5ad2-d871-441a-8c58-e888001a2828\") "
Jul 23 18:35:55.613569 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.613539    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f7a5ad2-d871-441a-8c58-e888001a2828-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4f7a5ad2-d871-441a-8c58-e888001a2828" (UID: "4f7a5ad2-d871-441a-8c58-e888001a2828"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:35:55.615398 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.615353    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f7a5ad2-d871-441a-8c58-e888001a2828-kube-api-access-tcqbr" (OuterVolumeSpecName: "kube-api-access-tcqbr") pod "4f7a5ad2-d871-441a-8c58-e888001a2828" (UID: "4f7a5ad2-d871-441a-8c58-e888001a2828"). InnerVolumeSpecName "kube-api-access-tcqbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:35:55.615516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.615494    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f7a5ad2-d871-441a-8c58-e888001a2828-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4f7a5ad2-d871-441a-8c58-e888001a2828" (UID: "4f7a5ad2-d871-441a-8c58-e888001a2828"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:35:55.684461 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.684428    2574 generic.go:356] "Generic (PLEG): container finished" podID="4f7a5ad2-d871-441a-8c58-e888001a2828" containerID="6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42" exitCode=0
Jul 23 18:35:55.684653 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.684484    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"
Jul 23 18:35:55.684653 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.684519    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl" event={"ID":"4f7a5ad2-d871-441a-8c58-e888001a2828","Type":"ContainerDied","Data":"6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42"}
Jul 23 18:35:55.684653 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.684587    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl" event={"ID":"4f7a5ad2-d871-441a-8c58-e888001a2828","Type":"ContainerDied","Data":"b3613c5937cf9388587099c5c757052156dcfd263a6ee94f876627923b94db77"}
Jul 23 18:35:55.684653 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.684618    2574 scope.go:117] "RemoveContainer" containerID="6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42"
Jul 23 18:35:55.695037 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.695014    2574 scope.go:117] "RemoveContainer" containerID="6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42"
Jul 23 18:35:55.695320 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:35:55.695300    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42\": container with ID starting with 6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42 not found: ID does not exist" containerID="6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42"
Jul 23 18:35:55.695408 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.695331    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42"} err="failed to get container status \"6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42\": rpc error: code = NotFound desc = could not find container \"6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42\": container with ID starting with 6282b0409d9f3d490b991a573f81aab05f437aad8aef2b8240d11ae65e42cf42 not found: ID does not exist"
Jul 23 18:35:55.714637 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.714601    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f7a5ad2-d871-441a-8c58-e888001a2828-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:35:55.714637 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.714636    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f7a5ad2-d871-441a-8c58-e888001a2828-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:35:55.714812 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.714649    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcqbr\" (UniqueName: \"kubernetes.io/projected/4f7a5ad2-d871-441a-8c58-e888001a2828-kube-api-access-tcqbr\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:35:55.717455 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.717432    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"]
Jul 23 18:35:55.722485 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:55.722460    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3c233914-5c4b6fbdcc-nf8hl"]
Jul 23 18:35:56.185807 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:56.185770    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f7a5ad2-d871-441a-8c58-e888001a2828" path="/var/lib/kubelet/pods/4f7a5ad2-d871-441a-8c58-e888001a2828/volumes"
Jul 23 18:35:57.188490 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:57.188436    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:58.304356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:58.304316    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:35:59.534752 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:59.534716    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"]
Jul 23 18:35:59.537768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:59.537742    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3c233914-ccptz"]
Jul 23 18:35:59.621393 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:59.621356    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:35:59.939634 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:35:59.939594    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:00.187022 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:00.186984    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da7bfa23-3e1b-4a70-82b2-aa04570f72e3" path="/var/lib/kubelet/pods/da7bfa23-3e1b-4a70-82b2-aa04570f72e3/volumes"
Jul 23 18:36:06.103589 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:06.103556    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:06.164859 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:06.164797    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:06.405150 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:06.405050    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:06.653416 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:06.653369    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:06.809178 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:06.809071    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:06.909092 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:06.909031    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:07.041956 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:07.041918    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:14.745028 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:14.744982    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:14.854878 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:14.854834    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:14.955768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:14.955731    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:15.156706 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:15.156664    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:23.493395 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:23.493338    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:23.575922 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:23.575823    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:30.615457 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:30.615414    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:31.007763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:31.007661    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:31.880866 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:31.880831    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:34.539242 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.539178    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:34.627105 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.627053    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:34.629572 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.629550    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"]
Jul 23 18:36:34.630017 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.630004    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f7a5ad2-d871-441a-8c58-e888001a2828" containerName="maas-api"
Jul 23 18:36:34.630067 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.630019    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f7a5ad2-d871-441a-8c58-e888001a2828" containerName="maas-api"
Jul 23 18:36:34.630067 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.630035    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da7bfa23-3e1b-4a70-82b2-aa04570f72e3" containerName="revoke-keys"
Jul 23 18:36:34.630067 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.630041    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="da7bfa23-3e1b-4a70-82b2-aa04570f72e3" containerName="revoke-keys"
Jul 23 18:36:34.630166 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.630112    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="da7bfa23-3e1b-4a70-82b2-aa04570f72e3" containerName="revoke-keys"
Jul 23 18:36:34.630166 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.630123    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f7a5ad2-d871-441a-8c58-e888001a2828" containerName="maas-api"
Jul 23 18:36:34.633385 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.633368    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:34.636727 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.636705    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a06c87e8-serving-cert\""
Jul 23 18:36:34.646739 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.646714    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"]
Jul 23 18:36:34.691293 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.691252    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:34.705913 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.705879    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-maas-api-tls\") pod \"maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:34.706072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.705932    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-openshift-service-ca\") pod \"maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:34.706072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.705997    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n65xs\" (UniqueName: \"kubernetes.io/projected/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-kube-api-access-n65xs\") pod \"maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:34.792520 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.792435    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:34.807111 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.807082    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-maas-api-tls\") pod \"maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:34.807251 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.807119    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-openshift-service-ca\") pod \"maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:34.807251 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.807140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n65xs\" (UniqueName: \"kubernetes.io/projected/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-kube-api-access-n65xs\") pod \"maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:34.807750 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.807730    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-openshift-service-ca\") pod \"maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:34.809538 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.809516    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-maas-api-tls\") pod \"maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:34.821770 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.821736    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n65xs\" (UniqueName: \"kubernetes.io/projected/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-kube-api-access-n65xs\") pod \"maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:34.944022 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:34.943994    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:35.104052 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:35.104022    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"]
Jul 23 18:36:35.105321 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:36:35.105285    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2132ddff_b435_4b2f_9ee3_9c0043f6ea6e.slice/crio-b104c6b6ea41d7bbf4854ada27d179a37da7e9d8437b554d2d596330d06c0191 WatchSource:0}: Error finding container b104c6b6ea41d7bbf4854ada27d179a37da7e9d8437b554d2d596330d06c0191: Status 404 returned error can't find the container with id b104c6b6ea41d7bbf4854ada27d179a37da7e9d8437b554d2d596330d06c0191
Jul 23 18:36:35.106652 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:35.106634    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:36:35.312490 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:35.312446    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:35.410658 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:35.410551    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:35.929403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:35.929311    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k" event={"ID":"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e","Type":"ContainerStarted","Data":"89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47"}
Jul 23 18:36:35.929403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:35.929361    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k" event={"ID":"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e","Type":"ContainerStarted","Data":"b104c6b6ea41d7bbf4854ada27d179a37da7e9d8437b554d2d596330d06c0191"}
Jul 23 18:36:35.929803 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:35.929464    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:35.956660 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:35.956609    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k" podStartSLOduration=1.425721045 podStartE2EDuration="1.956593476s" totalImagesPullingTime="530.872431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:35.95519504 +0000 UTC m=+2056.318038878" watchObservedRunningTime="2026-07-23 18:36:35.956593476 +0000 UTC m=+2056.319437358"
Jul 23 18:36:39.064609 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:39.064571    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:40.902732 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:40.902692    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:36:41.947367 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:41.947291    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:36:53.426492 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:53.426451    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:36:56.996600 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:36:56.996567    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:37:09.298772 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:09.298734    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:37:20.278337 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:20.278310    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:37:20.299695 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:20.299671    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:37:20.413212 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:20.413177    2574 scope.go:117] "RemoveContainer" containerID="f6d55a4a0b6c2bd3d4fcebb7117bd43b03ed694e276afdd6c2be2fb85879d0ce"
Jul 23 18:37:26.608624 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:26.608582    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:37:28.344194 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.344152    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"]
Jul 23 18:37:28.344697 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.344424    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k" podUID="2132ddff-b435-4b2f-9ee3-9c0043f6ea6e" containerName="maas-api" containerID="cri-o://89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47" gracePeriod=30
Jul 23 18:37:28.361072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.361044    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:28.596611 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.596553    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:37:28.737692 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.737661    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-maas-api-tls\") pod \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") "
Jul 23 18:37:28.737881 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.737713    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n65xs\" (UniqueName: \"kubernetes.io/projected/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-kube-api-access-n65xs\") pod \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") "
Jul 23 18:37:28.737881 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.737768    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-openshift-service-ca\") pod \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\" (UID: \"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e\") "
Jul 23 18:37:28.738421 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.738375    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2132ddff-b435-4b2f-9ee3-9c0043f6ea6e" (UID: "2132ddff-b435-4b2f-9ee3-9c0043f6ea6e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:37:28.740305 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.740269    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2132ddff-b435-4b2f-9ee3-9c0043f6ea6e" (UID: "2132ddff-b435-4b2f-9ee3-9c0043f6ea6e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:37:28.740439 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.740369    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-kube-api-access-n65xs" (OuterVolumeSpecName: "kube-api-access-n65xs") pod "2132ddff-b435-4b2f-9ee3-9c0043f6ea6e" (UID: "2132ddff-b435-4b2f-9ee3-9c0043f6ea6e"). InnerVolumeSpecName "kube-api-access-n65xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:37:28.839065 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.839027    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:37:28.839065 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.839062    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n65xs\" (UniqueName: \"kubernetes.io/projected/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-kube-api-access-n65xs\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:37:28.839321 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:28.839077    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:37:29.255503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:29.255466    2574 generic.go:356] "Generic (PLEG): container finished" podID="2132ddff-b435-4b2f-9ee3-9c0043f6ea6e" containerID="89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47" exitCode=0
Jul 23 18:37:29.255704 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:29.255511    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"
Jul 23 18:37:29.255704 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:29.255546    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k" event={"ID":"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e","Type":"ContainerDied","Data":"89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47"}
Jul 23 18:37:29.255704 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:29.255608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k" event={"ID":"2132ddff-b435-4b2f-9ee3-9c0043f6ea6e","Type":"ContainerDied","Data":"b104c6b6ea41d7bbf4854ada27d179a37da7e9d8437b554d2d596330d06c0191"}
Jul 23 18:37:29.255704 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:29.255639    2574 scope.go:117] "RemoveContainer" containerID="89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47"
Jul 23 18:37:29.265836 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:29.265819    2574 scope.go:117] "RemoveContainer" containerID="89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47"
Jul 23 18:37:29.266064 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:37:29.266047    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47\": container with ID starting with 89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47 not found: ID does not exist" containerID="89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47"
Jul 23 18:37:29.266103 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:29.266077    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47"} err="failed to get container status \"89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47\": rpc error: code = NotFound desc = could not find container \"89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47\": container with ID starting with 89f5de8cb3978a94df8091ebb84b81f0044c083b1145c2da3c69afd9202ffc47 not found: ID does not exist"
Jul 23 18:37:29.289363 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:29.289342    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"]
Jul 23 18:37:29.293382 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:29.293363    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a06c87e8-57c58fc959-z2z8k"]
Jul 23 18:37:30.187635 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:30.187601    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2132ddff-b435-4b2f-9ee3-9c0043f6ea6e" path="/var/lib/kubelet/pods/2132ddff-b435-4b2f-9ee3-9c0043f6ea6e/volumes"
Jul 23 18:37:32.822705 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:32.822667    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:35.166424 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:35.166391    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:36.156595 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:36.156562    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:36.501157 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:36.501075    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:37:40.190962 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:40.190923    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:47.201437 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:47.201394    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:37:47.304763 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:37:47.304727    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:16.527884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:16.527798    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:19.702509 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:19.702470    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:20.435386 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:20.435349    2574 scope.go:117] "RemoveContainer" containerID="b919b39b63093675cc1a0a33a0c81645940d925221a05a6695d53c0db3ed95e8"
Jul 23 18:38:27.265785 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:27.265746    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:27.359986 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:27.359948    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:27.630910 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:27.630876    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:27.862575 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:27.862536    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:28.988536 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:28.988500    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:29.087451 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:29.087406    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:29.194740 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:29.194703    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:30.100823 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:30.100792    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:30.517714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:30.517624    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:30.620160 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:30.620125    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:31.584510 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:31.584469    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:38:32.103974 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:32.103938    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:39.444274 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:39.444208    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:39.545127 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:39.545064    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:40.381149 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:40.381110    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:42.760130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:42.760089    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:38:48.397704 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:48.397638    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:48.493274 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:48.493193    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:48.604698 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:48.604663    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:48.707512 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:48.707415    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:59.298705 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:59.298664    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:38:59.647793 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:38:59.647750    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:20.707681 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:20.707644    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:28.113467 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:28.113428    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:28.208955 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:28.208915    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:28.460323 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:28.460212    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:28.805521 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:28.805430    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:29.370144 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:29.370111    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:32.449174 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.449131    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:32.571735 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.571701    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:32.715083 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.714975    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:32.826023 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.825983    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:32.851579 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.851547    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"]
Jul 23 18:39:32.851979 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.851967    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2132ddff-b435-4b2f-9ee3-9c0043f6ea6e" containerName="maas-api"
Jul 23 18:39:32.851979 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.851980    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="2132ddff-b435-4b2f-9ee3-9c0043f6ea6e" containerName="maas-api"
Jul 23 18:39:32.852070 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.852061    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="2132ddff-b435-4b2f-9ee3-9c0043f6ea6e" containerName="maas-api"
Jul 23 18:39:32.855315 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.855292    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:32.863541 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.863523    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-89c000-serving-cert\""
Jul 23 18:39:32.875497 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.875459    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"]
Jul 23 18:39:32.930343 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.930306    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-maas-api-tls\") pod \"maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:32.930530 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.930362    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxrd8\" (UniqueName: \"kubernetes.io/projected/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-kube-api-access-dxrd8\") pod \"maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:32.930530 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:32.930438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:33.031672 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.031573    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-maas-api-tls\") pod \"maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:33.031672 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.031635    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxrd8\" (UniqueName: \"kubernetes.io/projected/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-kube-api-access-dxrd8\") pod \"maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:33.031891 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.031707    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:33.032354 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.032334    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:33.034143 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.034111    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-maas-api-tls\") pod \"maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:33.034789 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.034764    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:33.046616 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.046586    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxrd8\" (UniqueName: \"kubernetes.io/projected/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-kube-api-access-dxrd8\") pod \"maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:33.165790 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.165751    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:33.343590 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.343560    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"]
Jul 23 18:39:33.346328 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:39:33.346294    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac4c8448_e6fb_40ca_b7e8_7afbc4feabfd.slice/crio-a68f8b8deaaea327a2087be1386b44e6310fe668bfbd4132dfcd736cb4e079e0 WatchSource:0}: Error finding container a68f8b8deaaea327a2087be1386b44e6310fe668bfbd4132dfcd736cb4e079e0: Status 404 returned error can't find the container with id a68f8b8deaaea327a2087be1386b44e6310fe668bfbd4132dfcd736cb4e079e0
Jul 23 18:39:33.625925 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.625836    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:33.732333 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:33.732291    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:34.005017 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:34.004922    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd" event={"ID":"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd","Type":"ContainerStarted","Data":"f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31"}
Jul 23 18:39:34.005017 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:34.004971    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd" event={"ID":"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd","Type":"ContainerStarted","Data":"a68f8b8deaaea327a2087be1386b44e6310fe668bfbd4132dfcd736cb4e079e0"}
Jul 23 18:39:34.005017 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:34.005004    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:34.030467 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:34.030406    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd" podStartSLOduration=1.627386268 podStartE2EDuration="2.030389856s" totalImagesPullingTime="403.003588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:34.02876687 +0000 UTC m=+2234.391610716" watchObservedRunningTime="2026-07-23 18:39:34.030389856 +0000 UTC m=+2234.393233704"
Jul 23 18:39:36.927297 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:36.927261    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:39:36.927759 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:36.927515    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:37.285723 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:37.285639    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:37.636925 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:37.636890    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:38.024398 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:38.024309    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:40.018609 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.018582    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:39:40.491282 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.491211    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:40.581956 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.581922    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:40.606660 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.606630    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"]
Jul 23 18:39:40.610550 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.610530    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:40.613533 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.613512    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-fa8ad7-serving-cert\""
Jul 23 18:39:40.614064 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.614045    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-maas-api-tls\") pod \"maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:40.614148 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.614087    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:40.614148 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.614108    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzwzj\" (UniqueName: \"kubernetes.io/projected/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-kube-api-access-hzwzj\") pod \"maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:40.623345 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.623319    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"]
Jul 23 18:39:40.668624 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.668592    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:40.715479 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.715445    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-maas-api-tls\") pod \"maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:40.715665 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.715502    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:40.715665 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.715534    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzwzj\" (UniqueName: \"kubernetes.io/projected/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-kube-api-access-hzwzj\") pod \"maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:40.715665 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:39:40.715604    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-serving-cert: secret "maas-api-e2e-inf-b-fa8ad7-serving-cert" not found
Jul 23 18:39:40.715665 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:39:40.715666    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-maas-api-tls podName:94af6b51-b3bd-4fb6-a1bd-f7402ca01582 nodeName:}" failed. No retries permitted until 2026-07-23 18:39:41.21565055 +0000 UTC m=+2241.578494376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-maas-api-tls") pod "maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4" (UID: "94af6b51-b3bd-4fb6-a1bd-f7402ca01582") : secret "maas-api-e2e-inf-b-fa8ad7-serving-cert" not found
Jul 23 18:39:40.716190 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.716173    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-openshift-service-ca\") pod \"maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:40.729417 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:40.729384    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzwzj\" (UniqueName: \"kubernetes.io/projected/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-kube-api-access-hzwzj\") pod \"maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:41.032049 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:41.032013    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:41.219502 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:41.219464    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-maas-api-tls\") pod \"maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:41.221990 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:41.221966    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-maas-api-tls\") pod \"maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:41.283072 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:41.282970    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:41.382103 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:41.382037    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:41.521752 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:41.521715    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:41.671136 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:41.671104    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"]
Jul 23 18:39:41.672605 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:39:41.672577    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94af6b51_b3bd_4fb6_a1bd_f7402ca01582.slice/crio-9c03c243873f9dbbca678d56939330e947b825d21508a4c2b42c99b6a11730d9 WatchSource:0}: Error finding container 9c03c243873f9dbbca678d56939330e947b825d21508a4c2b42c99b6a11730d9: Status 404 returned error can't find the container with id 9c03c243873f9dbbca678d56939330e947b825d21508a4c2b42c99b6a11730d9
Jul 23 18:39:42.061947 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:42.061911    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4" event={"ID":"94af6b51-b3bd-4fb6-a1bd-f7402ca01582","Type":"ContainerStarted","Data":"9c03c243873f9dbbca678d56939330e947b825d21508a4c2b42c99b6a11730d9"}
Jul 23 18:39:43.069730 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:43.069691    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4" event={"ID":"94af6b51-b3bd-4fb6-a1bd-f7402ca01582","Type":"ContainerStarted","Data":"4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c"}
Jul 23 18:39:43.070181 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:43.069838    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:43.088051 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:43.087988    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4" podStartSLOduration=2.393599263 podStartE2EDuration="3.087972686s" totalImagesPullingTime="694.373423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:43.086650209 +0000 UTC m=+2243.449494093" watchObservedRunningTime="2026-07-23 18:39:43.087972686 +0000 UTC m=+2243.450816530"
Jul 23 18:39:44.908547 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:44.908499    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:47.318150 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:47.318111    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:39:49.080301 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:49.080271    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:39:49.413578 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:49.413484    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:54.627005 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:54.626973    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:39:54.729787 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:39:54.729751    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:01.330410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:01.330376    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:40:02.254468 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:02.254430    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:02.353696 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:02.353664    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:10.906216 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:10.906170    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:18.813650 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:18.813617    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:40:28.845627 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:28.845579    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:30.261724 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:30.261686    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:39.328185 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:39.328146    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:39.387057 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:39.387022    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:54.494141 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:54.494107    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:55.461012 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:55.460975    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:55.592132 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:55.592087    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"]
Jul 23 18:40:55.597848 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:55.597819    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"
Jul 23 18:40:55.601254 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:55.601204    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:40:55.607958 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:55.607931    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"]
Jul 23 18:40:55.751751 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:55.751657    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a70d1f20-3f5b-4573-8192-c6c4523d77a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-89c000-799bp\" (UID: \"a70d1f20-3f5b-4573-8192-c6c4523d77a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"
Jul 23 18:40:55.852363 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:55.852326    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a70d1f20-3f5b-4573-8192-c6c4523d77a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-89c000-799bp\" (UID: \"a70d1f20-3f5b-4573-8192-c6c4523d77a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"
Jul 23 18:40:55.852957 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:55.852938    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a70d1f20-3f5b-4573-8192-c6c4523d77a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-89c000-799bp\" (UID: \"a70d1f20-3f5b-4573-8192-c6c4523d77a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"
Jul 23 18:40:55.912965 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:55.912921    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"
Jul 23 18:40:56.054195 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:56.054158    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"]
Jul 23 18:40:56.055659 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:40:56.055631    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda70d1f20_3f5b_4573_8192_c6c4523d77a7.slice/crio-9bf4dc1924b09970929f9c8c82afbefeb756392c99cfe24d8211deb4090301aa WatchSource:0}: Error finding container 9bf4dc1924b09970929f9c8c82afbefeb756392c99cfe24d8211deb4090301aa: Status 404 returned error can't find the container with id 9bf4dc1924b09970929f9c8c82afbefeb756392c99cfe24d8211deb4090301aa
Jul 23 18:40:56.145363 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:56.145319    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:56.244596 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:56.244565    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:40:56.506081 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:56.506047    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp" event={"ID":"a70d1f20-3f5b-4573-8192-c6c4523d77a7","Type":"ContainerStarted","Data":"86cd729a98f6311d24110879ed5eee3e32fab4fa520d007d48f4589ccd979407"}
Jul 23 18:40:56.506299 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:56.506106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp" event={"ID":"a70d1f20-3f5b-4573-8192-c6c4523d77a7","Type":"ContainerStarted","Data":"9bf4dc1924b09970929f9c8c82afbefeb756392c99cfe24d8211deb4090301aa"}
Jul 23 18:40:56.526790 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:56.526739    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp" podStartSLOduration=1.526724111 podStartE2EDuration="1.526724111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:40:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:40:56.524354634 +0000 UTC m=+2316.887198493" watchObservedRunningTime="2026-07-23 18:40:56.526724111 +0000 UTC m=+2316.889567959"
Jul 23 18:40:57.514829 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:57.514786    2574 generic.go:356] "Generic (PLEG): container finished" podID="a70d1f20-3f5b-4573-8192-c6c4523d77a7" containerID="86cd729a98f6311d24110879ed5eee3e32fab4fa520d007d48f4589ccd979407" exitCode=0
Jul 23 18:40:57.515215 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:57.514875    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp" event={"ID":"a70d1f20-3f5b-4573-8192-c6c4523d77a7","Type":"ContainerDied","Data":"86cd729a98f6311d24110879ed5eee3e32fab4fa520d007d48f4589ccd979407"}
Jul 23 18:40:58.661596 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:58.661571    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"
Jul 23 18:40:58.782475 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:58.782386    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a70d1f20-3f5b-4573-8192-c6c4523d77a7-maas-api-service-ca\") pod \"a70d1f20-3f5b-4573-8192-c6c4523d77a7\" (UID: \"a70d1f20-3f5b-4573-8192-c6c4523d77a7\") "
Jul 23 18:40:58.782758 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:58.782736    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a70d1f20-3f5b-4573-8192-c6c4523d77a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a70d1f20-3f5b-4573-8192-c6c4523d77a7" (UID: "a70d1f20-3f5b-4573-8192-c6c4523d77a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:40:58.883879 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:58.883838    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a70d1f20-3f5b-4573-8192-c6c4523d77a7-maas-api-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:40:59.496717 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:59.496681    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:40:59.528466 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:59.528437    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"
Jul 23 18:40:59.528466 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:59.528456    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp" event={"ID":"a70d1f20-3f5b-4573-8192-c6c4523d77a7","Type":"ContainerDied","Data":"9bf4dc1924b09970929f9c8c82afbefeb756392c99cfe24d8211deb4090301aa"}
Jul 23 18:40:59.528714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:40:59.528496    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bf4dc1924b09970929f9c8c82afbefeb756392c99cfe24d8211deb4090301aa"
Jul 23 18:41:06.058615 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.058576    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"]
Jul 23 18:41:06.059128 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.058835    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd" podUID="ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd" containerName="maas-api" containerID="cri-o://f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31" gracePeriod=30
Jul 23 18:41:06.082424 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.082394    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:06.312865 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.312801    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:41:06.348576 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.348538    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-maas-api-tls\") pod \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") "
Jul 23 18:41:06.348767 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.348600    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-openshift-service-ca\") pod \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") "
Jul 23 18:41:06.348767 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.348700    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxrd8\" (UniqueName: \"kubernetes.io/projected/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-kube-api-access-dxrd8\") pod \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\" (UID: \"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd\") "
Jul 23 18:41:06.351340 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.349382    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd" (UID: "ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:41:06.351340 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.349614    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:41:06.358942 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.358903    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd" (UID: "ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:41:06.359139 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.359112    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-kube-api-access-dxrd8" (OuterVolumeSpecName: "kube-api-access-dxrd8") pod "ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd" (UID: "ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd"). InnerVolumeSpecName "kube-api-access-dxrd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:41:06.451045 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.451009    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxrd8\" (UniqueName: \"kubernetes.io/projected/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-kube-api-access-dxrd8\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:41:06.451045 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.451041    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:41:06.571755 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.571721    2574 generic.go:356] "Generic (PLEG): container finished" podID="ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd" containerID="f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31" exitCode=0
Jul 23 18:41:06.571935 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.571781    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"
Jul 23 18:41:06.571935 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.571803    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd" event={"ID":"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd","Type":"ContainerDied","Data":"f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31"}
Jul 23 18:41:06.571935 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.571878    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd" event={"ID":"ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd","Type":"ContainerDied","Data":"a68f8b8deaaea327a2087be1386b44e6310fe668bfbd4132dfcd736cb4e079e0"}
Jul 23 18:41:06.571935 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.571900    2574 scope.go:117] "RemoveContainer" containerID="f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31"
Jul 23 18:41:06.582304 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.582287    2574 scope.go:117] "RemoveContainer" containerID="f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31"
Jul 23 18:41:06.582568 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:41:06.582548    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31\": container with ID starting with f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31 not found: ID does not exist" containerID="f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31"
Jul 23 18:41:06.582613 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.582576    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31"} err="failed to get container status \"f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31\": rpc error: code = NotFound desc = could not find container \"f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31\": container with ID starting with f78b535a94a970f900dce9ba810212418b8dcc75bcc914af1833304118d32b31 not found: ID does not exist"
Jul 23 18:41:06.596880 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.596857    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"]
Jul 23 18:41:06.603857 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:06.603833    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-89c000-6b99cd89bc-k9gvd"]
Jul 23 18:41:08.185567 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:08.185527    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd" path="/var/lib/kubelet/pods/ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd/volumes"
Jul 23 18:41:10.689533 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:10.689493    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"]
Jul 23 18:41:10.692021 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:10.691995    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-89c000-799bp"]
Jul 23 18:41:11.714148 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:11.714059    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:11.794683 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:11.794651    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:12.185924 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:12.185879    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a70d1f20-3f5b-4573-8192-c6c4523d77a7" path="/var/lib/kubelet/pods/a70d1f20-3f5b-4573-8192-c6c4523d77a7/volumes"
Jul 23 18:41:14.996197 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:14.996160    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:41:17.792667 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:17.792633    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:17.852514 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:17.852460    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:18.107527 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.107490    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:18.362559 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.362459    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:18.502737 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.502701    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"]
Jul 23 18:41:18.503179 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.503164    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd" containerName="maas-api"
Jul 23 18:41:18.503179 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.503180    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd" containerName="maas-api"
Jul 23 18:41:18.503321 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.503194    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70d1f20-3f5b-4573-8192-c6c4523d77a7" containerName="revoke-keys"
Jul 23 18:41:18.503321 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.503201    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70d1f20-3f5b-4573-8192-c6c4523d77a7" containerName="revoke-keys"
Jul 23 18:41:18.503321 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.503303    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70d1f20-3f5b-4573-8192-c6c4523d77a7" containerName="revoke-keys"
Jul 23 18:41:18.503321 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.503322    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac4c8448-e6fb-40ca-b7e8-7afbc4feabfd" containerName="maas-api"
Jul 23 18:41:18.507944 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.507920    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"
Jul 23 18:41:18.511692 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.511668    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:41:18.519379 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.519348    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"]
Jul 23 18:41:18.566571 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.566535    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d3b852-cd2b-4437-b7fd-dac41a8eaf3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k\" (UID: \"38d3b852-cd2b-4437-b7fd-dac41a8eaf3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"
Jul 23 18:41:18.668189 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.668088    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d3b852-cd2b-4437-b7fd-dac41a8eaf3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k\" (UID: \"38d3b852-cd2b-4437-b7fd-dac41a8eaf3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"
Jul 23 18:41:18.668795 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.668773    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d3b852-cd2b-4437-b7fd-dac41a8eaf3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k\" (UID: \"38d3b852-cd2b-4437-b7fd-dac41a8eaf3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"
Jul 23 18:41:18.819117 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.819075    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"
Jul 23 18:41:18.965684 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:18.965583    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"]
Jul 23 18:41:18.968591 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:41:18.968561    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d3b852_cd2b_4437_b7fd_dac41a8eaf3a.slice/crio-5fc5f1d3a0f768763daad87ed1f48d64bbde9976cea198feca66e10c2ef4b780 WatchSource:0}: Error finding container 5fc5f1d3a0f768763daad87ed1f48d64bbde9976cea198feca66e10c2ef4b780: Status 404 returned error can't find the container with id 5fc5f1d3a0f768763daad87ed1f48d64bbde9976cea198feca66e10c2ef4b780
Jul 23 18:41:19.202417 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:19.202378    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:19.296754 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:19.296662    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:19.652569 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:19.652534    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k" event={"ID":"38d3b852-cd2b-4437-b7fd-dac41a8eaf3a","Type":"ContainerStarted","Data":"c284079d658f53b12798f3eefc92b90d6c1c5f8491f4e474e1311ad33e1336ad"}
Jul 23 18:41:19.652770 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:19.652587    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k" event={"ID":"38d3b852-cd2b-4437-b7fd-dac41a8eaf3a","Type":"ContainerStarted","Data":"5fc5f1d3a0f768763daad87ed1f48d64bbde9976cea198feca66e10c2ef4b780"}
Jul 23 18:41:19.670148 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:19.670087    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k" podStartSLOduration=1.67007005 podStartE2EDuration="1.67007005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:41:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:41:19.669572021 +0000 UTC m=+2340.032415871" watchObservedRunningTime="2026-07-23 18:41:19.67007005 +0000 UTC m=+2340.032913951"
Jul 23 18:41:20.660729 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:20.660695    2574 generic.go:356] "Generic (PLEG): container finished" podID="38d3b852-cd2b-4437-b7fd-dac41a8eaf3a" containerID="c284079d658f53b12798f3eefc92b90d6c1c5f8491f4e474e1311ad33e1336ad" exitCode=0
Jul 23 18:41:20.661109 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:20.660780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k" event={"ID":"38d3b852-cd2b-4437-b7fd-dac41a8eaf3a","Type":"ContainerDied","Data":"c284079d658f53b12798f3eefc92b90d6c1c5f8491f4e474e1311ad33e1336ad"}
Jul 23 18:41:21.806673 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:21.806648    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"
Jul 23 18:41:21.899684 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:21.899638    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d3b852-cd2b-4437-b7fd-dac41a8eaf3a-maas-api-service-ca\") pod \"38d3b852-cd2b-4437-b7fd-dac41a8eaf3a\" (UID: \"38d3b852-cd2b-4437-b7fd-dac41a8eaf3a\") "
Jul 23 18:41:21.900003 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:21.899979    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38d3b852-cd2b-4437-b7fd-dac41a8eaf3a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "38d3b852-cd2b-4437-b7fd-dac41a8eaf3a" (UID: "38d3b852-cd2b-4437-b7fd-dac41a8eaf3a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:41:22.001526 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:22.001422    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38d3b852-cd2b-4437-b7fd-dac41a8eaf3a-maas-api-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:41:22.674194 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:22.674161    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"
Jul 23 18:41:22.674389 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:22.674200    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k" event={"ID":"38d3b852-cd2b-4437-b7fd-dac41a8eaf3a","Type":"ContainerDied","Data":"5fc5f1d3a0f768763daad87ed1f48d64bbde9976cea198feca66e10c2ef4b780"}
Jul 23 18:41:22.674389 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:22.674294    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5fc5f1d3a0f768763daad87ed1f48d64bbde9976cea198feca66e10c2ef4b780"
Jul 23 18:41:29.079699 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.079499    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"]
Jul 23 18:41:29.080218 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.079781    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4" podUID="94af6b51-b3bd-4fb6-a1bd-f7402ca01582" containerName="maas-api" containerID="cri-o://4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c" gracePeriod=30
Jul 23 18:41:29.110537 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.110505    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:29.375727 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.375702    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:41:29.483417 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.483380    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzwzj\" (UniqueName: \"kubernetes.io/projected/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-kube-api-access-hzwzj\") pod \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") "
Jul 23 18:41:29.483593 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.483431    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-maas-api-tls\") pod \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") "
Jul 23 18:41:29.483593 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.483538    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-openshift-service-ca\") pod \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\" (UID: \"94af6b51-b3bd-4fb6-a1bd-f7402ca01582\") "
Jul 23 18:41:29.483891 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.483864    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94af6b51-b3bd-4fb6-a1bd-f7402ca01582" (UID: "94af6b51-b3bd-4fb6-a1bd-f7402ca01582"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:41:29.485504 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.485473    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94af6b51-b3bd-4fb6-a1bd-f7402ca01582" (UID: "94af6b51-b3bd-4fb6-a1bd-f7402ca01582"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:41:29.485624 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.485500    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-kube-api-access-hzwzj" (OuterVolumeSpecName: "kube-api-access-hzwzj") pod "94af6b51-b3bd-4fb6-a1bd-f7402ca01582" (UID: "94af6b51-b3bd-4fb6-a1bd-f7402ca01582"). InnerVolumeSpecName "kube-api-access-hzwzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:41:29.585163 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.585124    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:41:29.585163 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.585158    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzwzj\" (UniqueName: \"kubernetes.io/projected/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-kube-api-access-hzwzj\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:41:29.585163 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.585170    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94af6b51-b3bd-4fb6-a1bd-f7402ca01582-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:41:29.717953 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.717866    2574 generic.go:356] "Generic (PLEG): container finished" podID="94af6b51-b3bd-4fb6-a1bd-f7402ca01582" containerID="4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c" exitCode=0
Jul 23 18:41:29.717953 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.717912    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"
Jul 23 18:41:29.718120 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.717955    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4" event={"ID":"94af6b51-b3bd-4fb6-a1bd-f7402ca01582","Type":"ContainerDied","Data":"4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c"}
Jul 23 18:41:29.718120 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.718008    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4" event={"ID":"94af6b51-b3bd-4fb6-a1bd-f7402ca01582","Type":"ContainerDied","Data":"9c03c243873f9dbbca678d56939330e947b825d21508a4c2b42c99b6a11730d9"}
Jul 23 18:41:29.718120 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.718031    2574 scope.go:117] "RemoveContainer" containerID="4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c"
Jul 23 18:41:29.728564 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.728537    2574 scope.go:117] "RemoveContainer" containerID="4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c"
Jul 23 18:41:29.728851 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:41:29.728831    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c\": container with ID starting with 4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c not found: ID does not exist" containerID="4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c"
Jul 23 18:41:29.728921 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.728861    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c"} err="failed to get container status \"4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c\": rpc error: code = NotFound desc = could not find container \"4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c\": container with ID starting with 4783a69397d691b34a438f26b2bdc9873b1132e216d928cb85e4facc8caa511c not found: ID does not exist"
Jul 23 18:41:29.744811 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.744777    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"]
Jul 23 18:41:29.750995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:29.750966    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-fa8ad7-68d769b459-6nms4"]
Jul 23 18:41:30.186480 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:30.186448    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94af6b51-b3bd-4fb6-a1bd-f7402ca01582" path="/var/lib/kubelet/pods/94af6b51-b3bd-4fb6-a1bd-f7402ca01582/volumes"
Jul 23 18:41:32.105219 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:32.105182    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:41:33.578084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:33.578054    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:33.589826 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:33.589782    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"]
Jul 23 18:41:33.594881 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:33.594848    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fa8ad7-fh94k"]
Jul 23 18:41:34.033089 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:34.032974    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:34.185745 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:34.185713    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d3b852-cd2b-4437-b7fd-dac41a8eaf3a" path="/var/lib/kubelet/pods/38d3b852-cd2b-4437-b7fd-dac41a8eaf3a/volumes"
Jul 23 18:41:37.470462 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:37.470423    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:41.057319 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:41.057281    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:41.139776 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:41.139733    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:41.435209 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:41.435165    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:41.701297 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:41.701172    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:42.074049 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:42.074013    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:42.495740 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:42.495649    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:42.829553 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:42.829518    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:46.070297 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.070254    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:46.187413 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.187380    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"]
Jul 23 18:41:46.188028 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.188002    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d3b852-cd2b-4437-b7fd-dac41a8eaf3a" containerName="revoke-keys"
Jul 23 18:41:46.188028 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.188024    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d3b852-cd2b-4437-b7fd-dac41a8eaf3a" containerName="revoke-keys"
Jul 23 18:41:46.188192 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.188037    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94af6b51-b3bd-4fb6-a1bd-f7402ca01582" containerName="maas-api"
Jul 23 18:41:46.188192 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.188043    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="94af6b51-b3bd-4fb6-a1bd-f7402ca01582" containerName="maas-api"
Jul 23 18:41:46.188192 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.188116    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d3b852-cd2b-4437-b7fd-dac41a8eaf3a" containerName="revoke-keys"
Jul 23 18:41:46.188192 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.188128    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="94af6b51-b3bd-4fb6-a1bd-f7402ca01582" containerName="maas-api"
Jul 23 18:41:46.192850 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.192828    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:46.203273 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.203248    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-63cdc8-serving-cert\""
Jul 23 18:41:46.207483 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.207455    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:46.207747 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.207718    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"]
Jul 23 18:41:46.251213 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.251180    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e03920-6779-41e8-b5d7-9eb25a76840f-maas-api-tls\") pod \"maas-api-e2e-api-a-63cdc8-858447667c-c6g4w\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:46.251422 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.251270    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9e03920-6779-41e8-b5d7-9eb25a76840f-openshift-service-ca\") pod \"maas-api-e2e-api-a-63cdc8-858447667c-c6g4w\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:46.251422 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.251376    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl2qn\" (UniqueName: \"kubernetes.io/projected/a9e03920-6779-41e8-b5d7-9eb25a76840f-kube-api-access-bl2qn\") pod \"maas-api-e2e-api-a-63cdc8-858447667c-c6g4w\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:46.307054 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.307013    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:46.352926 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.352834    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl2qn\" (UniqueName: \"kubernetes.io/projected/a9e03920-6779-41e8-b5d7-9eb25a76840f-kube-api-access-bl2qn\") pod \"maas-api-e2e-api-a-63cdc8-858447667c-c6g4w\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:46.353092 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.352925    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e03920-6779-41e8-b5d7-9eb25a76840f-maas-api-tls\") pod \"maas-api-e2e-api-a-63cdc8-858447667c-c6g4w\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:46.353092 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.352956    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9e03920-6779-41e8-b5d7-9eb25a76840f-openshift-service-ca\") pod \"maas-api-e2e-api-a-63cdc8-858447667c-c6g4w\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:46.353185 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:41:46.353091    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-serving-cert: secret "maas-api-e2e-api-a-63cdc8-serving-cert" not found
Jul 23 18:41:46.353185 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:41:46.353173    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e03920-6779-41e8-b5d7-9eb25a76840f-maas-api-tls podName:a9e03920-6779-41e8-b5d7-9eb25a76840f nodeName:}" failed. No retries permitted until 2026-07-23 18:41:46.853152799 +0000 UTC m=+2367.215996631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9e03920-6779-41e8-b5d7-9eb25a76840f-maas-api-tls") pod "maas-api-e2e-api-a-63cdc8-858447667c-c6g4w" (UID: "a9e03920-6779-41e8-b5d7-9eb25a76840f") : secret "maas-api-e2e-api-a-63cdc8-serving-cert" not found
Jul 23 18:41:46.353690 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.353671    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9e03920-6779-41e8-b5d7-9eb25a76840f-openshift-service-ca\") pod \"maas-api-e2e-api-a-63cdc8-858447667c-c6g4w\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:46.368959 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.368931    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl2qn\" (UniqueName: \"kubernetes.io/projected/a9e03920-6779-41e8-b5d7-9eb25a76840f-kube-api-access-bl2qn\") pod \"maas-api-e2e-api-a-63cdc8-858447667c-c6g4w\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:46.639579 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.639474    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:46.857846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.857807    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e03920-6779-41e8-b5d7-9eb25a76840f-maas-api-tls\") pod \"maas-api-e2e-api-a-63cdc8-858447667c-c6g4w\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:46.860307 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:46.860285    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e03920-6779-41e8-b5d7-9eb25a76840f-maas-api-tls\") pod \"maas-api-e2e-api-a-63cdc8-858447667c-c6g4w\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:47.104909 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:47.104859    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:47.234410 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:47.234345    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:47.259482 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:47.259451    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"]
Jul 23 18:41:47.260505 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:41:47.260476    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e03920_6779_41e8_b5d7_9eb25a76840f.slice/crio-49b17fe35d7183f33ed6f0704bf0f0364ae94dbebc39eef06ad16e0249afbbfc WatchSource:0}: Error finding container 49b17fe35d7183f33ed6f0704bf0f0364ae94dbebc39eef06ad16e0249afbbfc: Status 404 returned error can't find the container with id 49b17fe35d7183f33ed6f0704bf0f0364ae94dbebc39eef06ad16e0249afbbfc
Jul 23 18:41:47.261892 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:47.261872    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:41:47.367745 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:47.367653    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:47.835743 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:47.835707    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w" event={"ID":"a9e03920-6779-41e8-b5d7-9eb25a76840f","Type":"ContainerStarted","Data":"eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7"}
Jul 23 18:41:47.835919 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:47.835777    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w" event={"ID":"a9e03920-6779-41e8-b5d7-9eb25a76840f","Type":"ContainerStarted","Data":"49b17fe35d7183f33ed6f0704bf0f0364ae94dbebc39eef06ad16e0249afbbfc"}
Jul 23 18:41:47.835986 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:47.835927    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:47.862426 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:47.862374    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w" podStartSLOduration=1.362756488 podStartE2EDuration="1.862354797s" totalImagesPullingTime="499.598309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:41:47.859281154 +0000 UTC m=+2368.222125028" watchObservedRunningTime="2026-07-23 18:41:47.862354797 +0000 UTC m=+2368.225198645"
Jul 23 18:41:50.663779 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:50.663735    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:51.187324 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:51.187278    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:51.550655 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:51.550559    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:51.616258 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:51.615496    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:41:52.199406 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:52.199368    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:53.175755 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:53.175720    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:53.848484 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:53.848456    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:41:55.241165 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.241132    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"]
Jul 23 18:41:55.257156 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.257118    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:55.261023 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.260999    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-dc83b7-serving-cert\""
Jul 23 18:41:55.269893 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.269864    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"]
Jul 23 18:41:55.341613 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.341559    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f69pc\" (UniqueName: \"kubernetes.io/projected/e2adad44-e9a6-414c-a20e-d3f2dc680173-kube-api-access-f69pc\") pod \"maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:55.341807 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.341620    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2adad44-e9a6-414c-a20e-d3f2dc680173-openshift-service-ca\") pod \"maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:55.341807 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.341680    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2adad44-e9a6-414c-a20e-d3f2dc680173-maas-api-tls\") pod \"maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:55.443210 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.443164    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2adad44-e9a6-414c-a20e-d3f2dc680173-maas-api-tls\") pod \"maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:55.443474 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.443298    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f69pc\" (UniqueName: \"kubernetes.io/projected/e2adad44-e9a6-414c-a20e-d3f2dc680173-kube-api-access-f69pc\") pod \"maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:55.443474 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.443333    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2adad44-e9a6-414c-a20e-d3f2dc680173-openshift-service-ca\") pod \"maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:55.443474 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:41:55.443348    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-serving-cert: secret "maas-api-e2e-api-b-dc83b7-serving-cert" not found
Jul 23 18:41:55.443474 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:41:55.443440    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2adad44-e9a6-414c-a20e-d3f2dc680173-maas-api-tls podName:e2adad44-e9a6-414c-a20e-d3f2dc680173 nodeName:}" failed. No retries permitted until 2026-07-23 18:41:55.943416666 +0000 UTC m=+2376.306260517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e2adad44-e9a6-414c-a20e-d3f2dc680173-maas-api-tls") pod "maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll" (UID: "e2adad44-e9a6-414c-a20e-d3f2dc680173") : secret "maas-api-e2e-api-b-dc83b7-serving-cert" not found
Jul 23 18:41:55.443991 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.443972    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2adad44-e9a6-414c-a20e-d3f2dc680173-openshift-service-ca\") pod \"maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:55.457703 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.457680    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f69pc\" (UniqueName: \"kubernetes.io/projected/e2adad44-e9a6-414c-a20e-d3f2dc680173-kube-api-access-f69pc\") pod \"maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:55.590336 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.590273    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:55.697016 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.696976    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:55.929778 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.929690    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:55.947806 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.947763    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2adad44-e9a6-414c-a20e-d3f2dc680173-maas-api-tls\") pod \"maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:55.950697 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:55.950671    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2adad44-e9a6-414c-a20e-d3f2dc680173-maas-api-tls\") pod \"maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:56.030062 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:56.030017    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:56.129085 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:56.129050    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:41:56.169508 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:56.169472    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:56.328706 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:56.328674    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"]
Jul 23 18:41:56.329177 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:41:56.329152    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2adad44_e9a6_414c_a20e_d3f2dc680173.slice/crio-e4d5e003d79e6a6da1667f29bc0f82d7ca595077817343800513dc95a252a23d WatchSource:0}: Error finding container e4d5e003d79e6a6da1667f29bc0f82d7ca595077817343800513dc95a252a23d: Status 404 returned error can't find the container with id e4d5e003d79e6a6da1667f29bc0f82d7ca595077817343800513dc95a252a23d
Jul 23 18:41:56.892588 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:56.892539    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll" event={"ID":"e2adad44-e9a6-414c-a20e-d3f2dc680173","Type":"ContainerStarted","Data":"42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347"}
Jul 23 18:41:56.892738 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:56.892603    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll" event={"ID":"e2adad44-e9a6-414c-a20e-d3f2dc680173","Type":"ContainerStarted","Data":"e4d5e003d79e6a6da1667f29bc0f82d7ca595077817343800513dc95a252a23d"}
Jul 23 18:41:56.892738 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:56.892632    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:41:56.922364 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:56.922259    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll" podStartSLOduration=1.596720234 podStartE2EDuration="1.922242852s" totalImagesPullingTime="325.522618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:41:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:41:56.920636391 +0000 UTC m=+2377.283480241" watchObservedRunningTime="2026-07-23 18:41:56.922242852 +0000 UTC m=+2377.285086698"
Jul 23 18:41:59.530414 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:41:59.530375    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:00.917704 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:00.917671    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:42:02.903562 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:02.903532    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:42:08.054369 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.054327    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"]
Jul 23 18:42:08.058980 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.058960    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"
Jul 23 18:42:08.065178 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.064981    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:42:08.068931 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.068905    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"]
Jul 23 18:42:08.165786 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.165739    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b71a52-efd2-4a1c-ac65-ae191368b804-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7\" (UID: \"00b71a52-efd2-4a1c-ac65-ae191368b804\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"
Jul 23 18:42:08.266617 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.266585    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b71a52-efd2-4a1c-ac65-ae191368b804-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7\" (UID: \"00b71a52-efd2-4a1c-ac65-ae191368b804\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"
Jul 23 18:42:08.267399 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.267373    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b71a52-efd2-4a1c-ac65-ae191368b804-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7\" (UID: \"00b71a52-efd2-4a1c-ac65-ae191368b804\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"
Jul 23 18:42:08.370821 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.370781    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"
Jul 23 18:42:08.535394 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.535341    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"]
Jul 23 18:42:08.537392 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:42:08.537361    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b71a52_efd2_4a1c_ac65_ae191368b804.slice/crio-bf516e2f3d12f9b6aef5d8797c494d87797d9dc8e69b21fd3e53a307ef44f7a4 WatchSource:0}: Error finding container bf516e2f3d12f9b6aef5d8797c494d87797d9dc8e69b21fd3e53a307ef44f7a4: Status 404 returned error can't find the container with id bf516e2f3d12f9b6aef5d8797c494d87797d9dc8e69b21fd3e53a307ef44f7a4
Jul 23 18:42:08.546436 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.546346    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:08.635079 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.634999    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:08.969001 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.968903    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7" event={"ID":"00b71a52-efd2-4a1c-ac65-ae191368b804","Type":"ContainerStarted","Data":"334f454709623f39d90ccbd197bae32476f5ffec38c35893ff89a4b4cc30ee88"}
Jul 23 18:42:08.969001 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.968968    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7" event={"ID":"00b71a52-efd2-4a1c-ac65-ae191368b804","Type":"ContainerStarted","Data":"bf516e2f3d12f9b6aef5d8797c494d87797d9dc8e69b21fd3e53a307ef44f7a4"}
Jul 23 18:42:08.995864 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:08.995801    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7" podStartSLOduration=0.995780244 podStartE2EDuration="995.780244ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:42:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:42:08.995602837 +0000 UTC m=+2389.358446686" watchObservedRunningTime="2026-07-23 18:42:08.995780244 +0000 UTC m=+2389.358624095"
Jul 23 18:42:09.976703 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:09.976666    2574 generic.go:356] "Generic (PLEG): container finished" podID="00b71a52-efd2-4a1c-ac65-ae191368b804" containerID="334f454709623f39d90ccbd197bae32476f5ffec38c35893ff89a4b4cc30ee88" exitCode=0
Jul 23 18:42:09.977111 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:09.976755    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7" event={"ID":"00b71a52-efd2-4a1c-ac65-ae191368b804","Type":"ContainerDied","Data":"334f454709623f39d90ccbd197bae32476f5ffec38c35893ff89a4b4cc30ee88"}
Jul 23 18:42:11.129741 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:11.129705    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"
Jul 23 18:42:11.298049 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:11.297957    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b71a52-efd2-4a1c-ac65-ae191368b804-maas-api-service-ca\") pod \"00b71a52-efd2-4a1c-ac65-ae191368b804\" (UID: \"00b71a52-efd2-4a1c-ac65-ae191368b804\") "
Jul 23 18:42:11.298376 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:11.298353    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b71a52-efd2-4a1c-ac65-ae191368b804-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "00b71a52-efd2-4a1c-ac65-ae191368b804" (UID: "00b71a52-efd2-4a1c-ac65-ae191368b804"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:42:11.398906 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:11.398858    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b71a52-efd2-4a1c-ac65-ae191368b804-maas-api-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:42:11.990766 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:11.990732    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7" event={"ID":"00b71a52-efd2-4a1c-ac65-ae191368b804","Type":"ContainerDied","Data":"bf516e2f3d12f9b6aef5d8797c494d87797d9dc8e69b21fd3e53a307ef44f7a4"}
Jul 23 18:42:11.990766 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:11.990753    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"
Jul 23 18:42:11.990990 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:11.990780    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf516e2f3d12f9b6aef5d8797c494d87797d9dc8e69b21fd3e53a307ef44f7a4"
Jul 23 18:42:14.106511 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:14.106474    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:16.975831 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:16.975798    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:17.082381 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:17.082327    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:18.899196 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:18.899155    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:18.996170 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:18.996115    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:20.317886 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:20.317857    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:42:20.342134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:20.342105    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:42:20.497121 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:20.497090    2574 scope.go:117] "RemoveContainer" containerID="01adf7db8fbcc05fcf47221b94b7afa30a2e8433a46911efea4d083350351e39"
Jul 23 18:42:24.173897 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.173859    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"]
Jul 23 18:42:24.174418 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.174352    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w" podUID="a9e03920-6779-41e8-b5d7-9eb25a76840f" containerName="maas-api" containerID="cri-o://eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7" gracePeriod=30
Jul 23 18:42:24.215338 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.215292    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:24.435557 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.435493    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:42:24.527521 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.527485    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9e03920-6779-41e8-b5d7-9eb25a76840f-openshift-service-ca\") pod \"a9e03920-6779-41e8-b5d7-9eb25a76840f\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") "
Jul 23 18:42:24.527722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.527532    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl2qn\" (UniqueName: \"kubernetes.io/projected/a9e03920-6779-41e8-b5d7-9eb25a76840f-kube-api-access-bl2qn\") pod \"a9e03920-6779-41e8-b5d7-9eb25a76840f\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") "
Jul 23 18:42:24.527722 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.527575    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e03920-6779-41e8-b5d7-9eb25a76840f-maas-api-tls\") pod \"a9e03920-6779-41e8-b5d7-9eb25a76840f\" (UID: \"a9e03920-6779-41e8-b5d7-9eb25a76840f\") "
Jul 23 18:42:24.527936 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.527912    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9e03920-6779-41e8-b5d7-9eb25a76840f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9e03920-6779-41e8-b5d7-9eb25a76840f" (UID: "a9e03920-6779-41e8-b5d7-9eb25a76840f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:42:24.529698 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.529677    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e03920-6779-41e8-b5d7-9eb25a76840f-kube-api-access-bl2qn" (OuterVolumeSpecName: "kube-api-access-bl2qn") pod "a9e03920-6779-41e8-b5d7-9eb25a76840f" (UID: "a9e03920-6779-41e8-b5d7-9eb25a76840f"). InnerVolumeSpecName "kube-api-access-bl2qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:42:24.529777 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.529677    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9e03920-6779-41e8-b5d7-9eb25a76840f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9e03920-6779-41e8-b5d7-9eb25a76840f" (UID: "a9e03920-6779-41e8-b5d7-9eb25a76840f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:42:24.628350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.628316    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9e03920-6779-41e8-b5d7-9eb25a76840f-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:42:24.628350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.628346    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl2qn\" (UniqueName: \"kubernetes.io/projected/a9e03920-6779-41e8-b5d7-9eb25a76840f-kube-api-access-bl2qn\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:42:24.628350 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:24.628356    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9e03920-6779-41e8-b5d7-9eb25a76840f-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:42:25.070775 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:25.070742    2574 generic.go:356] "Generic (PLEG): container finished" podID="a9e03920-6779-41e8-b5d7-9eb25a76840f" containerID="eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7" exitCode=0
Jul 23 18:42:25.070960 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:25.070786    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"
Jul 23 18:42:25.070960 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:25.070790    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w" event={"ID":"a9e03920-6779-41e8-b5d7-9eb25a76840f","Type":"ContainerDied","Data":"eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7"}
Jul 23 18:42:25.070960 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:25.070895    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w" event={"ID":"a9e03920-6779-41e8-b5d7-9eb25a76840f","Type":"ContainerDied","Data":"49b17fe35d7183f33ed6f0704bf0f0364ae94dbebc39eef06ad16e0249afbbfc"}
Jul 23 18:42:25.070960 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:25.070916    2574 scope.go:117] "RemoveContainer" containerID="eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7"
Jul 23 18:42:25.081292 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:25.081264    2574 scope.go:117] "RemoveContainer" containerID="eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7"
Jul 23 18:42:25.081590 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:42:25.081570    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7\": container with ID starting with eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7 not found: ID does not exist" containerID="eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7"
Jul 23 18:42:25.081667 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:25.081601    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7"} err="failed to get container status \"eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7\": rpc error: code = NotFound desc = could not find container \"eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7\": container with ID starting with eb15fdb085e390f6849552530fa8c4bca9f24c81d7a8ae64a621141eb22903b7 not found: ID does not exist"
Jul 23 18:42:25.096419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:25.096384    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"]
Jul 23 18:42:25.102599 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:25.102571    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-63cdc8-858447667c-c6g4w"]
Jul 23 18:42:26.185985 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:26.185943    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9e03920-6779-41e8-b5d7-9eb25a76840f" path="/var/lib/kubelet/pods/a9e03920-6779-41e8-b5d7-9eb25a76840f/volumes"
Jul 23 18:42:26.822726 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:26.822692    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:42:28.145922 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:28.145883    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:28.147647 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:28.147612    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"]
Jul 23 18:42:28.152872 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:28.152849    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-63cdc8-dw4t7"]
Jul 23 18:42:28.186616 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:28.186581    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b71a52-efd2-4a1c-ac65-ae191368b804" path="/var/lib/kubelet/pods/00b71a52-efd2-4a1c-ac65-ae191368b804/volumes"
Jul 23 18:42:28.583270 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:28.583215    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:35.054882 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.054839    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:35.160689 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.160656    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:35.378687 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.378654    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:35.674967 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.674874    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:35.820078 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.820041    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"]
Jul 23 18:42:35.820543 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.820527    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e03920-6779-41e8-b5d7-9eb25a76840f" containerName="maas-api"
Jul 23 18:42:35.820613 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.820544    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e03920-6779-41e8-b5d7-9eb25a76840f" containerName="maas-api"
Jul 23 18:42:35.820613 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.820562    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b71a52-efd2-4a1c-ac65-ae191368b804" containerName="revoke-keys"
Jul 23 18:42:35.820613 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.820568    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b71a52-efd2-4a1c-ac65-ae191368b804" containerName="revoke-keys"
Jul 23 18:42:35.820714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.820634    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b71a52-efd2-4a1c-ac65-ae191368b804" containerName="revoke-keys"
Jul 23 18:42:35.820714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.820643    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9e03920-6779-41e8-b5d7-9eb25a76840f" containerName="maas-api"
Jul 23 18:42:35.823562 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.823547    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"
Jul 23 18:42:35.830913 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.830891    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:42:35.840516 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.840480    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"]
Jul 23 18:42:35.941411 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:35.941310    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/587801e6-d458-400d-aebf-bdc09abb6018-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn\" (UID: \"587801e6-d458-400d-aebf-bdc09abb6018\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"
Jul 23 18:42:36.042304 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:36.042261    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/587801e6-d458-400d-aebf-bdc09abb6018-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn\" (UID: \"587801e6-d458-400d-aebf-bdc09abb6018\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"
Jul 23 18:42:36.042954 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:36.042932    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/587801e6-d458-400d-aebf-bdc09abb6018-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn\" (UID: \"587801e6-d458-400d-aebf-bdc09abb6018\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"
Jul 23 18:42:36.133783 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:36.133755    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"
Jul 23 18:42:36.280380 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:36.280353    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"]
Jul 23 18:42:36.282057 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:42:36.282030    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587801e6_d458_400d_aebf_bdc09abb6018.slice/crio-24f9bdff6b00f06defcac5d6d73a644b0169fedda394ffb2cd7efd7f6bba9a6d WatchSource:0}: Error finding container 24f9bdff6b00f06defcac5d6d73a644b0169fedda394ffb2cd7efd7f6bba9a6d: Status 404 returned error can't find the container with id 24f9bdff6b00f06defcac5d6d73a644b0169fedda394ffb2cd7efd7f6bba9a6d
Jul 23 18:42:36.409290 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:36.409249    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:36.508504 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:36.508408    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:37.148125 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:37.148090    2574 generic.go:356] "Generic (PLEG): container finished" podID="587801e6-d458-400d-aebf-bdc09abb6018" containerID="fd134c3d78d6514e0bfe1e53cd63b55ce8bf968515fbfb34cb578b8df73062e0" exitCode=0
Jul 23 18:42:37.148575 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:37.148179    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn" event={"ID":"587801e6-d458-400d-aebf-bdc09abb6018","Type":"ContainerDied","Data":"fd134c3d78d6514e0bfe1e53cd63b55ce8bf968515fbfb34cb578b8df73062e0"}
Jul 23 18:42:37.148575 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:37.148255    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn" event={"ID":"587801e6-d458-400d-aebf-bdc09abb6018","Type":"ContainerStarted","Data":"24f9bdff6b00f06defcac5d6d73a644b0169fedda394ffb2cd7efd7f6bba9a6d"}
Jul 23 18:42:38.296448 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:38.296422    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"
Jul 23 18:42:38.364803 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:38.364769    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/587801e6-d458-400d-aebf-bdc09abb6018-maas-api-service-ca\") pod \"587801e6-d458-400d-aebf-bdc09abb6018\" (UID: \"587801e6-d458-400d-aebf-bdc09abb6018\") "
Jul 23 18:42:38.365082 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:38.365056    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/587801e6-d458-400d-aebf-bdc09abb6018-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "587801e6-d458-400d-aebf-bdc09abb6018" (UID: "587801e6-d458-400d-aebf-bdc09abb6018"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:42:38.365193 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:38.365172    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/587801e6-d458-400d-aebf-bdc09abb6018-maas-api-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:42:39.161506 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:39.161474    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"
Jul 23 18:42:39.161723 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:39.161515    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn" event={"ID":"587801e6-d458-400d-aebf-bdc09abb6018","Type":"ContainerDied","Data":"24f9bdff6b00f06defcac5d6d73a644b0169fedda394ffb2cd7efd7f6bba9a6d"}
Jul 23 18:42:39.161723 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:39.161566    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="24f9bdff6b00f06defcac5d6d73a644b0169fedda394ffb2cd7efd7f6bba9a6d"
Jul 23 18:42:48.310750 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:48.310675    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:48.401514 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:48.401484    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:51.296149 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.296115    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"]
Jul 23 18:42:51.296658 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.296384    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll" podUID="e2adad44-e9a6-414c-a20e-d3f2dc680173" containerName="maas-api" containerID="cri-o://42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347" gracePeriod=30
Jul 23 18:42:51.312936 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.312899    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:51.558084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.558021    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:42:51.695656 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.695622    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2adad44-e9a6-414c-a20e-d3f2dc680173-maas-api-tls\") pod \"e2adad44-e9a6-414c-a20e-d3f2dc680173\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") "
Jul 23 18:42:51.695839 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.695676    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f69pc\" (UniqueName: \"kubernetes.io/projected/e2adad44-e9a6-414c-a20e-d3f2dc680173-kube-api-access-f69pc\") pod \"e2adad44-e9a6-414c-a20e-d3f2dc680173\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") "
Jul 23 18:42:51.695839 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.695730    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2adad44-e9a6-414c-a20e-d3f2dc680173-openshift-service-ca\") pod \"e2adad44-e9a6-414c-a20e-d3f2dc680173\" (UID: \"e2adad44-e9a6-414c-a20e-d3f2dc680173\") "
Jul 23 18:42:51.696171 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.696147    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2adad44-e9a6-414c-a20e-d3f2dc680173-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e2adad44-e9a6-414c-a20e-d3f2dc680173" (UID: "e2adad44-e9a6-414c-a20e-d3f2dc680173"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:42:51.697760 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.697729    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2adad44-e9a6-414c-a20e-d3f2dc680173-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e2adad44-e9a6-414c-a20e-d3f2dc680173" (UID: "e2adad44-e9a6-414c-a20e-d3f2dc680173"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:42:51.697872 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.697783    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2adad44-e9a6-414c-a20e-d3f2dc680173-kube-api-access-f69pc" (OuterVolumeSpecName: "kube-api-access-f69pc") pod "e2adad44-e9a6-414c-a20e-d3f2dc680173" (UID: "e2adad44-e9a6-414c-a20e-d3f2dc680173"). InnerVolumeSpecName "kube-api-access-f69pc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:42:51.797185 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.797151    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e2adad44-e9a6-414c-a20e-d3f2dc680173-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:42:51.797185 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.797178    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e2adad44-e9a6-414c-a20e-d3f2dc680173-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:42:51.797185 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:51.797188    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f69pc\" (UniqueName: \"kubernetes.io/projected/e2adad44-e9a6-414c-a20e-d3f2dc680173-kube-api-access-f69pc\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:42:52.250884 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:52.250849    2574 generic.go:356] "Generic (PLEG): container finished" podID="e2adad44-e9a6-414c-a20e-d3f2dc680173" containerID="42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347" exitCode=0
Jul 23 18:42:52.251084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:52.250891    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"
Jul 23 18:42:52.251084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:52.250939    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll" event={"ID":"e2adad44-e9a6-414c-a20e-d3f2dc680173","Type":"ContainerDied","Data":"42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347"}
Jul 23 18:42:52.251084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:52.250985    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll" event={"ID":"e2adad44-e9a6-414c-a20e-d3f2dc680173","Type":"ContainerDied","Data":"e4d5e003d79e6a6da1667f29bc0f82d7ca595077817343800513dc95a252a23d"}
Jul 23 18:42:52.251084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:52.251006    2574 scope.go:117] "RemoveContainer" containerID="42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347"
Jul 23 18:42:52.260201 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:52.260184    2574 scope.go:117] "RemoveContainer" containerID="42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347"
Jul 23 18:42:52.260466 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:42:52.260449    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347\": container with ID starting with 42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347 not found: ID does not exist" containerID="42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347"
Jul 23 18:42:52.260525 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:52.260474    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347"} err="failed to get container status \"42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347\": rpc error: code = NotFound desc = could not find container \"42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347\": container with ID starting with 42c412b87e926aabaa8110497899180726846e9cbae1af0498d661e35a5e7347 not found: ID does not exist"
Jul 23 18:42:52.270803 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:52.270764    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"]
Jul 23 18:42:52.274957 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:52.274936    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-dc83b7-7df89d9ccd-r4lll"]
Jul 23 18:42:54.187348 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:54.187304    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2adad44-e9a6-414c-a20e-d3f2dc680173" path="/var/lib/kubelet/pods/e2adad44-e9a6-414c-a20e-d3f2dc680173/volumes"
Jul 23 18:42:55.874913 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:55.874880    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:55.895015 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:55.894980    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"]
Jul 23 18:42:55.897618 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:55.897587    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-dc83b7-j4jzn"]
Jul 23 18:42:56.186174 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:56.186078    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="587801e6-d458-400d-aebf-bdc09abb6018" path="/var/lib/kubelet/pods/587801e6-d458-400d-aebf-bdc09abb6018/volumes"
Jul 23 18:42:56.307000 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:56.306968    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:42:56.328869 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:42:56.328821    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:43:03.359811 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:03.359778    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:03.443349 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:03.443305    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:03.739473 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:03.739366    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:04.027644 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:04.027544    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:04.369998 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:04.369966    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:04.764334 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:04.764199    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:04.933138 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:04.933108    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:07.406492 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.406451    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:07.499549 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.499519    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"]
Jul 23 18:43:07.500169 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.500144    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="587801e6-d458-400d-aebf-bdc09abb6018" containerName="revoke-keys"
Jul 23 18:43:07.500169 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.500169    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="587801e6-d458-400d-aebf-bdc09abb6018" containerName="revoke-keys"
Jul 23 18:43:07.500360 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.500161    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:07.500360 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.500243    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2adad44-e9a6-414c-a20e-d3f2dc680173" containerName="maas-api"
Jul 23 18:43:07.500360 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.500253    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2adad44-e9a6-414c-a20e-d3f2dc680173" containerName="maas-api"
Jul 23 18:43:07.500469 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.500376    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2adad44-e9a6-414c-a20e-d3f2dc680173" containerName="maas-api"
Jul 23 18:43:07.500469 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.500396    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="587801e6-d458-400d-aebf-bdc09abb6018" containerName="revoke-keys"
Jul 23 18:43:07.503725 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.503707    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:07.506007 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.505980    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-d87a73-serving-cert\""
Jul 23 18:43:07.516584 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.516292    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"]
Jul 23 18:43:07.539928 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.539892    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csjk2\" (UniqueName: \"kubernetes.io/projected/c19ae25c-7420-480b-90df-2735f24aeec2-kube-api-access-csjk2\") pod \"maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:07.540102 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.540012    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c19ae25c-7420-480b-90df-2735f24aeec2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:07.540102 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.540057    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c19ae25c-7420-480b-90df-2735f24aeec2-maas-api-tls\") pod \"maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:07.582161 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.582127    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:07.641089 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.641049    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c19ae25c-7420-480b-90df-2735f24aeec2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:07.641291 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.641096    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c19ae25c-7420-480b-90df-2735f24aeec2-maas-api-tls\") pod \"maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:07.641291 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.641140    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csjk2\" (UniqueName: \"kubernetes.io/projected/c19ae25c-7420-480b-90df-2735f24aeec2-kube-api-access-csjk2\") pod \"maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:07.641373 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:43:07.641295    2574 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-serving-cert: secret "maas-api-e2e-shared-a-d87a73-serving-cert" not found
Jul 23 18:43:07.641409 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:43:07.641373    2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c19ae25c-7420-480b-90df-2735f24aeec2-maas-api-tls podName:c19ae25c-7420-480b-90df-2735f24aeec2 nodeName:}" failed. No retries permitted until 2026-07-23 18:43:08.14135307 +0000 UTC m=+2448.504196900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c19ae25c-7420-480b-90df-2735f24aeec2-maas-api-tls") pod "maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc" (UID: "c19ae25c-7420-480b-90df-2735f24aeec2") : secret "maas-api-e2e-shared-a-d87a73-serving-cert" not found
Jul 23 18:43:07.641771 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.641749    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c19ae25c-7420-480b-90df-2735f24aeec2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:07.655830 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.655793    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csjk2\" (UniqueName: \"kubernetes.io/projected/c19ae25c-7420-480b-90df-2735f24aeec2-kube-api-access-csjk2\") pod \"maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:07.813705 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:07.813610    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:08.101969 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:08.101934    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:08.146555 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:08.146505    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c19ae25c-7420-480b-90df-2735f24aeec2-maas-api-tls\") pod \"maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:08.148942 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:08.148915    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c19ae25c-7420-480b-90df-2735f24aeec2-maas-api-tls\") pod \"maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:08.204690 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:08.204652    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:08.417425 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:08.417328    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:08.573300 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:08.573272    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"]
Jul 23 18:43:08.574760 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:43:08.574732    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19ae25c_7420_480b_90df_2735f24aeec2.slice/crio-8d700a1bed262089e8b0587038ae75dbc9129f1700d38e03fada821f9a52f6d7 WatchSource:0}: Error finding container 8d700a1bed262089e8b0587038ae75dbc9129f1700d38e03fada821f9a52f6d7: Status 404 returned error can't find the container with id 8d700a1bed262089e8b0587038ae75dbc9129f1700d38e03fada821f9a52f6d7
Jul 23 18:43:09.361046 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:09.361010    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc" event={"ID":"c19ae25c-7420-480b-90df-2735f24aeec2","Type":"ContainerStarted","Data":"30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2"}
Jul 23 18:43:09.361269 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:09.361067    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc" event={"ID":"c19ae25c-7420-480b-90df-2735f24aeec2","Type":"ContainerStarted","Data":"8d700a1bed262089e8b0587038ae75dbc9129f1700d38e03fada821f9a52f6d7"}
Jul 23 18:43:09.361269 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:09.361135    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:09.384325 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:09.384179    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc" podStartSLOduration=1.7355842830000001 podStartE2EDuration="2.384160109s" totalImagesPullingTime="648.575826ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:09.38100867 +0000 UTC m=+2449.743852519" watchObservedRunningTime="2026-07-23 18:43:09.384160109 +0000 UTC m=+2449.747003958"
Jul 23 18:43:11.861341 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:11.861305    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:12.217090 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:12.217003    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:12.593031 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:12.592969    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:13.151037 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:13.151005    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:15.373126 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.373086    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:43:15.373770 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.373739    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:15.465418 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.465382    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:15.466069 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.466044    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"]
Jul 23 18:43:15.469926 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.469905    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.473940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.473914    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-118a8c-serving-cert\""
Jul 23 18:43:15.481843 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.481816    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"]
Jul 23 18:43:15.515646 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.515611    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k56nf\" (UniqueName: \"kubernetes.io/projected/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-kube-api-access-k56nf\") pod \"maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.515815 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.515655    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-maas-api-tls\") pod \"maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.515815 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.515782    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-openshift-service-ca\") pod \"maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.535891 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.535854    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:15.611069 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.611035    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:43:15.616845 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.616822    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-openshift-service-ca\") pod \"maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.616910 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.616886    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k56nf\" (UniqueName: \"kubernetes.io/projected/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-kube-api-access-k56nf\") pod \"maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.616962 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.616908    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-maas-api-tls\") pod \"maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.617525 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.617500    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-openshift-service-ca\") pod \"maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.619076 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.619038    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:15.619440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.619422    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-maas-api-tls\") pod \"maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.628676 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.628614    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k56nf\" (UniqueName: \"kubernetes.io/projected/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-kube-api-access-k56nf\") pod \"maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.781798 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.781761    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:15.933161 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:15.933135    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"]
Jul 23 18:43:15.934412 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:43:15.934384    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b4e6a2_2f3e_4e16_ba76_5cf4275f2c67.slice/crio-6e7fac096444d24a4b997feea3297f3f24ebb1e113549e50856b28a52b2acf84 WatchSource:0}: Error finding container 6e7fac096444d24a4b997feea3297f3f24ebb1e113549e50856b28a52b2acf84: Status 404 returned error can't find the container with id 6e7fac096444d24a4b997feea3297f3f24ebb1e113549e50856b28a52b2acf84
Jul 23 18:43:16.215202 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:16.215104    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:16.316464 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:16.316432    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:16.404753 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:16.404722    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx" event={"ID":"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67","Type":"ContainerStarted","Data":"838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5"}
Jul 23 18:43:16.405123 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:16.404780    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx" event={"ID":"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67","Type":"ContainerStarted","Data":"6e7fac096444d24a4b997feea3297f3f24ebb1e113549e50856b28a52b2acf84"}
Jul 23 18:43:16.405123 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:16.404919    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:16.443082 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:16.443029    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx" podStartSLOduration=1.052185228 podStartE2EDuration="1.44301335s" totalImagesPullingTime="390.828122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:16.439157652 +0000 UTC m=+2456.802001522" watchObservedRunningTime="2026-07-23 18:43:16.44301335 +0000 UTC m=+2456.805857198"
Jul 23 18:43:19.889629 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:19.889589    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:22.416116 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:22.416086    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:43:27.118419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:27.118382    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:43:29.177490 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:29.177455    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:29.281364 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:29.281329    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:37.112632 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:37.112593    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:37.214080 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:37.214046    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:45.409422 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:45.409385    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:43:48.799453 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:43:48.799412    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:44:05.205061 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:44:05.205022    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:44:18.359780 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:44:18.359672    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:44:22.105466 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:44:22.105425    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:44:42.821575 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:44:42.821534    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:44:57.404005 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:44:57.403960    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:45:00.150369 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.150331    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5"]
Jul 23 18:45:00.154184 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.154163    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5"
Jul 23 18:45:00.154729 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.154707    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x"]
Jul 23 18:45:00.156854 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.156832    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:45:00.157974 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.157959    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh"]
Jul 23 18:45:00.158077 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.158061    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x"
Jul 23 18:45:00.161423 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.161242    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh"
Jul 23 18:45:00.165084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.165069    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5"
Jul 23 18:45:00.170997 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.170916    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5"]
Jul 23 18:45:00.180616 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.175444    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x"
Jul 23 18:45:00.180616 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.176511    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh"]
Jul 23 18:45:00.180616 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.178661    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x"]
Jul 23 18:45:00.215799 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.215766    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh"
Jul 23 18:45:00.350379 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.350349    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5"]
Jul 23 18:45:00.353022 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:45:00.352968    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod927b2e35_ce22_4f60_817a_8c69cb2aece5.slice/crio-96e08a9c1d8197ac56b1318cf9a25ff5240bf2d7deacfe7bef3486f4d364e416 WatchSource:0}: Error finding container 96e08a9c1d8197ac56b1318cf9a25ff5240bf2d7deacfe7bef3486f4d364e416: Status 404 returned error can't find the container with id 96e08a9c1d8197ac56b1318cf9a25ff5240bf2d7deacfe7bef3486f4d364e416
Jul 23 18:45:00.386253 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:45:00.386201    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79147778_0194_4b59_924a_342a98f04573.slice/crio-eb69ff8b687c53a4646c550bcc0fa3b850e3477259deeb7828fe6233a4e5b525 WatchSource:0}: Error finding container eb69ff8b687c53a4646c550bcc0fa3b850e3477259deeb7828fe6233a4e5b525: Status 404 returned error can't find the container with id eb69ff8b687c53a4646c550bcc0fa3b850e3477259deeb7828fe6233a4e5b525
Jul 23 18:45:00.388101 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.388075    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x"]
Jul 23 18:45:00.415389 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:00.415365    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh"]
Jul 23 18:45:00.430432 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:45:00.430400    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6b8d8d_c967_4fd8_b8fc_618d616a88f4.slice/crio-c2d6d987ec8fa08648035515f17b7c483c5a6e77939b2baeb26bc80db3d4195f WatchSource:0}: Error finding container c2d6d987ec8fa08648035515f17b7c483c5a6e77939b2baeb26bc80db3d4195f: Status 404 returned error can't find the container with id c2d6d987ec8fa08648035515f17b7c483c5a6e77939b2baeb26bc80db3d4195f
Jul 23 18:45:01.062808 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:01.062705    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5" event={"ID":"927b2e35-ce22-4f60-817a-8c69cb2aece5","Type":"ContainerStarted","Data":"20307a3d39a3be4acd3b12c15bcc2a0501bd511ef0195603222884fe1e826daa"}
Jul 23 18:45:01.062808 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:01.062773    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5" event={"ID":"927b2e35-ce22-4f60-817a-8c69cb2aece5","Type":"ContainerStarted","Data":"96e08a9c1d8197ac56b1318cf9a25ff5240bf2d7deacfe7bef3486f4d364e416"}
Jul 23 18:45:01.064351 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:01.064323    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh" event={"ID":"8b6b8d8d-c967-4fd8-b8fc-618d616a88f4","Type":"ContainerStarted","Data":"a15b901686a8e288fcc7be59e6c72f24e43c84e3fa285277e2408515597ecb31"}
Jul 23 18:45:01.064482 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:01.064375    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh" event={"ID":"8b6b8d8d-c967-4fd8-b8fc-618d616a88f4","Type":"ContainerStarted","Data":"c2d6d987ec8fa08648035515f17b7c483c5a6e77939b2baeb26bc80db3d4195f"}
Jul 23 18:45:01.065799 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:01.065778    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x" event={"ID":"79147778-0194-4b59-924a-342a98f04573","Type":"ContainerStarted","Data":"ef03b9a0af30e9299a0472b42ff06d2016ac58edb527d2e9fe1086d935f154a2"}
Jul 23 18:45:01.065908 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:01.065813    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x" event={"ID":"79147778-0194-4b59-924a-342a98f04573","Type":"ContainerStarted","Data":"eb69ff8b687c53a4646c550bcc0fa3b850e3477259deeb7828fe6233a4e5b525"}
Jul 23 18:45:01.095692 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:01.095646    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5" podStartSLOduration=1.095631275 podStartE2EDuration="1.095631275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:01.094822046 +0000 UTC m=+2561.457665896" watchObservedRunningTime="2026-07-23 18:45:01.095631275 +0000 UTC m=+2561.458475124"
Jul 23 18:45:01.114724 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:01.114683    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x" podStartSLOduration=1.114668551 podStartE2EDuration="1.114668551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:01.114526624 +0000 UTC m=+2561.477370491" watchObservedRunningTime="2026-07-23 18:45:01.114668551 +0000 UTC m=+2561.477512400"
Jul 23 18:45:01.141477 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:01.141416    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh" podStartSLOduration=1.141400388 podStartE2EDuration="1.141400388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:45:01.139058714 +0000 UTC m=+2561.501902563" watchObservedRunningTime="2026-07-23 18:45:01.141400388 +0000 UTC m=+2561.504244237"
Jul 23 18:45:02.011939 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:02.011905    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:45:02.072705 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:02.072671    2574 generic.go:356] "Generic (PLEG): container finished" podID="79147778-0194-4b59-924a-342a98f04573" containerID="ef03b9a0af30e9299a0472b42ff06d2016ac58edb527d2e9fe1086d935f154a2" exitCode=0
Jul 23 18:45:02.072905 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:02.072764    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x" event={"ID":"79147778-0194-4b59-924a-342a98f04573","Type":"ContainerDied","Data":"ef03b9a0af30e9299a0472b42ff06d2016ac58edb527d2e9fe1086d935f154a2"}
Jul 23 18:45:02.074829 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:02.074554    2574 generic.go:356] "Generic (PLEG): container finished" podID="927b2e35-ce22-4f60-817a-8c69cb2aece5" containerID="20307a3d39a3be4acd3b12c15bcc2a0501bd511ef0195603222884fe1e826daa" exitCode=0
Jul 23 18:45:02.074829 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:02.074675    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5" event={"ID":"927b2e35-ce22-4f60-817a-8c69cb2aece5","Type":"ContainerDied","Data":"20307a3d39a3be4acd3b12c15bcc2a0501bd511ef0195603222884fe1e826daa"}
Jul 23 18:45:02.077003 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:02.076979    2574 generic.go:356] "Generic (PLEG): container finished" podID="8b6b8d8d-c967-4fd8-b8fc-618d616a88f4" containerID="a15b901686a8e288fcc7be59e6c72f24e43c84e3fa285277e2408515597ecb31" exitCode=0
Jul 23 18:45:02.077382 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:02.077106    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh" event={"ID":"8b6b8d8d-c967-4fd8-b8fc-618d616a88f4","Type":"ContainerDied","Data":"a15b901686a8e288fcc7be59e6c72f24e43c84e3fa285277e2408515597ecb31"}
Jul 23 18:45:03.240129 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:03.240100    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x"
Jul 23 18:45:03.278148 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:03.278119    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5"
Jul 23 18:45:03.281665 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:03.281624    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh"
Jul 23 18:45:04.091642 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:04.091615    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5"
Jul 23 18:45:04.091829 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:04.091653    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5" event={"ID":"927b2e35-ce22-4f60-817a-8c69cb2aece5","Type":"ContainerDied","Data":"96e08a9c1d8197ac56b1318cf9a25ff5240bf2d7deacfe7bef3486f4d364e416"}
Jul 23 18:45:04.091829 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:04.091707    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="96e08a9c1d8197ac56b1318cf9a25ff5240bf2d7deacfe7bef3486f4d364e416"
Jul 23 18:45:04.092945 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:04.092919    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh"
Jul 23 18:45:04.093084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:04.092940    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747205-6fnhh" event={"ID":"8b6b8d8d-c967-4fd8-b8fc-618d616a88f4","Type":"ContainerDied","Data":"c2d6d987ec8fa08648035515f17b7c483c5a6e77939b2baeb26bc80db3d4195f"}
Jul 23 18:45:04.093084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:04.092981    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2d6d987ec8fa08648035515f17b7c483c5a6e77939b2baeb26bc80db3d4195f"
Jul 23 18:45:04.094287 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:04.094272    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x"
Jul 23 18:45:04.094403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:04.094273    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x" event={"ID":"79147778-0194-4b59-924a-342a98f04573","Type":"ContainerDied","Data":"eb69ff8b687c53a4646c550bcc0fa3b850e3477259deeb7828fe6233a4e5b525"}
Jul 23 18:45:04.094403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:04.094393    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb69ff8b687c53a4646c550bcc0fa3b850e3477259deeb7828fe6233a4e5b525"
Jul 23 18:45:21.022318 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:21.022278    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:45:37.174383 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:37.174346    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:45:42.491515 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:42.491423    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:45:43.833436 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:43.833397    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:45:56.940820 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:45:56.940777    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:46:14.725503 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:46:14.725465    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:46:16.861566 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:46:16.861531    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:46:32.495366 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:46:32.495327    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:46:33.385167 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:46:33.385126    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:46:35.218903 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:46:35.218869    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:46:42.842571 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:46:42.842532    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:46:48.869356 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:46:48.869323    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:47:20.358016 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:47:20.357942    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:47:20.385645 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:47:20.385621    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:47:20.574024 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:47:20.573994    2574 scope.go:117] "RemoveContainer" containerID="c284079d658f53b12798f3eefc92b90d6c1c5f8491f4e474e1311ad33e1336ad"
Jul 23 18:47:20.583148 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:47:20.583127    2574 scope.go:117] "RemoveContainer" containerID="86cd729a98f6311d24110879ed5eee3e32fab4fa520d007d48f4589ccd979407"
Jul 23 18:47:22.040933 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:47:22.040894    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:47:26.001946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:47:26.001916    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:47:43.927710 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:47:43.927664    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:47:49.399797 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:47:49.399762    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:47:49.503411 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:47:49.503369    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:48:01.017994 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:01.017958    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:48:08.703779 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:08.703741    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:48:09.708499 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:09.708462    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:48:20.609595 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:20.609563    2574 scope.go:117] "RemoveContainer" containerID="334f454709623f39d90ccbd197bae32476f5ffec38c35893ff89a4b4cc30ee88"
Jul 23 18:48:21.807190 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:21.807156    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:48:25.099131 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:25.099088    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:48:25.562115 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:25.562027    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:48:29.916134 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:29.916104    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:48:30.059724 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:30.059686    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:48:30.159302 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:30.159265    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:48:38.027062 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:38.027020    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:48:38.128197 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:38.128159    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:48:52.356644 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:52.356605    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:48:56.208478 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:48:56.208446    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:49:07.582045 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:07.582014    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:49:07.636506 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:07.636470    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:49:10.735904 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:10.735873    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:49:10.804116 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:10.804082    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:49:15.845730 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:15.845698    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:49:20.631488 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:20.631458    2574 scope.go:117] "RemoveContainer" containerID="fd134c3d78d6514e0bfe1e53cd63b55ce8bf968515fbfb34cb578b8df73062e0"
Jul 23 18:49:34.915499 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:34.915463    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:49:39.760059 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:39.760017    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:49:40.643014 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:40.642977    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:49:41.676234 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.676201    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7626-140624565665584"]
Jul 23 18:49:41.676692 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.676677    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="927b2e35-ce22-4f60-817a-8c69cb2aece5" containerName="cleanup"
Jul 23 18:49:41.676692 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.676694    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="927b2e35-ce22-4f60-817a-8c69cb2aece5" containerName="cleanup"
Jul 23 18:49:41.676768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.676702    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79147778-0194-4b59-924a-342a98f04573" containerName="cleanup"
Jul 23 18:49:41.676768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.676709    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="79147778-0194-4b59-924a-342a98f04573" containerName="cleanup"
Jul 23 18:49:41.676768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.676730    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6b8d8d-c967-4fd8-b8fc-618d616a88f4" containerName="cleanup"
Jul 23 18:49:41.676768 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.676735    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6b8d8d-c967-4fd8-b8fc-618d616a88f4" containerName="cleanup"
Jul 23 18:49:41.676893 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.676802    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6b8d8d-c967-4fd8-b8fc-618d616a88f4" containerName="cleanup"
Jul 23 18:49:41.676893 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.676811    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="79147778-0194-4b59-924a-342a98f04573" containerName="cleanup"
Jul 23 18:49:41.676893 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.676820    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="927b2e35-ce22-4f60-817a-8c69cb2aece5" containerName="cleanup"
Jul 23 18:49:41.679999 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.679983    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624565665584"
Jul 23 18:49:41.683240 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.683203    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d654b\""
Jul 23 18:49:41.691557 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.691529    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624565665584"]
Jul 23 18:49:41.798468 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.798438    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xwkw\" (UniqueName: \"kubernetes.io/projected/771616b9-fe87-42a9-9395-5a55e8fa238f-kube-api-access-4xwkw\") pod \"test-curl-7626-140624565665584\" (UID: \"771616b9-fe87-42a9-9395-5a55e8fa238f\") " pod="opendatahub/test-curl-7626-140624565665584"
Jul 23 18:49:41.899045 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.899015    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xwkw\" (UniqueName: \"kubernetes.io/projected/771616b9-fe87-42a9-9395-5a55e8fa238f-kube-api-access-4xwkw\") pod \"test-curl-7626-140624565665584\" (UID: \"771616b9-fe87-42a9-9395-5a55e8fa238f\") " pod="opendatahub/test-curl-7626-140624565665584"
Jul 23 18:49:41.918012 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.917981    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xwkw\" (UniqueName: \"kubernetes.io/projected/771616b9-fe87-42a9-9395-5a55e8fa238f-kube-api-access-4xwkw\") pod \"test-curl-7626-140624565665584\" (UID: \"771616b9-fe87-42a9-9395-5a55e8fa238f\") " pod="opendatahub/test-curl-7626-140624565665584"
Jul 23 18:49:41.989421 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:41.989338    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624565665584"
Jul 23 18:49:42.127504 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:42.127478    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624565665584"]
Jul 23 18:49:42.128855 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:49:42.128823    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod771616b9_fe87_42a9_9395_5a55e8fa238f.slice/crio-8efb27595da6e909f27b32c60cebd024be4326d201a40ec0b9a22217f8593092 WatchSource:0}: Error finding container 8efb27595da6e909f27b32c60cebd024be4326d201a40ec0b9a22217f8593092: Status 404 returned error can't find the container with id 8efb27595da6e909f27b32c60cebd024be4326d201a40ec0b9a22217f8593092
Jul 23 18:49:42.130255 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:42.130239    2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 18:49:42.841258 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:42.841202    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624565665584" event={"ID":"771616b9-fe87-42a9-9395-5a55e8fa238f","Type":"ContainerStarted","Data":"8efb27595da6e909f27b32c60cebd024be4326d201a40ec0b9a22217f8593092"}
Jul 23 18:49:43.848411 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:43.848375    2574 generic.go:356] "Generic (PLEG): container finished" podID="771616b9-fe87-42a9-9395-5a55e8fa238f" containerID="7beb17e1ff81e58e7d89445b9f8667c743e588539eb96968a844b3a74d553902" exitCode=0
Jul 23 18:49:43.848795 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:43.848467    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624565665584" event={"ID":"771616b9-fe87-42a9-9395-5a55e8fa238f","Type":"ContainerDied","Data":"7beb17e1ff81e58e7d89445b9f8667c743e588539eb96968a844b3a74d553902"}
Jul 23 18:49:44.988419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:44.988388    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624565665584"
Jul 23 18:49:45.017960 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.017936    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7626-140624565665584_771616b9-fe87-42a9-9395-5a55e8fa238f/test-curl-7626-140624565665584/0.log"
Jul 23 18:49:45.049855 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.049824    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7626-140624565665584"]
Jul 23 18:49:45.057079 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.057051    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7626-140624565665584"]
Jul 23 18:49:45.132883 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.132819    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xwkw\" (UniqueName: \"kubernetes.io/projected/771616b9-fe87-42a9-9395-5a55e8fa238f-kube-api-access-4xwkw\") pod \"771616b9-fe87-42a9-9395-5a55e8fa238f\" (UID: \"771616b9-fe87-42a9-9395-5a55e8fa238f\") "
Jul 23 18:49:45.134824 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.134798    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/771616b9-fe87-42a9-9395-5a55e8fa238f-kube-api-access-4xwkw" (OuterVolumeSpecName: "kube-api-access-4xwkw") pod "771616b9-fe87-42a9-9395-5a55e8fa238f" (UID: "771616b9-fe87-42a9-9395-5a55e8fa238f"). InnerVolumeSpecName "kube-api-access-4xwkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:49:45.191937 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.191911    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7626-140624564790064"]
Jul 23 18:49:45.192338 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.192324    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="771616b9-fe87-42a9-9395-5a55e8fa238f" containerName="test-curl-7626-140624565665584"
Jul 23 18:49:45.192391 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.192340    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="771616b9-fe87-42a9-9395-5a55e8fa238f" containerName="test-curl-7626-140624565665584"
Jul 23 18:49:45.192427 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.192422    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="771616b9-fe87-42a9-9395-5a55e8fa238f" containerName="test-curl-7626-140624565665584"
Jul 23 18:49:45.195448 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.195432    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564790064"
Jul 23 18:49:45.207282 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.207211    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624564790064"]
Jul 23 18:49:45.233957 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.233931    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xwkw\" (UniqueName: \"kubernetes.io/projected/771616b9-fe87-42a9-9395-5a55e8fa238f-kube-api-access-4xwkw\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:49:45.334747 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.334720    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5rpd\" (UniqueName: \"kubernetes.io/projected/fd8e7af6-77b0-4e39-a1f3-6d79eb720460-kube-api-access-w5rpd\") pod \"test-curl-7626-140624564790064\" (UID: \"fd8e7af6-77b0-4e39-a1f3-6d79eb720460\") " pod="opendatahub/test-curl-7626-140624564790064"
Jul 23 18:49:45.436199 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.436101    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5rpd\" (UniqueName: \"kubernetes.io/projected/fd8e7af6-77b0-4e39-a1f3-6d79eb720460-kube-api-access-w5rpd\") pod \"test-curl-7626-140624564790064\" (UID: \"fd8e7af6-77b0-4e39-a1f3-6d79eb720460\") " pod="opendatahub/test-curl-7626-140624564790064"
Jul 23 18:49:45.447521 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.447493    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5rpd\" (UniqueName: \"kubernetes.io/projected/fd8e7af6-77b0-4e39-a1f3-6d79eb720460-kube-api-access-w5rpd\") pod \"test-curl-7626-140624564790064\" (UID: \"fd8e7af6-77b0-4e39-a1f3-6d79eb720460\") " pod="opendatahub/test-curl-7626-140624564790064"
Jul 23 18:49:45.504054 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.504024    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564790064"
Jul 23 18:49:45.848289 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.848262    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624564790064"]
Jul 23 18:49:45.849352 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:49:45.849327    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd8e7af6_77b0_4e39_a1f3_6d79eb720460.slice/crio-2290112066eb0cdebbec4d1d4c1ca52836ebc1b176554b9fd273336ea668d4a7 WatchSource:0}: Error finding container 2290112066eb0cdebbec4d1d4c1ca52836ebc1b176554b9fd273336ea668d4a7: Status 404 returned error can't find the container with id 2290112066eb0cdebbec4d1d4c1ca52836ebc1b176554b9fd273336ea668d4a7
Jul 23 18:49:45.862361 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.862343    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624565665584"
Jul 23 18:49:45.862455 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.862370    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8efb27595da6e909f27b32c60cebd024be4326d201a40ec0b9a22217f8593092"
Jul 23 18:49:45.864130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:45.863969    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624564790064" event={"ID":"fd8e7af6-77b0-4e39-a1f3-6d79eb720460","Type":"ContainerStarted","Data":"2290112066eb0cdebbec4d1d4c1ca52836ebc1b176554b9fd273336ea668d4a7"}
Jul 23 18:49:45.877314 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:49:45.877289    2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7626-140624565665584\" is forbidden: User \"system:node:ip-10-0-143-41.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-41.ec2.internal' and this object" podUID="771616b9-fe87-42a9-9395-5a55e8fa238f" pod="opendatahub/test-curl-7626-140624565665584"
Jul 23 18:49:46.185743 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:46.185711    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="771616b9-fe87-42a9-9395-5a55e8fa238f" path="/var/lib/kubelet/pods/771616b9-fe87-42a9-9395-5a55e8fa238f/volumes"
Jul 23 18:49:46.871376 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:46.871344    2574 generic.go:356] "Generic (PLEG): container finished" podID="fd8e7af6-77b0-4e39-a1f3-6d79eb720460" containerID="1f301ecee6112094ae129e2ffc7896acb65146c506cccd5cfae8ed352e192ebe" exitCode=0
Jul 23 18:49:46.871665 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:46.871435    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624564790064" event={"ID":"fd8e7af6-77b0-4e39-a1f3-6d79eb720460","Type":"ContainerDied","Data":"1f301ecee6112094ae129e2ffc7896acb65146c506cccd5cfae8ed352e192ebe"}
Jul 23 18:49:48.022078 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.022048    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564790064"
Jul 23 18:49:48.048668 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.048627    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7626-140624564790064_fd8e7af6-77b0-4e39-a1f3-6d79eb720460/test-curl-7626-140624564790064/0.log"
Jul 23 18:49:48.085249 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.085205    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7626-140624564790064"]
Jul 23 18:49:48.089699 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.089672    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7626-140624564790064"]
Jul 23 18:49:48.162133 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.162051    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5rpd\" (UniqueName: \"kubernetes.io/projected/fd8e7af6-77b0-4e39-a1f3-6d79eb720460-kube-api-access-w5rpd\") pod \"fd8e7af6-77b0-4e39-a1f3-6d79eb720460\" (UID: \"fd8e7af6-77b0-4e39-a1f3-6d79eb720460\") "
Jul 23 18:49:48.163973 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.163946    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd8e7af6-77b0-4e39-a1f3-6d79eb720460-kube-api-access-w5rpd" (OuterVolumeSpecName: "kube-api-access-w5rpd") pod "fd8e7af6-77b0-4e39-a1f3-6d79eb720460" (UID: "fd8e7af6-77b0-4e39-a1f3-6d79eb720460"). InnerVolumeSpecName "kube-api-access-w5rpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:49:48.186205 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.186177    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd8e7af6-77b0-4e39-a1f3-6d79eb720460" path="/var/lib/kubelet/pods/fd8e7af6-77b0-4e39-a1f3-6d79eb720460/volumes"
Jul 23 18:49:48.263488 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.263453    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5rpd\" (UniqueName: \"kubernetes.io/projected/fd8e7af6-77b0-4e39-a1f3-6d79eb720460-kube-api-access-w5rpd\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:49:48.284182 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.284152    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7626-140624564861376"]
Jul 23 18:49:48.284607 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.284594    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd8e7af6-77b0-4e39-a1f3-6d79eb720460" containerName="test-curl-7626-140624564790064"
Jul 23 18:49:48.284661 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.284609    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd8e7af6-77b0-4e39-a1f3-6d79eb720460" containerName="test-curl-7626-140624564790064"
Jul 23 18:49:48.284705 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.284695    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd8e7af6-77b0-4e39-a1f3-6d79eb720460" containerName="test-curl-7626-140624564790064"
Jul 23 18:49:48.287719 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.287703    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:48.296802 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.296781    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624564861376"]
Jul 23 18:49:48.364476 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.364445    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gb65q\" (UniqueName: \"kubernetes.io/projected/d0da77b3-1cda-4417-a291-22170cadb3d2-kube-api-access-gb65q\") pod \"test-curl-7626-140624564861376\" (UID: \"d0da77b3-1cda-4417-a291-22170cadb3d2\") " pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:48.465096 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.465011    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gb65q\" (UniqueName: \"kubernetes.io/projected/d0da77b3-1cda-4417-a291-22170cadb3d2-kube-api-access-gb65q\") pod \"test-curl-7626-140624564861376\" (UID: \"d0da77b3-1cda-4417-a291-22170cadb3d2\") " pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:48.477016 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.476988    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gb65q\" (UniqueName: \"kubernetes.io/projected/d0da77b3-1cda-4417-a291-22170cadb3d2-kube-api-access-gb65q\") pod \"test-curl-7626-140624564861376\" (UID: \"d0da77b3-1cda-4417-a291-22170cadb3d2\") " pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:48.598055 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.598024    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:48.741212 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:49:48.741183    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0da77b3_1cda_4417_a291_22170cadb3d2.slice/crio-022939b1716c9131f42d68be6172fbf1cc45402de497e7dc2b530c1c7996e7a6 WatchSource:0}: Error finding container 022939b1716c9131f42d68be6172fbf1cc45402de497e7dc2b530c1c7996e7a6: Status 404 returned error can't find the container with id 022939b1716c9131f42d68be6172fbf1cc45402de497e7dc2b530c1c7996e7a6
Jul 23 18:49:48.742131 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.742108    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624564861376"]
Jul 23 18:49:48.887477 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.887448    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564790064"
Jul 23 18:49:48.887657 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.887491    2574 scope.go:117] "RemoveContainer" containerID="1f301ecee6112094ae129e2ffc7896acb65146c506cccd5cfae8ed352e192ebe"
Jul 23 18:49:48.888836 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:48.888648    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624564861376" event={"ID":"d0da77b3-1cda-4417-a291-22170cadb3d2","Type":"ContainerStarted","Data":"022939b1716c9131f42d68be6172fbf1cc45402de497e7dc2b530c1c7996e7a6"}
Jul 23 18:49:49.896832 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:49.896797    2574 generic.go:356] "Generic (PLEG): container finished" podID="d0da77b3-1cda-4417-a291-22170cadb3d2" containerID="8f15f388730955b8d411cab2ed652fd8a45f59fbe05b34ebb246de01a3341b47" exitCode=0
Jul 23 18:49:49.897212 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:49.896867    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624564861376" event={"ID":"d0da77b3-1cda-4417-a291-22170cadb3d2","Type":"ContainerDied","Data":"8f15f388730955b8d411cab2ed652fd8a45f59fbe05b34ebb246de01a3341b47"}
Jul 23 18:49:51.043764 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.043738    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:51.072108 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.072084    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7626-140624564861376_d0da77b3-1cda-4417-a291-22170cadb3d2/test-curl-7626-140624564861376/0.log"
Jul 23 18:49:51.102621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.102598    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7626-140624564861376"]
Jul 23 18:49:51.107558 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.107536    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7626-140624564861376"]
Jul 23 18:49:51.193002 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.192935    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gb65q\" (UniqueName: \"kubernetes.io/projected/d0da77b3-1cda-4417-a291-22170cadb3d2-kube-api-access-gb65q\") pod \"d0da77b3-1cda-4417-a291-22170cadb3d2\" (UID: \"d0da77b3-1cda-4417-a291-22170cadb3d2\") "
Jul 23 18:49:51.194917 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.194892    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0da77b3-1cda-4417-a291-22170cadb3d2-kube-api-access-gb65q" (OuterVolumeSpecName: "kube-api-access-gb65q") pod "d0da77b3-1cda-4417-a291-22170cadb3d2" (UID: "d0da77b3-1cda-4417-a291-22170cadb3d2"). InnerVolumeSpecName "kube-api-access-gb65q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:49:51.238678 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.238645    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:49:51.245102 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.245073    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7626-140624564861376"]
Jul 23 18:49:51.245534 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.245519    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0da77b3-1cda-4417-a291-22170cadb3d2" containerName="test-curl-7626-140624564861376"
Jul 23 18:49:51.245534 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.245533    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0da77b3-1cda-4417-a291-22170cadb3d2" containerName="test-curl-7626-140624564861376"
Jul 23 18:49:51.245673 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.245593    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0da77b3-1cda-4417-a291-22170cadb3d2" containerName="test-curl-7626-140624564861376"
Jul 23 18:49:51.248784 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.248765    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:51.255240 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.255209    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624564861376"]
Jul 23 18:49:51.293846 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.293816    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gb65q\" (UniqueName: \"kubernetes.io/projected/d0da77b3-1cda-4417-a291-22170cadb3d2-kube-api-access-gb65q\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:49:51.395144 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.395117    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2dzw\" (UniqueName: \"kubernetes.io/projected/7b3fa391-a294-4c2f-ac01-7481462dd3bd-kube-api-access-s2dzw\") pod \"test-curl-7626-140624564861376\" (UID: \"7b3fa391-a294-4c2f-ac01-7481462dd3bd\") " pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:51.496782 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.496692    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2dzw\" (UniqueName: \"kubernetes.io/projected/7b3fa391-a294-4c2f-ac01-7481462dd3bd-kube-api-access-s2dzw\") pod \"test-curl-7626-140624564861376\" (UID: \"7b3fa391-a294-4c2f-ac01-7481462dd3bd\") " pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:51.511962 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.511932    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2dzw\" (UniqueName: \"kubernetes.io/projected/7b3fa391-a294-4c2f-ac01-7481462dd3bd-kube-api-access-s2dzw\") pod \"test-curl-7626-140624564861376\" (UID: \"7b3fa391-a294-4c2f-ac01-7481462dd3bd\") " pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:51.558621 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.558593    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:51.698744 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.698720    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624564861376"]
Jul 23 18:49:51.700789 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:49:51.700762    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b3fa391_a294_4c2f_ac01_7481462dd3bd.slice/crio-0b994946c093b79cd94b40bf32ef285ff346e7e9e9d2b456db3ee9c2a10b41ac WatchSource:0}: Error finding container 0b994946c093b79cd94b40bf32ef285ff346e7e9e9d2b456db3ee9c2a10b41ac: Status 404 returned error can't find the container with id 0b994946c093b79cd94b40bf32ef285ff346e7e9e9d2b456db3ee9c2a10b41ac
Jul 23 18:49:51.909646 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.909608    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624564861376" event={"ID":"7b3fa391-a294-4c2f-ac01-7481462dd3bd","Type":"ContainerStarted","Data":"0b994946c093b79cd94b40bf32ef285ff346e7e9e9d2b456db3ee9c2a10b41ac"}
Jul 23 18:49:51.910901 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.910878    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:51.911048 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.910883    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="022939b1716c9131f42d68be6172fbf1cc45402de497e7dc2b530c1c7996e7a6"
Jul 23 18:49:51.923620 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:51.923590    2574 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7626-140624564861376" oldPodUID="d0da77b3-1cda-4417-a291-22170cadb3d2" podUID="7b3fa391-a294-4c2f-ac01-7481462dd3bd"
Jul 23 18:49:52.187204 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:52.187133    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0da77b3-1cda-4417-a291-22170cadb3d2" path="/var/lib/kubelet/pods/d0da77b3-1cda-4417-a291-22170cadb3d2/volumes"
Jul 23 18:49:52.917770 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:52.917736    2574 generic.go:356] "Generic (PLEG): container finished" podID="7b3fa391-a294-4c2f-ac01-7481462dd3bd" containerID="78cc3f863eaa10a014e8670805ae5bcb5023578330979b5983a7717889df012b" exitCode=0
Jul 23 18:49:52.917948 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:52.917824    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624564861376" event={"ID":"7b3fa391-a294-4c2f-ac01-7481462dd3bd","Type":"ContainerDied","Data":"78cc3f863eaa10a014e8670805ae5bcb5023578330979b5983a7717889df012b"}
Jul 23 18:49:54.054913 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.054887    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:54.087663 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.087637    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7626-140624564861376_7b3fa391-a294-4c2f-ac01-7481462dd3bd/test-curl-7626-140624564861376/0.log"
Jul 23 18:49:54.128092 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.128064    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7626-140624564861376"]
Jul 23 18:49:54.134374 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.134352    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7626-140624564861376"]
Jul 23 18:49:54.223879 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.223820    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2dzw\" (UniqueName: \"kubernetes.io/projected/7b3fa391-a294-4c2f-ac01-7481462dd3bd-kube-api-access-s2dzw\") pod \"7b3fa391-a294-4c2f-ac01-7481462dd3bd\" (UID: \"7b3fa391-a294-4c2f-ac01-7481462dd3bd\") "
Jul 23 18:49:54.225780 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.225747    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b3fa391-a294-4c2f-ac01-7481462dd3bd-kube-api-access-s2dzw" (OuterVolumeSpecName: "kube-api-access-s2dzw") pod "7b3fa391-a294-4c2f-ac01-7481462dd3bd" (UID: "7b3fa391-a294-4c2f-ac01-7481462dd3bd"). InnerVolumeSpecName "kube-api-access-s2dzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:49:54.265838 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.265809    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7626-140624564862384"]
Jul 23 18:49:54.266253 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.266238    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b3fa391-a294-4c2f-ac01-7481462dd3bd" containerName="test-curl-7626-140624564861376"
Jul 23 18:49:54.266302 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.266256    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b3fa391-a294-4c2f-ac01-7481462dd3bd" containerName="test-curl-7626-140624564861376"
Jul 23 18:49:54.266344 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.266335    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b3fa391-a294-4c2f-ac01-7481462dd3bd" containerName="test-curl-7626-140624564861376"
Jul 23 18:49:54.269160 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.269142    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:54.279349 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.279329    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624564862384"]
Jul 23 18:49:54.324982 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.324953    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2dzw\" (UniqueName: \"kubernetes.io/projected/7b3fa391-a294-4c2f-ac01-7481462dd3bd-kube-api-access-s2dzw\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:49:54.426434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.426398    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tmxn\" (UniqueName: \"kubernetes.io/projected/d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f-kube-api-access-5tmxn\") pod \"test-curl-7626-140624564862384\" (UID: \"d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f\") " pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:54.528051 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.527964    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tmxn\" (UniqueName: \"kubernetes.io/projected/d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f-kube-api-access-5tmxn\") pod \"test-curl-7626-140624564862384\" (UID: \"d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f\") " pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:54.541415 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.541374    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tmxn\" (UniqueName: \"kubernetes.io/projected/d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f-kube-api-access-5tmxn\") pod \"test-curl-7626-140624564862384\" (UID: \"d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f\") " pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:54.578372 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.578344    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:54.719804 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.719777    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624564862384"]
Jul 23 18:49:54.721808 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:49:54.721782    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd77a690a_d0d4_42ed_b0db_c28fd6d8fe1f.slice/crio-7834f596228d9468f15dd3bb6cbd316adff0a8017d81645367e6ad5f0f0f8ec3 WatchSource:0}: Error finding container 7834f596228d9468f15dd3bb6cbd316adff0a8017d81645367e6ad5f0f0f8ec3: Status 404 returned error can't find the container with id 7834f596228d9468f15dd3bb6cbd316adff0a8017d81645367e6ad5f0f0f8ec3
Jul 23 18:49:54.930757 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.930725    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624564862384" event={"ID":"d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f","Type":"ContainerStarted","Data":"7834f596228d9468f15dd3bb6cbd316adff0a8017d81645367e6ad5f0f0f8ec3"}
Jul 23 18:49:54.931887 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.931869    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564861376"
Jul 23 18:49:54.931983 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:54.931893    2574 scope.go:117] "RemoveContainer" containerID="78cc3f863eaa10a014e8670805ae5bcb5023578330979b5983a7717889df012b"
Jul 23 18:49:55.941687 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:55.941652    2574 generic.go:356] "Generic (PLEG): container finished" podID="d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f" containerID="93ff8dc5566bb994d4017d2ffd3daaf33d4664bf0d877de03d0a7dcc27566dfe" exitCode=0
Jul 23 18:49:55.942173 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:55.941748    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624564862384" event={"ID":"d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f","Type":"ContainerDied","Data":"93ff8dc5566bb994d4017d2ffd3daaf33d4664bf0d877de03d0a7dcc27566dfe"}
Jul 23 18:49:56.186940 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:56.186907    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b3fa391-a294-4c2f-ac01-7481462dd3bd" path="/var/lib/kubelet/pods/7b3fa391-a294-4c2f-ac01-7481462dd3bd/volumes"
Jul 23 18:49:57.077349 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.077327    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:57.103727 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.103701    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7626-140624564862384_d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f/test-curl-7626-140624564862384/0.log"
Jul 23 18:49:57.134973 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.134942    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7626-140624564862384"]
Jul 23 18:49:57.140110 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.140087    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7626-140624564862384"]
Jul 23 18:49:57.255130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.255035    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tmxn\" (UniqueName: \"kubernetes.io/projected/d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f-kube-api-access-5tmxn\") pod \"d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f\" (UID: \"d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f\") "
Jul 23 18:49:57.257004 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.256980    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f-kube-api-access-5tmxn" (OuterVolumeSpecName: "kube-api-access-5tmxn") pod "d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f" (UID: "d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f"). InnerVolumeSpecName "kube-api-access-5tmxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:49:57.273981 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.273950    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7626-140624564862384"]
Jul 23 18:49:57.274623 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.274604    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f" containerName="test-curl-7626-140624564862384"
Jul 23 18:49:57.274623 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.274623    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f" containerName="test-curl-7626-140624564862384"
Jul 23 18:49:57.274729 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.274699    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f" containerName="test-curl-7626-140624564862384"
Jul 23 18:49:57.277844 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.277827    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:57.286522 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.286501    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624564862384"]
Jul 23 18:49:57.356488 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.356456    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tmxn\" (UniqueName: \"kubernetes.io/projected/d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f-kube-api-access-5tmxn\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:49:57.457461 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.457427    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpwtk\" (UniqueName: \"kubernetes.io/projected/3ad19af3-d4ee-4e02-bf5d-3e0746ea1313-kube-api-access-hpwtk\") pod \"test-curl-7626-140624564862384\" (UID: \"3ad19af3-d4ee-4e02-bf5d-3e0746ea1313\") " pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:57.558473 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.558383    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpwtk\" (UniqueName: \"kubernetes.io/projected/3ad19af3-d4ee-4e02-bf5d-3e0746ea1313-kube-api-access-hpwtk\") pod \"test-curl-7626-140624564862384\" (UID: \"3ad19af3-d4ee-4e02-bf5d-3e0746ea1313\") " pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:57.568574 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.568543    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpwtk\" (UniqueName: \"kubernetes.io/projected/3ad19af3-d4ee-4e02-bf5d-3e0746ea1313-kube-api-access-hpwtk\") pod \"test-curl-7626-140624564862384\" (UID: \"3ad19af3-d4ee-4e02-bf5d-3e0746ea1313\") " pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:57.587524 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.587499    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:57.723856 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.723828    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7626-140624564862384"]
Jul 23 18:49:57.725307 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:49:57.725281    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ad19af3_d4ee_4e02_bf5d_3e0746ea1313.slice/crio-d2654ee68c5aec7ace06089c2486f46fd8b4d67fd71997cc9ec401b4d8409edd WatchSource:0}: Error finding container d2654ee68c5aec7ace06089c2486f46fd8b4d67fd71997cc9ec401b4d8409edd: Status 404 returned error can't find the container with id d2654ee68c5aec7ace06089c2486f46fd8b4d67fd71997cc9ec401b4d8409edd
Jul 23 18:49:57.955098 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.955072    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:49:57.955279 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.955104    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7834f596228d9468f15dd3bb6cbd316adff0a8017d81645367e6ad5f0f0f8ec3"
Jul 23 18:49:57.956405 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.956373    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624564862384" event={"ID":"3ad19af3-d4ee-4e02-bf5d-3e0746ea1313","Type":"ContainerStarted","Data":"d2654ee68c5aec7ace06089c2486f46fd8b4d67fd71997cc9ec401b4d8409edd"}
Jul 23 18:49:57.967573 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:57.967548    2574 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7626-140624564862384" oldPodUID="d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f" podUID="3ad19af3-d4ee-4e02-bf5d-3e0746ea1313"
Jul 23 18:49:58.186481 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:58.186447    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f" path="/var/lib/kubelet/pods/d77a690a-d0d4-42ed-b0db-c28fd6d8fe1f/volumes"
Jul 23 18:49:58.963401 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:58.963366    2574 generic.go:356] "Generic (PLEG): container finished" podID="3ad19af3-d4ee-4e02-bf5d-3e0746ea1313" containerID="57317803dbe37f682c13930a038a64ac67e14fceeb44b738961fe2c62d73e8b8" exitCode=0
Jul 23 18:49:58.963589 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:49:58.963450    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7626-140624564862384" event={"ID":"3ad19af3-d4ee-4e02-bf5d-3e0746ea1313","Type":"ContainerDied","Data":"57317803dbe37f682c13930a038a64ac67e14fceeb44b738961fe2c62d73e8b8"}
Jul 23 18:50:00.091084 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.091059    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:50:00.118714 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.118686    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7626-140624564862384_3ad19af3-d4ee-4e02-bf5d-3e0746ea1313/test-curl-7626-140624564862384/0.log"
Jul 23 18:50:00.150899 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.150874    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7626-140624564862384"]
Jul 23 18:50:00.154419 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.154394    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7626-140624564862384"]
Jul 23 18:50:00.183055 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.183025    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpwtk\" (UniqueName: \"kubernetes.io/projected/3ad19af3-d4ee-4e02-bf5d-3e0746ea1313-kube-api-access-hpwtk\") pod \"3ad19af3-d4ee-4e02-bf5d-3e0746ea1313\" (UID: \"3ad19af3-d4ee-4e02-bf5d-3e0746ea1313\") "
Jul 23 18:50:00.185212 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.185188    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad19af3-d4ee-4e02-bf5d-3e0746ea1313-kube-api-access-hpwtk" (OuterVolumeSpecName: "kube-api-access-hpwtk") pod "3ad19af3-d4ee-4e02-bf5d-3e0746ea1313" (UID: "3ad19af3-d4ee-4e02-bf5d-3e0746ea1313"). InnerVolumeSpecName "kube-api-access-hpwtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:50:00.187256 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.187217    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ad19af3-d4ee-4e02-bf5d-3e0746ea1313" path="/var/lib/kubelet/pods/3ad19af3-d4ee-4e02-bf5d-3e0746ea1313/volumes"
Jul 23 18:50:00.284612 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.284539    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpwtk\" (UniqueName: \"kubernetes.io/projected/3ad19af3-d4ee-4e02-bf5d-3e0746ea1313-kube-api-access-hpwtk\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:50:00.381563 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.381530    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"]
Jul 23 18:50:00.381977 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.381964    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad19af3-d4ee-4e02-bf5d-3e0746ea1313" containerName="test-curl-7626-140624564862384"
Jul 23 18:50:00.382016 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.381978    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad19af3-d4ee-4e02-bf5d-3e0746ea1313" containerName="test-curl-7626-140624564862384"
Jul 23 18:50:00.382051 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.382044    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad19af3-d4ee-4e02-bf5d-3e0746ea1313" containerName="test-curl-7626-140624564862384"
Jul 23 18:50:00.385195 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.385180    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"
Jul 23 18:50:00.391920 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.391742    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:50:00.395943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.395919    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"]
Jul 23 18:50:00.486562 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.486528    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3702b15-53a1-4d20-b8ae-1d9a4006a02e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d87a73-789kc\" (UID: \"b3702b15-53a1-4d20-b8ae-1d9a4006a02e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"
Jul 23 18:50:00.587861 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.587831    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3702b15-53a1-4d20-b8ae-1d9a4006a02e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d87a73-789kc\" (UID: \"b3702b15-53a1-4d20-b8ae-1d9a4006a02e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"
Jul 23 18:50:00.588464 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.588445    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3702b15-53a1-4d20-b8ae-1d9a4006a02e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-d87a73-789kc\" (UID: \"b3702b15-53a1-4d20-b8ae-1d9a4006a02e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"
Jul 23 18:50:00.697606 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.697571    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"
Jul 23 18:50:00.840186 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:50:00.840137    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3702b15_53a1_4d20_b8ae_1d9a4006a02e.slice/crio-2371139ef94301c712d32df5737834737d896b2d3ea22dbe08ad48f5f3841698 WatchSource:0}: Error finding container 2371139ef94301c712d32df5737834737d896b2d3ea22dbe08ad48f5f3841698: Status 404 returned error can't find the container with id 2371139ef94301c712d32df5737834737d896b2d3ea22dbe08ad48f5f3841698
Jul 23 18:50:00.841074 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.841045    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"]
Jul 23 18:50:00.961925 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.961900    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:00.976346 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.976324    2574 scope.go:117] "RemoveContainer" containerID="57317803dbe37f682c13930a038a64ac67e14fceeb44b738961fe2c62d73e8b8"
Jul 23 18:50:00.976462 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.976328    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7626-140624564862384"
Jul 23 18:50:00.977800 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:00.977772    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc" event={"ID":"b3702b15-53a1-4d20-b8ae-1d9a4006a02e","Type":"ContainerStarted","Data":"2371139ef94301c712d32df5737834737d896b2d3ea22dbe08ad48f5f3841698"}
Jul 23 18:50:01.066120 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:01.066095    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:01.986174 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:01.986140    2574 generic.go:356] "Generic (PLEG): container finished" podID="b3702b15-53a1-4d20-b8ae-1d9a4006a02e" containerID="a53db5050feeb167e8aa3c2e4ff826aa0995d2be2c31595e716228a30c0d09f2" exitCode=0
Jul 23 18:50:01.986565 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:01.986201    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc" event={"ID":"b3702b15-53a1-4d20-b8ae-1d9a4006a02e","Type":"ContainerDied","Data":"a53db5050feeb167e8aa3c2e4ff826aa0995d2be2c31595e716228a30c0d09f2"}
Jul 23 18:50:03.127788 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:03.127766    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"
Jul 23 18:50:03.312741 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:03.312661    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3702b15-53a1-4d20-b8ae-1d9a4006a02e-maas-api-service-ca\") pod \"b3702b15-53a1-4d20-b8ae-1d9a4006a02e\" (UID: \"b3702b15-53a1-4d20-b8ae-1d9a4006a02e\") "
Jul 23 18:50:03.313042 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:03.313015    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3702b15-53a1-4d20-b8ae-1d9a4006a02e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b3702b15-53a1-4d20-b8ae-1d9a4006a02e" (UID: "b3702b15-53a1-4d20-b8ae-1d9a4006a02e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:50:03.413938 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:03.413904    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3702b15-53a1-4d20-b8ae-1d9a4006a02e-maas-api-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:50:03.999601 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:03.999570    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"
Jul 23 18:50:03.999743 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:03.999605    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc" event={"ID":"b3702b15-53a1-4d20-b8ae-1d9a4006a02e","Type":"ContainerDied","Data":"2371139ef94301c712d32df5737834737d896b2d3ea22dbe08ad48f5f3841698"}
Jul 23 18:50:03.999743 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:03.999673    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2371139ef94301c712d32df5737834737d896b2d3ea22dbe08ad48f5f3841698"
Jul 23 18:50:10.934379 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:10.934342    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"]
Jul 23 18:50:10.936313 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:10.935271    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc" podUID="c19ae25c-7420-480b-90df-2735f24aeec2" containerName="maas-api" containerID="cri-o://30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2" gracePeriod=30
Jul 23 18:50:10.966409 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:10.966377    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:10.976754 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:10.976727    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5"]
Jul 23 18:50:10.980818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:10.980793    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d87a73-29747205-xzhs5"]
Jul 23 18:50:11.184828 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:11.184774    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:50:11.284493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:11.284465    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csjk2\" (UniqueName: \"kubernetes.io/projected/c19ae25c-7420-480b-90df-2735f24aeec2-kube-api-access-csjk2\") pod \"c19ae25c-7420-480b-90df-2735f24aeec2\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") "
Jul 23 18:50:11.284652 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:11.284511    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c19ae25c-7420-480b-90df-2735f24aeec2-maas-api-tls\") pod \"c19ae25c-7420-480b-90df-2735f24aeec2\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") "
Jul 23 18:50:11.284652 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:11.284585    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c19ae25c-7420-480b-90df-2735f24aeec2-openshift-service-ca\") pod \"c19ae25c-7420-480b-90df-2735f24aeec2\" (UID: \"c19ae25c-7420-480b-90df-2735f24aeec2\") "
Jul 23 18:50:11.284943 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:11.284921    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c19ae25c-7420-480b-90df-2735f24aeec2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c19ae25c-7420-480b-90df-2735f24aeec2" (UID: "c19ae25c-7420-480b-90df-2735f24aeec2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:50:11.286540 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:11.286515    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c19ae25c-7420-480b-90df-2735f24aeec2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c19ae25c-7420-480b-90df-2735f24aeec2" (UID: "c19ae25c-7420-480b-90df-2735f24aeec2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:50:11.286540 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:11.286521    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c19ae25c-7420-480b-90df-2735f24aeec2-kube-api-access-csjk2" (OuterVolumeSpecName: "kube-api-access-csjk2") pod "c19ae25c-7420-480b-90df-2735f24aeec2" (UID: "c19ae25c-7420-480b-90df-2735f24aeec2"). InnerVolumeSpecName "kube-api-access-csjk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:50:11.385602 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:11.385575    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csjk2\" (UniqueName: \"kubernetes.io/projected/c19ae25c-7420-480b-90df-2735f24aeec2-kube-api-access-csjk2\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:50:11.385602 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:11.385605    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c19ae25c-7420-480b-90df-2735f24aeec2-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:50:11.385757 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:11.385618    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c19ae25c-7420-480b-90df-2735f24aeec2-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:50:12.048440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.048353    2574 generic.go:356] "Generic (PLEG): container finished" podID="c19ae25c-7420-480b-90df-2735f24aeec2" containerID="30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2" exitCode=0
Jul 23 18:50:12.048440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.048400    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"
Jul 23 18:50:12.048961 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.048436    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc" event={"ID":"c19ae25c-7420-480b-90df-2735f24aeec2","Type":"ContainerDied","Data":"30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2"}
Jul 23 18:50:12.048961 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.048522    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc" event={"ID":"c19ae25c-7420-480b-90df-2735f24aeec2","Type":"ContainerDied","Data":"8d700a1bed262089e8b0587038ae75dbc9129f1700d38e03fada821f9a52f6d7"}
Jul 23 18:50:12.048961 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.048563    2574 scope.go:117] "RemoveContainer" containerID="30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2"
Jul 23 18:50:12.060555 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.060529    2574 scope.go:117] "RemoveContainer" containerID="30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2"
Jul 23 18:50:12.060897 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:50:12.060869    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2\": container with ID starting with 30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2 not found: ID does not exist" containerID="30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2"
Jul 23 18:50:12.060974 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.060908    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2"} err="failed to get container status \"30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2\": rpc error: code = NotFound desc = could not find container \"30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2\": container with ID starting with 30e4256f0fc9c30e4df86abce9f542808d82c6d07e896ad79deef5bee2477ef2 not found: ID does not exist"
Jul 23 18:50:12.073413 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.073391    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"]
Jul 23 18:50:12.081324 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.081303    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-d87a73-6cd4cf6d9-5pplc"]
Jul 23 18:50:12.185856 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.185829    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="927b2e35-ce22-4f60-817a-8c69cb2aece5" path="/var/lib/kubelet/pods/927b2e35-ce22-4f60-817a-8c69cb2aece5/volumes"
Jul 23 18:50:12.186179 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:12.186166    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c19ae25c-7420-480b-90df-2735f24aeec2" path="/var/lib/kubelet/pods/c19ae25c-7420-480b-90df-2735f24aeec2/volumes"
Jul 23 18:50:14.415318 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:14.415274    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:50:15.472297 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:15.472264    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:15.500423 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:15.500390    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"]
Jul 23 18:50:15.509423 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:15.509394    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-d87a73-789kc"]
Jul 23 18:50:15.903235 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:15.903198    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:16.185804 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:16.185726    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3702b15-53a1-4d20-b8ae-1d9a4006a02e" path="/var/lib/kubelet/pods/b3702b15-53a1-4d20-b8ae-1d9a4006a02e/volumes"
Jul 23 18:50:23.088450 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.088412    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:23.152271 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.152240    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:23.409845 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.409757    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:23.652855 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.652822    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:23.777765 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.777692    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"]
Jul 23 18:50:23.778119 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.778107    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3702b15-53a1-4d20-b8ae-1d9a4006a02e" containerName="revoke-keys"
Jul 23 18:50:23.778163 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.778121    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3702b15-53a1-4d20-b8ae-1d9a4006a02e" containerName="revoke-keys"
Jul 23 18:50:23.778163 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.778133    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19ae25c-7420-480b-90df-2735f24aeec2" containerName="maas-api"
Jul 23 18:50:23.778163 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.778138    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19ae25c-7420-480b-90df-2735f24aeec2" containerName="maas-api"
Jul 23 18:50:23.778330 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.778202    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3702b15-53a1-4d20-b8ae-1d9a4006a02e" containerName="revoke-keys"
Jul 23 18:50:23.778330 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.778209    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c19ae25c-7420-480b-90df-2735f24aeec2" containerName="maas-api"
Jul 23 18:50:23.783166 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.783145    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"
Jul 23 18:50:23.789275 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.789250    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\""
Jul 23 18:50:23.799458 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.799433    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"]
Jul 23 18:50:23.901985 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:23.901949    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e309cd2e-1994-4ccf-b7dc-90be6336b254-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc\" (UID: \"e309cd2e-1994-4ccf-b7dc-90be6336b254\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"
Jul 23 18:50:24.003485 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:24.003453    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e309cd2e-1994-4ccf-b7dc-90be6336b254-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc\" (UID: \"e309cd2e-1994-4ccf-b7dc-90be6336b254\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"
Jul 23 18:50:24.004047 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:24.004028    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e309cd2e-1994-4ccf-b7dc-90be6336b254-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc\" (UID: \"e309cd2e-1994-4ccf-b7dc-90be6336b254\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"
Jul 23 18:50:24.092476 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:24.092445    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"
Jul 23 18:50:24.241739 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:24.241705    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"]
Jul 23 18:50:24.243297 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:50:24.243264    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode309cd2e_1994_4ccf_b7dc_90be6336b254.slice/crio-5556b1516960dfc3c10aa03c364db1d4003a41b2c4c468d389939ba593fac91c WatchSource:0}: Error finding container 5556b1516960dfc3c10aa03c364db1d4003a41b2c4c468d389939ba593fac91c: Status 404 returned error can't find the container with id 5556b1516960dfc3c10aa03c364db1d4003a41b2c4c468d389939ba593fac91c
Jul 23 18:50:24.753112 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:24.753023    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:24.855293 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:24.855265    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:25.128535 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:25.128504    2574 generic.go:356] "Generic (PLEG): container finished" podID="e309cd2e-1994-4ccf-b7dc-90be6336b254" containerID="fd0352da723b1ab8296453eaa106c521dbe65e2480d768b76867b168ef19a800" exitCode=0
Jul 23 18:50:25.128827 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:25.128578    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc" event={"ID":"e309cd2e-1994-4ccf-b7dc-90be6336b254","Type":"ContainerDied","Data":"fd0352da723b1ab8296453eaa106c521dbe65e2480d768b76867b168ef19a800"}
Jul 23 18:50:25.128827 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:25.128622    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc" event={"ID":"e309cd2e-1994-4ccf-b7dc-90be6336b254","Type":"ContainerStarted","Data":"5556b1516960dfc3c10aa03c364db1d4003a41b2c4c468d389939ba593fac91c"}
Jul 23 18:50:26.291103 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:26.291078    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"
Jul 23 18:50:26.432075 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:26.431999    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e309cd2e-1994-4ccf-b7dc-90be6336b254-maas-api-service-ca\") pod \"e309cd2e-1994-4ccf-b7dc-90be6336b254\" (UID: \"e309cd2e-1994-4ccf-b7dc-90be6336b254\") "
Jul 23 18:50:26.432353 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:26.432328    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e309cd2e-1994-4ccf-b7dc-90be6336b254-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e309cd2e-1994-4ccf-b7dc-90be6336b254" (UID: "e309cd2e-1994-4ccf-b7dc-90be6336b254"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:50:26.533448 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:26.533417    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e309cd2e-1994-4ccf-b7dc-90be6336b254-maas-api-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:50:27.141295 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:27.141269    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"
Jul 23 18:50:27.141470 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:27.141266    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc" event={"ID":"e309cd2e-1994-4ccf-b7dc-90be6336b254","Type":"ContainerDied","Data":"5556b1516960dfc3c10aa03c364db1d4003a41b2c4c468d389939ba593fac91c"}
Jul 23 18:50:27.141470 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:27.141409    2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5556b1516960dfc3c10aa03c364db1d4003a41b2c4c468d389939ba593fac91c"
Jul 23 18:50:34.647339 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:34.647297    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"]
Jul 23 18:50:34.647821 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:34.647529    2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx" podUID="c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67" containerName="maas-api" containerID="cri-o://838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5" gracePeriod=30
Jul 23 18:50:34.699790 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:34.699734    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:34.701042 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:34.701012    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x"]
Jul 23 18:50:34.703685 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:34.703668    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-118a8c-29747205-h9l5x"]
Jul 23 18:50:34.905645 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:34.905589    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:50:35.006395 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.006359    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-openshift-service-ca\") pod \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") "
Jul 23 18:50:35.006395 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.006399    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-maas-api-tls\") pod \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") "
Jul 23 18:50:35.006582 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.006567    2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k56nf\" (UniqueName: \"kubernetes.io/projected/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-kube-api-access-k56nf\") pod \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\" (UID: \"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67\") "
Jul 23 18:50:35.006793 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.006769    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67" (UID: "c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 18:50:35.006879 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.006856    2574 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-openshift-service-ca\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:50:35.008583 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.008559    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67" (UID: "c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 18:50:35.008672 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.008655    2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-kube-api-access-k56nf" (OuterVolumeSpecName: "kube-api-access-k56nf") pod "c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67" (UID: "c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67"). InnerVolumeSpecName "kube-api-access-k56nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 18:50:35.108036 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.108000    2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k56nf\" (UniqueName: \"kubernetes.io/projected/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-kube-api-access-k56nf\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:50:35.108036 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.108030    2574 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67-maas-api-tls\") on node \"ip-10-0-143-41.ec2.internal\" DevicePath \"\""
Jul 23 18:50:35.195764 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.195687    2574 generic.go:356] "Generic (PLEG): container finished" podID="c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67" containerID="838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5" exitCode=0
Jul 23 18:50:35.195764 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.195728    2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"
Jul 23 18:50:35.195995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.195785    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx" event={"ID":"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67","Type":"ContainerDied","Data":"838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5"}
Jul 23 18:50:35.195995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.195842    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx" event={"ID":"c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67","Type":"ContainerDied","Data":"6e7fac096444d24a4b997feea3297f3f24ebb1e113549e50856b28a52b2acf84"}
Jul 23 18:50:35.195995 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.195874    2574 scope.go:117] "RemoveContainer" containerID="838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5"
Jul 23 18:50:35.205946 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.205923    2574 scope.go:117] "RemoveContainer" containerID="838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5"
Jul 23 18:50:35.206237 ip-10-0-143-41 kubenswrapper[2574]: E0723 18:50:35.206205    2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5\": container with ID starting with 838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5 not found: ID does not exist" containerID="838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5"
Jul 23 18:50:35.206306 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.206250    2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5"} err="failed to get container status \"838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5\": rpc error: code = NotFound desc = could not find container \"838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5\": container with ID starting with 838448544d32a0ed4924f75e916f182fbe56ba1f29ab9241c2e20f670c105db5 not found: ID does not exist"
Jul 23 18:50:35.229829 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.229802    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"]
Jul 23 18:50:35.232566 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:35.232544    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-118a8c-8495978c96-jv6sx"]
Jul 23 18:50:36.185710 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:36.185681    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79147778-0194-4b59-924a-342a98f04573" path="/var/lib/kubelet/pods/79147778-0194-4b59-924a-342a98f04573/volumes"
Jul 23 18:50:36.186070 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:36.186056    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67" path="/var/lib/kubelet/pods/c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67/volumes"
Jul 23 18:50:38.025298 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:38.025268    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pqwtd"]
Jul 23 18:50:38.872828 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:38.872794    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:38.880653 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:38.880625    2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"]
Jul 23 18:50:38.886900 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:38.886877    2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-118a8c-whgqc"]
Jul 23 18:50:39.273532 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:39.273440    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:40.190557 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:40.190526    2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e309cd2e-1994-4ccf-b7dc-90be6336b254" path="/var/lib/kubelet/pods/e309cd2e-1994-4ccf-b7dc-90be6336b254/volumes"
Jul 23 18:50:45.585829 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:45.585791    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:46.802026 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:46.801982    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:50:52.358783 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:52.358752    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nkgtn_58dad97b-037b-4fb6-ade8-ad2f5ff6afff/manager/0.log"
Jul 23 18:50:52.493868 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:52.493835    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s7cl4_fc5a2c65-053f-4eea-a9d6-c837c04ba5d3/manager/0.log"
Jul 23 18:50:52.749505 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:52.749428    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jh9nw_fe76d075-337f-4a9b-8a05-fc041f546f0f/server/0.log"
Jul 23 18:50:52.881193 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:52.881162    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gqnqb_74967bc8-0d98-4f92-814b-a338a0991e8a/manager/0.log"
Jul 23 18:50:53.162861 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:53.162833    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-hw578_5a70bf0f-d407-407d-aef9-c6a8e87cae46/copy-manifests/0.log"
Jul 23 18:50:53.180041 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:53.180010    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-hw578_5a70bf0f-d407-407d-aef9-c6a8e87cae46/manager/0.log"
Jul 23 18:50:53.718679 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:53.718645    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-79b7dbcf5c-9dkhc_a2819b97-92d1-406c-b7ac-2b215ab1988c/maas-api/0.log"
Jul 23 18:50:53.853538 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:53.853504    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747175-w6tm7_3fee0e3b-f2e0-4633-bc4f-7e9070bcee51/cleanup/0.log"
Jul 23 18:50:53.996502 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:53.996431    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747190-g5s97_7c25e689-d93e-437d-aefd-53a8909f76fa/cleanup/0.log"
Jul 23 18:50:54.124573 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:54.124546    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747205-6fnhh_8b6b8d8d-c967-4fd8-b8fc-618d616a88f4/cleanup/0.log"
Jul 23 18:50:55.084539 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.084506    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt_1596d7a7-f6ef-461f-a4e5-18d365dcb6ed/util/0.log"
Jul 23 18:50:55.095669 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.095646    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt_1596d7a7-f6ef-461f-a4e5-18d365dcb6ed/pull/0.log"
Jul 23 18:50:55.106496 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.106478    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt_1596d7a7-f6ef-461f-a4e5-18d365dcb6ed/extract/0.log"
Jul 23 18:50:55.235969 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.235933    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j_9ab5eeba-1a82-420b-af49-571b749e15f4/extract/0.log"
Jul 23 18:50:55.244138 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.244111    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j_9ab5eeba-1a82-420b-af49-571b749e15f4/util/0.log"
Jul 23 18:50:55.259160 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.259136    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j_9ab5eeba-1a82-420b-af49-571b749e15f4/pull/0.log"
Jul 23 18:50:55.377107 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.377020    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24_4ff7e150-95de-4985-8325-b60321b22295/extract/0.log"
Jul 23 18:50:55.384384 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.384365    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24_4ff7e150-95de-4985-8325-b60321b22295/util/0.log"
Jul 23 18:50:55.391931 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.391905    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24_4ff7e150-95de-4985-8325-b60321b22295/pull/0.log"
Jul 23 18:50:55.508178 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.508149    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z_a2f6376f-f6a2-4a8c-8aaf-6a029fc82806/util/0.log"
Jul 23 18:50:55.515065 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.515042    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z_a2f6376f-f6a2-4a8c-8aaf-6a029fc82806/pull/0.log"
Jul 23 18:50:55.521769 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.521749    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z_a2f6376f-f6a2-4a8c-8aaf-6a029fc82806/extract/0.log"
Jul 23 18:50:55.799128 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:55.799019    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-q6m5v_35bf8764-4d6f-4fff-a559-4da1fcc1b6de/manager/0.log"
Jul 23 18:50:56.045383 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:56.045357    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9bsf4_a5e8b7ae-8335-44ca-8f4f-060c13b0180a/kuadrant-console-plugin/0.log"
Jul 23 18:50:56.169535 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:56.169501    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5nj4q_0098b149-ca73-4edf-9c1e-0da361483330/registry-server/0.log"
Jul 23 18:50:56.312324 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:56.312297    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qknsf_36635919-09a8-477e-9f9a-7d980e98f240/manager/0.log"
Jul 23 18:50:56.446480 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:56.446402    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pqwtd_e3c7620d-ebb6-4564-97e0-1b1942524880/limitador/0.log"
Jul 23 18:50:57.352167 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:57.352141    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84ccbf468f-5g6m2_138be5b4-c9da-4a03-bc52-f4f97ff6f78d/kube-auth-proxy/0.log"
Jul 23 18:50:57.485783 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:57.485749    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m4tc6_27c48f64-09ee-441e-b24c-40cf615d962b/istio-proxy/1.log"
Jul 23 18:50:57.623093 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:57.623022    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8gbf7_bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947/payload-pre-processing/0.log"
Jul 23 18:50:57.765807 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:57.765784    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-l9m2f_bc362a74-6587-47b8-9def-ede22fee5e3d/payload-processing/0.log"
Jul 23 18:50:57.893377 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:57.893297    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6689ddd698-sx5jk_fca00c58-fee4-4d2b-910c-979d9b13dd72/router/0.log"
Jul 23 18:50:58.900359 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:50:58.900326    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-h2lqj_568bffd2-bca3-4a8d-a570-551979306b7a/main/0.log"
Jul 23 18:51:04.920957 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.920921    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w9xtf/must-gather-fbrpx"]
Jul 23 18:51:04.921385 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.921369    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67" containerName="maas-api"
Jul 23 18:51:04.921385 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.921381    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67" containerName="maas-api"
Jul 23 18:51:04.921463 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.921403    2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e309cd2e-1994-4ccf-b7dc-90be6336b254" containerName="revoke-keys"
Jul 23 18:51:04.921463 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.921409    2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e309cd2e-1994-4ccf-b7dc-90be6336b254" containerName="revoke-keys"
Jul 23 18:51:04.921527 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.921478    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e309cd2e-1994-4ccf-b7dc-90be6336b254" containerName="revoke-keys"
Jul 23 18:51:04.921527 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.921488    2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3b4e6a2-2f3e-4e16-ba76-5cf4275f2c67" containerName="maas-api"
Jul 23 18:51:04.924753 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.924731    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xtf/must-gather-fbrpx"
Jul 23 18:51:04.927169 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.927145    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:51:04.928036 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.928021    2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w9xtf\"/\"default-dockercfg-8ktnr\""
Jul 23 18:51:04.928810 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.928793    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9xtf\"/\"kube-root-ca.crt\""
Jul 23 18:51:04.928902 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.928812    2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9xtf\"/\"openshift-service-ca.crt\""
Jul 23 18:51:04.935680 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.935656    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xtf/must-gather-fbrpx"]
Jul 23 18:51:04.991325 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.991278    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4c6r\" (UniqueName: \"kubernetes.io/projected/75331fe4-ac56-4d9c-abac-ac1d610ef9dc-kube-api-access-r4c6r\") pod \"must-gather-fbrpx\" (UID: \"75331fe4-ac56-4d9c-abac-ac1d610ef9dc\") " pod="openshift-must-gather-w9xtf/must-gather-fbrpx"
Jul 23 18:51:04.991325 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:04.991331    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/75331fe4-ac56-4d9c-abac-ac1d610ef9dc-must-gather-output\") pod \"must-gather-fbrpx\" (UID: \"75331fe4-ac56-4d9c-abac-ac1d610ef9dc\") " pod="openshift-must-gather-w9xtf/must-gather-fbrpx"
Jul 23 18:51:05.022236 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:05.022189    2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log" limit=1024
Jul 23 18:51:05.092634 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:05.092598    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4c6r\" (UniqueName: \"kubernetes.io/projected/75331fe4-ac56-4d9c-abac-ac1d610ef9dc-kube-api-access-r4c6r\") pod \"must-gather-fbrpx\" (UID: \"75331fe4-ac56-4d9c-abac-ac1d610ef9dc\") " pod="openshift-must-gather-w9xtf/must-gather-fbrpx"
Jul 23 18:51:05.092634 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:05.092639    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/75331fe4-ac56-4d9c-abac-ac1d610ef9dc-must-gather-output\") pod \"must-gather-fbrpx\" (UID: \"75331fe4-ac56-4d9c-abac-ac1d610ef9dc\") " pod="openshift-must-gather-w9xtf/must-gather-fbrpx"
Jul 23 18:51:05.093025 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:05.093005    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/75331fe4-ac56-4d9c-abac-ac1d610ef9dc-must-gather-output\") pod \"must-gather-fbrpx\" (UID: \"75331fe4-ac56-4d9c-abac-ac1d610ef9dc\") " pod="openshift-must-gather-w9xtf/must-gather-fbrpx"
Jul 23 18:51:05.102649 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:05.102620    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4c6r\" (UniqueName: \"kubernetes.io/projected/75331fe4-ac56-4d9c-abac-ac1d610ef9dc-kube-api-access-r4c6r\") pod \"must-gather-fbrpx\" (UID: \"75331fe4-ac56-4d9c-abac-ac1d610ef9dc\") " pod="openshift-must-gather-w9xtf/must-gather-fbrpx"
Jul 23 18:51:05.235890 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:05.235801    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xtf/must-gather-fbrpx"
Jul 23 18:51:05.375734 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:05.375709    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xtf/must-gather-fbrpx"]
Jul 23 18:51:05.377435 ip-10-0-143-41 kubenswrapper[2574]: W0723 18:51:05.377403    2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75331fe4_ac56_4d9c_abac_ac1d610ef9dc.slice/crio-6feb6cfd31412b538bb3902cddb76a846df7c52ea3f1bfd66ddca5fe0bb3e984 WatchSource:0}: Error finding container 6feb6cfd31412b538bb3902cddb76a846df7c52ea3f1bfd66ddca5fe0bb3e984: Status 404 returned error can't find the container with id 6feb6cfd31412b538bb3902cddb76a846df7c52ea3f1bfd66ddca5fe0bb3e984
Jul 23 18:51:05.396066 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:05.396033    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xtf/must-gather-fbrpx" event={"ID":"75331fe4-ac56-4d9c-abac-ac1d610ef9dc","Type":"ContainerStarted","Data":"6feb6cfd31412b538bb3902cddb76a846df7c52ea3f1bfd66ddca5fe0bb3e984"}
Jul 23 18:51:06.407409 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:06.407355    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xtf/must-gather-fbrpx" event={"ID":"75331fe4-ac56-4d9c-abac-ac1d610ef9dc","Type":"ContainerStarted","Data":"c37a3e4cbdd418380403c45631b3135c5ec4a36b0996d0e7549d439b48311449"}
Jul 23 18:51:07.419332 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:07.419284    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xtf/must-gather-fbrpx" event={"ID":"75331fe4-ac56-4d9c-abac-ac1d610ef9dc","Type":"ContainerStarted","Data":"28101157a0815e81c8bb7fd0aa933fc98bc65e69c06b79100c7a70d78e54766a"}
Jul 23 18:51:07.443264 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:07.443168    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w9xtf/must-gather-fbrpx" podStartSLOduration=2.587336712 podStartE2EDuration="3.443144788s" totalImagesPullingTime="855.808076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:51:07.43837575 +0000 UTC m=+2927.801219601" watchObservedRunningTime="2026-07-23 18:51:07.443144788 +0000 UTC m=+2927.805988641"
Jul 23 18:51:07.985873 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:07.985838    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sn5fv_dcf14205-3f73-4b29-ad41-afb60d083309/global-pull-secret-syncer/0.log"
Jul 23 18:51:08.104333 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:08.104300    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mw7kn_77049378-df66-46f7-8e93-f0a08ea49b3e/konnectivity-agent/0.log"
Jul 23 18:51:08.285088 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:08.285000    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-41.ec2.internal_51be1d98ce7a93e78550fbe38c9a87e2/haproxy/0.log"
Jul 23 18:51:12.831962 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:12.831924    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt_1596d7a7-f6ef-461f-a4e5-18d365dcb6ed/extract/0.log"
Jul 23 18:51:12.889403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:12.889210    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt_1596d7a7-f6ef-461f-a4e5-18d365dcb6ed/util/0.log"
Jul 23 18:51:12.942360 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:12.942206    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759f56kt_1596d7a7-f6ef-461f-a4e5-18d365dcb6ed/pull/0.log"
Jul 23 18:51:12.997336 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:12.997248    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j_9ab5eeba-1a82-420b-af49-571b749e15f4/extract/0.log"
Jul 23 18:51:13.048671 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:13.048645    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j_9ab5eeba-1a82-420b-af49-571b749e15f4/util/0.log"
Jul 23 18:51:13.107211 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:13.107116    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwg6j_9ab5eeba-1a82-420b-af49-571b749e15f4/pull/0.log"
Jul 23 18:51:13.182331 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:13.182301    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24_4ff7e150-95de-4985-8325-b60321b22295/extract/0.log"
Jul 23 18:51:13.248125 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:13.248093    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24_4ff7e150-95de-4985-8325-b60321b22295/util/0.log"
Jul 23 18:51:13.305774 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:13.305746    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73nmb24_4ff7e150-95de-4985-8325-b60321b22295/pull/0.log"
Jul 23 18:51:13.360097 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:13.360002    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z_a2f6376f-f6a2-4a8c-8aaf-6a029fc82806/extract/0.log"
Jul 23 18:51:13.412607 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:13.412570    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z_a2f6376f-f6a2-4a8c-8aaf-6a029fc82806/util/0.log"
Jul 23 18:51:13.465321 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:13.465293    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1zdw9z_a2f6376f-f6a2-4a8c-8aaf-6a029fc82806/pull/0.log"
Jul 23 18:51:13.900808 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:13.900770    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-q6m5v_35bf8764-4d6f-4fff-a559-4da1fcc1b6de/manager/0.log"
Jul 23 18:51:13.996578 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:13.996543    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9bsf4_a5e8b7ae-8335-44ca-8f4f-060c13b0180a/kuadrant-console-plugin/0.log"
Jul 23 18:51:14.055578 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:14.055540    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5nj4q_0098b149-ca73-4edf-9c1e-0da361483330/registry-server/0.log"
Jul 23 18:51:14.308531 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:14.308364    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qknsf_36635919-09a8-477e-9f9a-7d980e98f240/manager/0.log"
Jul 23 18:51:14.340918 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:14.340886    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pqwtd_e3c7620d-ebb6-4564-97e0-1b1942524880/limitador/0.log"
Jul 23 18:51:16.116183 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.116146    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7d8a46b-9a40-49b5-aa90-d8949931d166/alertmanager/0.log"
Jul 23 18:51:16.160176 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.160141    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7d8a46b-9a40-49b5-aa90-d8949931d166/config-reloader/0.log"
Jul 23 18:51:16.207082 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.207050    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7d8a46b-9a40-49b5-aa90-d8949931d166/kube-rbac-proxy-web/0.log"
Jul 23 18:51:16.246235 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.246184    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7d8a46b-9a40-49b5-aa90-d8949931d166/kube-rbac-proxy/0.log"
Jul 23 18:51:16.287843 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.287811    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7d8a46b-9a40-49b5-aa90-d8949931d166/kube-rbac-proxy-metric/0.log"
Jul 23 18:51:16.323347 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.323314    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7d8a46b-9a40-49b5-aa90-d8949931d166/prom-label-proxy/0.log"
Jul 23 18:51:16.355056 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.355030    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a7d8a46b-9a40-49b5-aa90-d8949931d166/init-config-reloader/0.log"
Jul 23 18:51:16.465986 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.465894    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-4sw88_c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af/kube-state-metrics/0.log"
Jul 23 18:51:16.495951 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.495924    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-4sw88_c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af/kube-rbac-proxy-main/0.log"
Jul 23 18:51:16.544286 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.544252    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-4sw88_c95ca3b0-6791-4ec0-b5be-3e6dbfcb49af/kube-rbac-proxy-self/0.log"
Jul 23 18:51:16.777873 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.777797    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btdrm_caafa5e3-77ba-4e28-a76e-a31b311d0588/node-exporter/0.log"
Jul 23 18:51:16.810953 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.810924    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btdrm_caafa5e3-77ba-4e28-a76e-a31b311d0588/kube-rbac-proxy/0.log"
Jul 23 18:51:16.843092 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.843053    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-btdrm_caafa5e3-77ba-4e28-a76e-a31b311d0588/init-textfile/0.log"
Jul 23 18:51:16.993070 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:16.993031    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rnzkx_ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b/kube-rbac-proxy-main/0.log"
Jul 23 18:51:17.022849 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:17.022819    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rnzkx_ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b/kube-rbac-proxy-self/0.log"
Jul 23 18:51:17.061628 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:17.061539    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-rnzkx_ca6e3ea5-01c0-4d75-b36f-3dbd2bb8f93b/openshift-state-metrics/0.log"
Jul 23 18:51:17.621924 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:17.621879    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-7f4dt_c40fe7c6-f5fe-4725-a367-f2d69a4d035e/prometheus-operator/0.log"
Jul 23 18:51:17.647212 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:17.647180    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-7f4dt_c40fe7c6-f5fe-4725-a367-f2d69a4d035e/kube-rbac-proxy/0.log"
Jul 23 18:51:17.680058 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:17.680026    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-zj64r_663d7e4e-240e-4bfd-8a3a-8327c8c7c0a8/prometheus-operator-admission-webhook/0.log"
Jul 23 18:51:17.722250 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:17.722182    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-548c59bcb4-sv75r_6973a297-ac7e-4fa8-8153-5fc330e52649/telemeter-client/0.log"
Jul 23 18:51:17.751507 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:17.751475    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-548c59bcb4-sv75r_6973a297-ac7e-4fa8-8153-5fc330e52649/reload/0.log"
Jul 23 18:51:17.785403 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:17.785375    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-548c59bcb4-sv75r_6973a297-ac7e-4fa8-8153-5fc330e52649/kube-rbac-proxy/0.log"
Jul 23 18:51:18.373196 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.373156    2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"]
Jul 23 18:51:18.381172 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.381142    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.390387 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.390347    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"]
Jul 23 18:51:18.448363 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.448317    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-proc\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.448549 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.448384    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-podres\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.448549 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.448454    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82dm5\" (UniqueName: \"kubernetes.io/projected/fa54b504-1309-4e53-9a27-020e0bd4ae59-kube-api-access-82dm5\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.448549 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.448486    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-lib-modules\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.448689 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.448562    2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-sys\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.550303 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.550257    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-podres\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.550489 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.550356    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82dm5\" (UniqueName: \"kubernetes.io/projected/fa54b504-1309-4e53-9a27-020e0bd4ae59-kube-api-access-82dm5\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.550489 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.550395    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-lib-modules\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.550489 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.550436    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-podres\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.550489 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.550443    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-sys\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.550489 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.550486    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-sys\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.550773 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.550546    2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-proc\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.550773 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.550573    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-lib-modules\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.550773 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.550637    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fa54b504-1309-4e53-9a27-020e0bd4ae59-proc\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.560959 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.560928    2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82dm5\" (UniqueName: \"kubernetes.io/projected/fa54b504-1309-4e53-9a27-020e0bd4ae59-kube-api-access-82dm5\") pod \"perf-node-gather-daemonset-vxp6v\" (UID: \"fa54b504-1309-4e53-9a27-020e0bd4ae59\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.696040 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.695945    2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:18.888493 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:18.888463    2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"]
Jul 23 18:51:19.540870 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:19.540806    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v" event={"ID":"fa54b504-1309-4e53-9a27-020e0bd4ae59","Type":"ContainerStarted","Data":"7b52696169e2a8f55848430dd6ee047947cfea7aab235f25312241534e9c796e"}
Jul 23 18:51:19.541077 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:19.540954    2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v" event={"ID":"fa54b504-1309-4e53-9a27-020e0bd4ae59","Type":"ContainerStarted","Data":"57ac4190c39784c2f7e4f42bb7c26340ec6a22a68b0a92ffe2376f99eb7d78c3"}
Jul 23 18:51:19.542106 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:19.542079    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:19.564306 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:19.564236    2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v" podStartSLOduration=1.5641979940000001 podStartE2EDuration="1.564197994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:51:19.561355167 +0000 UTC m=+2939.924199043" watchObservedRunningTime="2026-07-23 18:51:19.564197994 +0000 UTC m=+2939.927041846"
Jul 23 18:51:19.865790 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:19.865759    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/1.log"
Jul 23 18:51:19.874434 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:19.874401    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2znmx_48aa5870-cde6-4e62-bfe1-23850da12a63/console-operator/2.log"
Jul 23 18:51:20.692205 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:20.692167    2574 scope.go:117] "RemoveContainer" containerID="ef03b9a0af30e9299a0472b42ff06d2016ac58edb527d2e9fe1086d935f154a2"
Jul 23 18:51:20.706383 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:20.706359    2574 scope.go:117] "RemoveContainer" containerID="20307a3d39a3be4acd3b12c15bcc2a0501bd511ef0195603222884fe1e826daa"
Jul 23 18:51:21.127061 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:21.127027    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-lgl6q_48355f6a-e1f3-4762-8345-abe22c731896/volume-data-source-validator/0.log"
Jul 23 18:51:22.266796 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:22.266760    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvjbc_fbf30af5-97fb-434d-87a6-efc654c519db/dns/0.log"
Jul 23 18:51:22.300956 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:22.300931    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvjbc_fbf30af5-97fb-434d-87a6-efc654c519db/kube-rbac-proxy/0.log"
Jul 23 18:51:22.512877 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:22.512843    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nv8r5_058016a0-d6ab-4363-bc0a-f804b1b5716f/dns-node-resolver/0.log"
Jul 23 18:51:23.116576 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:23.116544    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-646d7cc4cd-8p4xd_5fc44631-5885-4007-bf2c-c54aa4c7bbcb/registry/0.log"
Jul 23 18:51:23.143402 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:23.143377    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6sx4r_1069ec60-3215-429b-b2e0-517286fe5600/node-ca/0.log"
Jul 23 18:51:24.598949 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:24.598921    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84ccbf468f-5g6m2_138be5b4-c9da-4a03-bc52-f4f97ff6f78d/kube-auth-proxy/0.log"
Jul 23 18:51:24.640474 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:24.640444    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m4tc6_27c48f64-09ee-441e-b24c-40cf615d962b/istio-proxy/0.log"
Jul 23 18:51:24.694401 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:24.694363    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m4tc6_27c48f64-09ee-441e-b24c-40cf615d962b/istio-proxy/1.log"
Jul 23 18:51:24.754311 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:24.754278    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8gbf7_bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947/payload-pre-processing/0.log"
Jul 23 18:51:24.809200 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:24.809168    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-l9m2f_bc362a74-6587-47b8-9def-ede22fee5e3d/payload-processing/0.log"
Jul 23 18:51:24.847402 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:24.847377    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6689ddd698-sx5jk_fca00c58-fee4-4d2b-910c-979d9b13dd72/router/0.log"
Jul 23 18:51:25.629175 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:25.629144    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m262c_8873245d-123f-4e44-bad1-94a7abe556c7/serve-healthcheck-canary/0.log"
Jul 23 18:51:26.539264 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:26.539234    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z6cm5_dc1d277c-2d3d-4cf5-8d38-6c9299f96081/kube-rbac-proxy/0.log"
Jul 23 18:51:26.568393 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:26.568367    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z6cm5_dc1d277c-2d3d-4cf5-8d38-6c9299f96081/exporter/0.log"
Jul 23 18:51:26.570046 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:26.570003    2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-vxp6v"
Jul 23 18:51:26.604440 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:26.604410    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z6cm5_dc1d277c-2d3d-4cf5-8d38-6c9299f96081/extractor/0.log"
Jul 23 18:51:28.484029 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:28.483998    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84ccbf468f-5g6m2_138be5b4-c9da-4a03-bc52-f4f97ff6f78d/kube-auth-proxy/0.log"
Jul 23 18:51:28.507501 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:28.507463    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m4tc6_27c48f64-09ee-441e-b24c-40cf615d962b/istio-proxy/0.log"
Jul 23 18:51:28.563993 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:28.563953    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m4tc6_27c48f64-09ee-441e-b24c-40cf615d962b/istio-proxy/1.log"
Jul 23 18:51:28.603611 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:28.603577    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8gbf7_bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947/payload-pre-processing/0.log"
Jul 23 18:51:28.632057 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:28.632023    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-l9m2f_bc362a74-6587-47b8-9def-ede22fee5e3d/payload-processing/0.log"
Jul 23 18:51:28.661904 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:28.661877    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6689ddd698-sx5jk_fca00c58-fee4-4d2b-910c-979d9b13dd72/router/0.log"
Jul 23 18:51:29.125602 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:29.125574    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nkgtn_58dad97b-037b-4fb6-ade8-ad2f5ff6afff/manager/0.log"
Jul 23 18:51:29.493721 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:29.493684    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-s7cl4_fc5a2c65-053f-4eea-a9d6-c837c04ba5d3/manager/0.log"
Jul 23 18:51:29.665751 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:29.665722    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jh9nw_fe76d075-337f-4a9b-8a05-fc041f546f0f/server/0.log"
Jul 23 18:51:29.799085 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:29.799049    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gqnqb_74967bc8-0d98-4f92-814b-a338a0991e8a/manager/0.log"
Jul 23 18:51:30.033130 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:30.033093    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-hw578_5a70bf0f-d407-407d-aef9-c6a8e87cae46/manager/0.log"
Jul 23 18:51:30.062589 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:30.062556    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-hw578_5a70bf0f-d407-407d-aef9-c6a8e87cae46/copy-manifests/0.log"
Jul 23 18:51:30.396057 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:30.396027    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84ccbf468f-5g6m2_138be5b4-c9da-4a03-bc52-f4f97ff6f78d/kube-auth-proxy/0.log"
Jul 23 18:51:30.423031 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:30.422997    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m4tc6_27c48f64-09ee-441e-b24c-40cf615d962b/istio-proxy/0.log"
Jul 23 18:51:30.474804 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:30.474774    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-m4tc6_27c48f64-09ee-441e-b24c-40cf615d962b/istio-proxy/1.log"
Jul 23 18:51:30.520021 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:30.519990    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-8gbf7_bd3a5cd0-3a0c-44c5-abd6-1d4b8517a947/payload-pre-processing/0.log"
Jul 23 18:51:30.558574 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:30.558543    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-l9m2f_bc362a74-6587-47b8-9def-ede22fee5e3d/payload-processing/0.log"
Jul 23 18:51:30.592184 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:30.592158    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6689ddd698-sx5jk_fca00c58-fee4-4d2b-910c-979d9b13dd72/router/0.log"
Jul 23 18:51:31.817818 ip-10-0-143-41 kubenswrapper[2574]: I0723 18:51:31.817786    2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-x2dkl_0ba8dfbb-87f4-409b-92b6-bab37660b880/openshift-lws-operator/0.log"